Trace number 3742640

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.4 624.116

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathBA/
normalized-BeauxArts_K70.opb
MD5SUMe50339bba16007b68fcf75042d633deb
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark10.8114
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables3850
Total number of constraints3992
Number of constraints which are clauses3922
Number of constraints which are cardinality constraints (but not clauses)70
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint70
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 71
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3742640-1339251389.opb.
0.00/0.00	c Instance file HOME/instance-3742640-1339251389.opb
0.00/0.00	c File size is 237140 bytes.
0.00/0.09	c Highest Coefficient sum: 71
0.00/0.09	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.10	c ============================[ Problem Statistics ]=============================
0.00/0.10	c |                                                                             |
0.00/0.10	c |  Parsing time:          0.10         s                                      |
0.00/0.10	c |  Number Variables:      3850                                                |
0.00/0.10	c |  Number Constraints:    3992                                                |
0.00/0.10	c ===============================================================================

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742640-1339251389/watcher-3742640-1339251389 -o /tmp/evaluation-result-3742640-1339251389/solver-3742640-1339251389 -C 1800 -W 1900 -M 15500 run HOME/instance-3742640-1339251389.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.42 5.84 4.49 3/175 1372
/proc/meminfo: memFree=29458032/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0

[startup+0.0706721 s]
/proc/loadavg: 8.42 5.84 4.49 3/175 1372
/proc/meminfo: memFree=29458032/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100237 s]
/proc/loadavg: 8.42 5.84 4.49 3/175 1372
/proc/meminfo: memFree=29458032/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300202 s]
/proc/loadavg: 8.42 5.84 4.49 3/175 1372
/proc/meminfo: memFree=29458032/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700177 s]
/proc/loadavg: 8.42 5.84 4.49 3/175 1372
/proc/meminfo: memFree=29458032/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50021 s]
/proc/loadavg: 8.42 5.84 4.49 3/177 1374
/proc/meminfo: memFree=29448112/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=25952 CPUtime=1.49 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 4769 0 0 0 149 0 0 0 20 0 1 0 391267365 26574848 3309 33554432000 134512640 146736320 4289596928 4289590984 136474230 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 6488 3309 778 2985 0 3422 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 35100

[startup+3.10021 s]
/proc/loadavg: 8.42 5.84 4.49 3/177 1374
/proc/meminfo: memFree=29447120/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=25952 CPUtime=3.09 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 4772 0 0 0 309 0 0 0 20 0 1 0 391267365 26574848 3312 33554432000 134512640 146736320 4289596928 4289591224 136015526 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 6488 3312 778 2985 0 3422 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 35100

[startup+6.30022 s]
/proc/loadavg: 7.90 5.77 4.48 3/176 1374
/proc/meminfo: memFree=29442788/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=32476 CPUtime=6.29 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 6788 0 0 0 629 0 0 0 20 0 1 0 391267365 33255424 4549 33554432000 134512640 146736320 4289596928 4289590656 136000333 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 8119 4549 834 2985 0 5053 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 41624

[startup+12.7002 s]
/proc/loadavg: 7.43 5.71 4.47 3/177 1375
/proc/meminfo: memFree=29443372/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=32612 CPUtime=12.69 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 7002 0 0 0 1269 0 0 0 20 0 1 0 391267365 33394688 4593 33554432000 134512640 146736320 4289596928 4289591192 136385265 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 8153 4593 837 2985 0 5087 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 41760

[startup+25.5002 s]
/proc/loadavg: 6.23 5.53 4.43 3/177 1375
/proc/meminfo: memFree=29442120/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=34308 CPUtime=25.48 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 7922 0 0 0 2547 1 0 0 20 0 1 0 391267365 35131392 5533 33554432000 134512640 146736320 4289596928 4289590852 136385179 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 8577 5533 841 2985 0 5511 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 43456

[startup+51.1002 s]
/proc/loadavg: 4.78 5.24 4.36 3/177 1375
/proc/meminfo: memFree=29442244/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=29676 CPUtime=51.07 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 10801 0 0 0 5106 1 0 0 20 0 1 0 391267365 30388224 4913 33554432000 134512640 146736320 4289596928 4289589628 135447033 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 7419 4913 844 2985 0 4353 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 38824

[startup+102.306 s]
/proc/loadavg: 5.59 5.30 4.42 10/184 1442
/proc/meminfo: memFree=29648488/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=162768 CPUtime=179.19 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 24563 0 0 0 17912 7 0 0 20 0 8 0 391267365 166674432 16476 33554432000 134512640 146736320 4289596928 4289590024 136000308 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 40692 16476 885 2985 0 37626 0
[pid=1373/tid=1376] ppid=1372 vsize=162768 CPUtime=12.77 cores=0,2,4,6
/proc/1373/task/1376/stat : 1376 (pb_cplex) R 1372 1372 32287 0 -1 4202560 746 0 0 0 1277 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4141326376 139044542 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1377] ppid=1372 vsize=162768 CPUtime=12.76 cores=0,2,4,6
/proc/1373/task/1377/stat : 1377 (pb_cplex) R 1372 1372 32287 0 -1 4202560 844 0 0 0 1276 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4130841168 136403109 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1378] ppid=1372 vsize=162768 CPUtime=12.86 cores=0,2,4,6
/proc/1373/task/1378/stat : 1378 (pb_cplex) R 1372 1372 32287 0 -1 4202560 759 0 0 0 1286 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4120355032 136008653 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1379] ppid=1372 vsize=162768 CPUtime=12.72 cores=0,2,4,6
/proc/1373/task/1379/stat : 1379 (pb_cplex) R 1372 1372 32287 0 -1 4202560 903 0 0 0 1272 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4109869644 139028288 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1380] ppid=1372 vsize=162768 CPUtime=12.81 cores=0,2,4,6
/proc/1373/task/1380/stat : 1380 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1748 0 0 0 1281 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4099382444 135454079 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1381] ppid=1372 vsize=162768 CPUtime=12.87 cores=0,2,4,6
/proc/1373/task/1381/stat : 1381 (pb_cplex) R 1372 1372 32287 0 -1 4202560 945 0 0 0 1287 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4088897584 136384861 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1382] ppid=1372 vsize=162768 CPUtime=12.72 cores=0,2,4,6
/proc/1373/task/1382/stat : 1382 (pb_cplex) R 1372 1372 32287 0 -1 4202560 995 0 0 0 1272 0 0 0 20 0 8 0 391273741 166674432 16476 33554432000 134512640 146736320 4289596928 4078411848 136474219 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 179.19
Current children cumulated vsize (KiB) 171916

[startup+162.3 s]
/proc/loadavg: 7.20 5.78 4.64 10/184 1498
/proc/meminfo: memFree=29700912/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=172496 CPUtime=410.94 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 36410 0 0 0 41082 12 0 0 20 0 8 0 391267365 176635904 20633 33554432000 134512640 146736320 4289596928 4289588328 138462648 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 43124 20633 903 2985 0 40058 0
[pid=1373/tid=1376] ppid=1372 vsize=172496 CPUtime=47.02 cores=0,2,4,6
/proc/1373/task/1376/stat : 1376 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1687 0 0 0 4702 0 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4141326544 136008178 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1377] ppid=1372 vsize=172496 CPUtime=47.14 cores=0,2,4,6
/proc/1373/task/1377/stat : 1377 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1616 0 0 0 4714 0 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4130840264 136002916 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1378] ppid=1372 vsize=172496 CPUtime=35.39 cores=0,2,4,6
/proc/1373/task/1378/stat : 1378 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1739 0 0 0 3539 0 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4120353644 135457253 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1379] ppid=1372 vsize=172496 CPUtime=38.61 cores=0,2,4,6
/proc/1373/task/1379/stat : 1379 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1509 0 0 0 3860 1 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4109870104 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1380] ppid=1372 vsize=172496 CPUtime=44.69 cores=0,2,4,6
/proc/1373/task/1380/stat : 1380 (pb_cplex) R 1372 1372 32287 0 -1 4202560 8683 0 0 0 4466 3 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4099383752 136000758 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1381] ppid=1372 vsize=172496 CPUtime=43.17 cores=0,2,4,6
/proc/1373/task/1381/stat : 1381 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1584 0 0 0 4317 0 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4088897744 136007970 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1382] ppid=1372 vsize=172496 CPUtime=40.84 cores=0,2,4,6
/proc/1373/task/1382/stat : 1382 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1560 0 0 0 4084 0 0 0 20 0 8 0 391273741 176635904 20633 33554432000 134512640 146736320 4289596928 4078410192 135459704 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 410.94
Current children cumulated vsize (KiB) 181644

[startup+222.3 s]
/proc/loadavg: 8.23 6.34 4.90 10/185 1501
/proc/meminfo: memFree=29679432/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=179408 CPUtime=645.2 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 43527 0 0 0 64502 18 0 0 20 0 8 0 391267365 183713792 23100 33554432000 134512640 146736320 4289596928 4289589660 135855178 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/1373/statm: 44852 23100 908 2985 0 41786 0
[pid=1373/tid=1376] ppid=1372 vsize=179408 CPUtime=74.92 cores=0,2,4,6
/proc/1373/task/1376/stat : 1376 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1993 0 0 0 7490 2 0 0 20 0 8 0 391273741 183713792 23100 33554432000 134512640 146736320 4289596928 4141326404 136385185 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1377] ppid=1372 vsize=179408 CPUtime=74.67 cores=0,2,4,6

################
# More data... #
################

[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=127752 CPUtime=1212.68 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 56788 0 0 0 121221 47 0 0 20 0 1 0 391267365 130818048 17505 33554432000 134512640 146736320 4289596928 4289590992 136008328 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/1373/statm: 31938 17505 912 2985 0 28872 0
Current children cumulated CPU time (s) 1212.68
Current children cumulated vsize (KiB) 136900

[startup+462.3 s]
/proc/loadavg: 7.02 6.80 5.43 17/191 1524
/proc/meminfo: memFree=28997760/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=425760 CPUtime=1288.7 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 66787 0 0 0 128816 54 0 0 20 0 8 0 391267365 435978240 72625 33554432000 134512640 146736320 4289596928 4289590024 136000333 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 106440 72625 915 2985 0 103374 0
[pid=1373/tid=1518] ppid=1372 vsize=425760 CPUtime=2.7 cores=0,2,4,6
/proc/1373/task/1518/stat : 1518 (pb_cplex) R 1372 1372 32287 0 -1 4202560 941 0 0 0 270 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 4078410824 144714320 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1519] ppid=1372 vsize=425760 CPUtime=2.67 cores=0,2,4,6
/proc/1373/task/1519/stat : 1519 (pb_cplex) R 1372 1372 32287 0 -1 4202560 649 0 0 0 267 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 4088897744 136008441 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1520] ppid=1372 vsize=425760 CPUtime=2.59 cores=0,2,4,6
/proc/1373/task/1520/stat : 1520 (pb_cplex) R 1372 1372 32287 0 -1 4202560 611 0 0 0 259 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 4099383368 139042910 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1521] ppid=1372 vsize=425760 CPUtime=2.66 cores=0,2,4,6
/proc/1373/task/1521/stat : 1521 (pb_cplex) R 1372 1372 32287 0 -1 4202560 578 0 0 0 266 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 4109869264 136008212 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1522] ppid=1372 vsize=425760 CPUtime=2.66 cores=0,2,4,6
/proc/1373/task/1522/stat : 1522 (pb_cplex) R 1372 1372 32287 0 -1 4202560 727 0 0 0 266 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 3798298248 135982683 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1523] ppid=1372 vsize=425760 CPUtime=2.66 cores=0,2,4,6
/proc/1373/task/1523/stat : 1523 (pb_cplex) R 1372 1372 32287 0 -1 4202560 821 0 0 0 266 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 3787813076 135846451 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1524] ppid=1372 vsize=425760 CPUtime=2.64 cores=0,2,4,6
/proc/1373/task/1524/stat : 1524 (pb_cplex) R 1372 1372 32287 0 -1 4202560 687 0 0 0 264 0 0 0 20 0 8 0 391310123 435978240 72625 33554432000 134512640 146736320 4289596928 3777326224 136008165 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1288.7
Current children cumulated vsize (KiB) 434908

[startup+522.3 s]
/proc/loadavg: 7.93 7.31 5.70 4/184 1524
/proc/meminfo: memFree=29315468/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=428268 CPUtime=1496.08 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) S 1372 1372 32287 0 -1 4202496 67857 0 0 0 149550 58 0 0 20 0 8 0 391267365 438546432 73282 33554432000 134512640 146736320 4289596928 4289593296 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/1373/statm: 107067 73282 915 2985 0 104001 0
[pid=1373/tid=1518] ppid=1372 vsize=428268 CPUtime=20.03 cores=0,2,4,6
/proc/1373/task/1518/stat : 1518 (pb_cplex) S 1372 1372 32287 0 -1 4202560 990 0 0 0 2003 0 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 4078415504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1519] ppid=1372 vsize=428268 CPUtime=42.9 cores=0,2,4,6
/proc/1373/task/1519/stat : 1519 (pb_cplex) R 1372 1372 32287 0 -1 4202560 759 0 0 0 4290 0 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 4088897744 136008234 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1520] ppid=1372 vsize=428268 CPUtime=25.64 cores=0,2,4,6
/proc/1373/task/1520/stat : 1520 (pb_cplex) S 1372 1372 32287 0 -1 4202560 616 0 0 0 2564 0 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 4099387024 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1521] ppid=1372 vsize=428268 CPUtime=42.75 cores=0,2,4,6
/proc/1373/task/1521/stat : 1521 (pb_cplex) R 1372 1372 32287 0 -1 4202560 962 0 0 0 4274 1 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 4109869128 139042974 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1522] ppid=1372 vsize=428268 CPUtime=27.67 cores=0,2,4,6
/proc/1373/task/1522/stat : 1522 (pb_cplex) S 1372 1372 32287 0 -1 4202560 884 0 0 0 2767 0 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 3798302352 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1523] ppid=1372 vsize=428268 CPUtime=18.36 cores=0,2,4,6
/proc/1373/task/1523/stat : 1523 (pb_cplex) S 1372 1372 32287 0 -1 4202560 828 0 0 0 1836 0 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 3787816592 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1524] ppid=1372 vsize=428268 CPUtime=24.28 cores=0,2,4,6
/proc/1373/task/1524/stat : 1524 (pb_cplex) S 1372 1372 32287 0 -1 4202560 783 0 0 0 2428 0 0 0 20 0 8 0 391310123 438546432 73282 33554432000 134512640 146736320 4289596928 3777330832 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1496.08
Current children cumulated vsize (KiB) 437416

[startup+582.3 s]
/proc/loadavg: 5.96 6.77 5.61 10/191 1567
/proc/meminfo: memFree=29202728/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=433140 CPUtime=1637.42 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 71058 0 0 0 163680 62 0 0 20 0 8 0 391267365 443535360 75295 33554432000 134512640 146736320 4289596928 4289589784 136009126 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/1373/statm: 108285 75295 915 2985 0 105219 0
[pid=1373/tid=1518] ppid=1372 vsize=433140 CPUtime=28.92 cores=0,2,4,6
/proc/1373/task/1518/stat : 1518 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1415 0 0 0 2891 1 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 4078411984 136008364 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1519] ppid=1372 vsize=433140 CPUtime=80 cores=0,2,4,6
/proc/1373/task/1519/stat : 1519 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1157 0 0 0 7998 2 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 4088897928 136388075 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1520] ppid=1372 vsize=433140 CPUtime=34.51 cores=0,2,4,6
/proc/1373/task/1520/stat : 1520 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1133 0 0 0 3451 0 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 4099383352 136475800 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1521] ppid=1372 vsize=433140 CPUtime=93.61 cores=0,2,4,6
/proc/1373/task/1521/stat : 1521 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1919 0 0 0 9357 4 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 4109869148 135855174 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1522] ppid=1372 vsize=433140 CPUtime=36.58 cores=0,2,4,6
/proc/1373/task/1522/stat : 1522 (pb_cplex) R 1372 1372 32287 0 -1 4202560 958 0 0 0 3658 0 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 3798298692 136385170 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1523] ppid=1372 vsize=433140 CPUtime=27.05 cores=0,2,4,6
/proc/1373/task/1523/stat : 1523 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1382 0 0 0 2705 0 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 3787813024 136006005 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1524] ppid=1372 vsize=433140 CPUtime=33.21 cores=0,2,4,6
/proc/1373/task/1524/stat : 1524 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1021 0 0 0 3321 0 0 0 20 0 8 0 391310123 443535360 75295 33554432000 134512640 146736320 4289596928 3777327320 136008596 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1637.42
Current children cumulated vsize (KiB) 442288



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+624.1 s]
/proc/loadavg: 10.66 7.88 6.04 17/191 1568
/proc/meminfo: memFree=28941828/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=438672 CPUtime=1797.63 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 73935 0 0 0 179697 66 0 0 20 0 8 0 391267365 449200128 78366 33554432000 134512640 146736320 4289596928 4289589568 136019038 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 109668 78366 917 2985 0 106602 0
[pid=1373/tid=1518] ppid=1372 vsize=438672 CPUtime=52.01 cores=0,2,4,6
/proc/1373/task/1518/stat : 1518 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1644 0 0 0 5200 1 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4078411844 136385175 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1519] ppid=1372 vsize=438672 CPUtime=98.68 cores=0,2,4,6
/proc/1373/task/1519/stat : 1519 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1346 0 0 0 9866 2 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4088897744 136008168 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1520] ppid=1372 vsize=438672 CPUtime=55.5 cores=0,2,4,6
/proc/1373/task/1520/stat : 1520 (pb_cplex) R 1372 1372 32287 0 -1 4202560 2317 0 0 0 5549 1 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4099383408 136384846 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1521] ppid=1372 vsize=438672 CPUtime=112.23 cores=0,2,4,6
/proc/1373/task/1521/stat : 1521 (pb_cplex) R 1372 1372 32287 0 -1 4202560 2213 0 0 0 11218 5 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4109869264 136008042 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1522] ppid=1372 vsize=438672 CPUtime=55.53 cores=0,2,4,6
/proc/1373/task/1522/stat : 1522 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1434 0 0 0 5553 0 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 3798298832 136008116 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1523] ppid=1372 vsize=438672 CPUtime=44.8 cores=0,2,4,6
/proc/1373/task/1523/stat : 1523 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1649 0 0 0 4480 0 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 3787812864 136018924 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1524] ppid=1372 vsize=438672 CPUtime=55.62 cores=0,2,4,6
/proc/1373/task/1524/stat : 1524 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1169 0 0 0 5561 1 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 3777326292 135455279 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1797.63
Current children cumulated vsize (KiB) 447820

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+624.1 s]
/proc/loadavg: 10.66 7.88 6.04 17/191 1568
/proc/meminfo: memFree=28941828/32873844 swapFree=7124/7124
[pid=1372] ppid=1369 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1372/stat : 1372 (run) S 1369 1372 32287 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391267365 9367552 270 33554432000 4194304 5064252 140735301275056 140735301273968 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1372/statm: 2287 270 229 213 0 72 0
[pid=1373] ppid=1372 vsize=438672 CPUtime=1797.63 cores=0,2,4,6
/proc/1373/stat : 1373 (pb_cplex) R 1372 1372 32287 0 -1 4202496 73935 0 0 0 179697 66 0 0 20 0 8 0 391267365 449200128 78366 33554432000 134512640 146736320 4289596928 4289589568 136019038 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/1373/statm: 109668 78366 917 2985 0 106602 0
[pid=1373/tid=1518] ppid=1372 vsize=438672 CPUtime=52.01 cores=0,2,4,6
/proc/1373/task/1518/stat : 1518 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1644 0 0 0 5200 1 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4078411844 136385175 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1519] ppid=1372 vsize=438672 CPUtime=98.68 cores=0,2,4,6
/proc/1373/task/1519/stat : 1519 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1346 0 0 0 9866 2 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4088897744 136008168 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1520] ppid=1372 vsize=438672 CPUtime=55.5 cores=0,2,4,6
/proc/1373/task/1520/stat : 1520 (pb_cplex) R 1372 1372 32287 0 -1 4202560 2317 0 0 0 5549 1 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4099383408 136384846 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=1373/tid=1521] ppid=1372 vsize=438672 CPUtime=112.23 cores=0,2,4,6
/proc/1373/task/1521/stat : 1521 (pb_cplex) R 1372 1372 32287 0 -1 4202560 2213 0 0 0 11218 5 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 4109869264 136008042 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=1373/tid=1522] ppid=1372 vsize=438672 CPUtime=55.53 cores=0,2,4,6
/proc/1373/task/1522/stat : 1522 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1434 0 0 0 5553 0 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 3798298832 136008116 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=1373/tid=1523] ppid=1372 vsize=438672 CPUtime=44.8 cores=0,2,4,6
/proc/1373/task/1523/stat : 1523 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1649 0 0 0 4480 0 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 3787812864 136018924 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=1373/tid=1524] ppid=1372 vsize=438672 CPUtime=55.62 cores=0,2,4,6
/proc/1373/task/1524/stat : 1524 (pb_cplex) R 1372 1372 32287 0 -1 4202560 1169 0 0 0 5561 1 0 0 20 0 8 0 391310123 449200128 78366 33554432000 134512640 146736320 4289596928 3777326292 135455279 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1797.63
Current children cumulated vsize (KiB) 447820

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1372 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1797.63
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 2.77014
#  lost CPU user time (s): 2.93005
#  lost CPU system time (s): -0.16

Real time (s): 624.116
CPU time (s): 1800.4
CPU user time (s): 1799.9
CPU system time (s): 0.5
CPU usage (%): 288.472
Max. virtual memory (cumulated for all children) (KiB): 447820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.57176 second user time and 3.42548 second system time

The end

Launcher Data 

Begin job on node110 at 2012-06-09 16:16:29
IDJOB=3742640
IDBENCH=90219
IDSOLVER=2325
FILE ID=node110/3742640-1339251389
RUNJOBID= node110-1339246832-32304
PBS_JOBID= 14644371
Free space on /tmp= 69256 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathBA/normalized-BeauxArts_K70.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742640-1339251389/watcher-3742640-1339251389 -o /tmp/evaluation-result-3742640-1339251389/solver-3742640-1339251389 -C 1800 -W 1900 -M 15500  run HOME/instance-3742640-1339251389.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e50339bba16007b68fcf75042d633deb
RANDOM SEED=1994886045

node110.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29457684 kB
Buffers:          205220 kB
Cached:          1993068 kB
SwapCached:         1880 kB
Active:          2431164 kB
Inactive:          96804 kB
Active(anon):     325972 kB
Inactive(anon):     6128 kB
Active(file):    2105192 kB
Inactive(file):    90676 kB
Unevictable:        7124 kB
Mlocked:            7124 kB
SwapTotal:      67108856 kB
SwapFree:       67099064 kB
Dirty:             16692 kB
Writeback:             0 kB
AnonPages:        418056 kB
Mapped:            12140 kB
Shmem:                 0 kB
Slab:             745748 kB
SReclaimable:     186832 kB
SUnreclaim:       558916 kB
KernelStack:        1528 kB
PageTables:         4332 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     597380 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    331776 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3742640-1339251389.opb

Free space on /tmp at the end= 69248 MiB
End job on node110 at 2012-06-09 16:26:54