Trace number 3742705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.03 621.917

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathBA/
normalized-BeauxArts_K76.opb
MD5SUMb21b0bbddae7db554b549f6efc66327c
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1.82672
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables4180
Total number of constraints4334
Number of constraints which are clauses4258
Number of constraints which are cardinality constraints (but not clauses)76
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint76
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 77
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3742705-1339251409.opb.
0.00/0.00	c Instance file HOME/instance-3742705-1339251409.opb
0.00/0.00	c File size is 258078 bytes.
0.00/0.10	c Highest Coefficient sum: 77
0.00/0.10	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.11	c ============================[ Problem Statistics ]=============================
0.00/0.11	c |                                                                             |
0.00/0.11	c |  Parsing time:          0.11         s                                      |
0.00/0.11	c |  Number Variables:      4180                                                |
0.00/0.11	c |  Number Constraints:    4334                                                |
0.00/0.11	c ===============================================================================
1799.48/621.91	c Remaining time 1799.89 sec.
1799.48/621.91	c 
1799.48/621.91	c *** INTERRUPTED ***
1799.48/621.91	s UNKNOWN
1799.48/621.91	c Total CPU time              : 1798.86 s
1799.48/621.91	c Memory used           : 455.92 MB
1799.48/621.91	c CPU time              : 1798.86 s
1799.48/621.91	c 
1799.48/621.91	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742705-1339251409/watcher-3742705-1339251409 -o /tmp/evaluation-result-3742705-1339251409/solver-3742705-1339251409 -C 1800 -W 1900 -M 15500 run HOME/instance-3742705-1339251409.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.13 2.04 2.57 3/177 7492
/proc/meminfo: memFree=28415848/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0

[startup+0.0245869 s]
/proc/loadavg: 2.13 2.04 2.57 3/177 7492
/proc/meminfo: memFree=28415848/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100256 s]
/proc/loadavg: 2.13 2.04 2.57 3/177 7492
/proc/meminfo: memFree=28415848/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300273 s]
/proc/loadavg: 2.13 2.04 2.57 3/177 7492
/proc/meminfo: memFree=28415848/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700229 s]
/proc/loadavg: 2.13 2.04 2.57 3/177 7492
/proc/meminfo: memFree=28415848/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50026 s]
/proc/loadavg: 2.13 2.04 2.57 3/179 7494
/proc/meminfo: memFree=28406052/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=27272 CPUtime=1.49 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 5172 0 0 0 148 1 0 0 20 0 1 0 391265396 27926528 3509 33554432000 134512640 146736320 4291787072 4291781148 135855162 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 6818 3509 778 2985 0 3752 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 36420

[startup+3.10026 s]
/proc/loadavg: 2.13 2.04 2.57 3/179 7494
/proc/meminfo: memFree=28404936/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=27272 CPUtime=3.09 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 5186 0 0 0 308 1 0 0 20 0 1 0 391265396 27926528 3523 33554432000 134512640 146736320 4291787072 4291781368 136015703 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 6818 3523 778 2985 0 3752 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 36420

[startup+6.30028 s]
/proc/loadavg: 2.12 2.04 2.57 3/179 7494
/proc/meminfo: memFree=28404192/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=35032 CPUtime=6.29 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 7183 0 0 0 628 1 0 0 20 0 1 0 391265396 35872768 4746 33554432000 134512640 146736320 4291787072 4291781132 136017642 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 8758 4746 817 2985 0 5692 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 44180

[startup+12.7003 s]
/proc/loadavg: 2.11 2.04 2.57 3/179 7494
/proc/meminfo: memFree=28399040/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=34940 CPUtime=12.68 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 8054 0 0 0 1267 1 0 0 20 0 1 0 391265396 35778560 5001 33554432000 134512640 146736320 4291787072 4291780884 135855162 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 8735 5001 837 2985 0 5669 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 44088

[startup+25.5003 s]
/proc/loadavg: 2.09 2.04 2.56 3/179 7494
/proc/meminfo: memFree=28396940/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=36364 CPUtime=25.48 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 10716 0 0 0 2547 1 0 0 20 0 1 0 391265396 37236736 5464 33554432000 134512640 146736320 4291787072 4291781384 136000416 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 9091 5464 840 2985 0 6025 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 45512

[startup+51.1003 s]
/proc/loadavg: 2.06 2.03 2.54 3/179 7494
/proc/meminfo: memFree=28396940/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=36808 CPUtime=51.08 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 13406 0 0 0 5106 2 0 0 20 0 1 0 391265396 37691392 5623 33554432000 134512640 146736320 4291787072 4291780996 136385167 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 9202 5623 841 2985 0 6136 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 45956

[startup+102.306 s]
/proc/loadavg: 2.02 2.02 2.51 3/179 7494
/proc/meminfo: memFree=28400344/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=31132 CPUtime=102.28 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 15546 0 0 0 10225 3 0 0 20 0 1 0 391265396 31879168 4639 33554432000 134512640 146736320 4291787072 4291782232 144757825 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/7493/statm: 7783 4639 844 2985 0 4717 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 40280

[startup+162.3 s]
/proc/loadavg: 4.76 2.69 2.70 8/186 7551
/proc/meminfo: memFree=28511296/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=170288 CPUtime=251.14 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 29693 0 0 0 25105 9 0 0 20 0 8 0 391265396 174374912 18232 33554432000 134512640 146736320 4291787072 4291779920 136008065 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7493/statm: 42572 18232 882 2985 0 39506 0
[pid=7493/tid=7495] ppid=7492 vsize=170288 CPUtime=11.14 cores=1,3,5,7
/proc/7493/task/7495/stat : 7495 (pb_cplex) S 7492 7492 6357 0 -1 4202560 1308 0 0 0 1114 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4138634896 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7496] ppid=7492 vsize=170288 CPUtime=18.86 cores=1,3,5,7
/proc/7493/task/7496/stat : 7496 (pb_cplex) R 7492 7492 6357 0 -1 4202560 939 0 0 0 1886 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4128145512 136384781 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7497] ppid=7492 vsize=170288 CPUtime=14.78 cores=1,3,5,7
/proc/7493/task/7497/stat : 7497 (pb_cplex) R 7492 7492 6357 0 -1 4202560 818 0 0 0 1478 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4117659704 136475800 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7498] ppid=7492 vsize=170288 CPUtime=18.9 cores=1,3,5,7
/proc/7493/task/7498/stat : 7498 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1028 0 0 0 1890 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4107174104 136008653 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7499] ppid=7492 vsize=170288 CPUtime=11.05 cores=1,3,5,7
/proc/7493/task/7499/stat : 7499 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1018 0 0 0 1105 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4096688184 136475868 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7500] ppid=7492 vsize=170288 CPUtime=15.5 cores=1,3,5,7
/proc/7493/task/7500/stat : 7500 (pb_cplex) R 7492 7492 6357 0 -1 4202560 898 0 0 0 1550 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4086202644 136003522 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7501] ppid=7492 vsize=170288 CPUtime=13.05 cores=1,3,5,7
/proc/7493/task/7501/stat : 7501 (pb_cplex) S 7492 7492 6357 0 -1 4202560 1008 0 0 0 1305 0 0 0 20 0 8 0 391277315 174374912 18232 33554432000 134512640 146736320 4291787072 4075720336 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 251.14
Current children cumulated vsize (KiB) 179436

[startup+222.3 s]
/proc/loadavg: 5.84 3.29 2.90 10/187 7554
/proc/meminfo: memFree=28494884/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=173428 CPUtime=441.06 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 34398 0 0 0 44093 13 0 0 20 0 8 0 391265396 177590272 21177 33554432000 134512640 146736320 4291787072 4291779780 136385179 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7493/statm: 43357 21177 908 2985 0 40291 0
[pid=7493/tid=7495] ppid=7492 vsize=173428 CPUtime=24.4 cores=1,3,5,7
/proc/7493/task/7495/stat : 7495 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1707 0 0 0 2440 0 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4138631240 139042899 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7496] ppid=7492 vsize=173428 CPUtime=37.38 cores=1,3,5,7
/proc/7493/task/7496/stat : 7496 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2469 0 0 0 3737 1 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4128145624 136009159 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7497] ppid=7492 vsize=173428 CPUtime=31.6 cores=1,3,5,7
/proc/7493/task/7497/stat : 7497 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1118 0 0 0 3160 0 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4117658476 135456844 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7498] ppid=7492 vsize=173428 CPUtime=58.95 cores=1,3,5,7
/proc/7493/task/7498/stat : 7498 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1110 0 0 0 5893 2 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4107173960 139042902 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7499] ppid=7492 vsize=173428 CPUtime=55.63 cores=1,3,5,7
/proc/7493/task/7499/stat : 7499 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1109 0 0 0 5563 0 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4096689128 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7500] ppid=7492 vsize=173428 CPUtime=41.78 cores=1,3,5,7
/proc/7493/task/7500/stat : 7500 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2502 0 0 0 4176 2 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4086202436 136385179 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7501] ppid=7492 vsize=173428 CPUtime=26.68 cores=1,3,5,7
/proc/7493/task/7501/stat : 7501 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1056 0 0 0 2668 0 0 0 20 0 8 0 391277315 177590272 21177 33554432000 134512640 146736320 4291787072 4075716664 136475800 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 441.06
Current children cumulated vsize (KiB) 182576


################
# More data... #
################

[pid=7493] ppid=7492 vsize=147176 CPUtime=1159.93 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 45697 0 0 0 115947 46 0 0 20 0 1 0 391265396 150708224 22380 33554432000 134512640 146736320 4291787072 4291783832 144757825 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/7493/statm: 36794 22380 912 2985 0 33728 0
Current children cumulated CPU time (s) 1159.93
Current children cumulated vsize (KiB) 156324
#
############


[startup+462.3 s]
/proc/loadavg: 4.71 5.21 3.85 3/186 7562
/proc/meminfo: memFree=28319936/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=427708 CPUtime=1214.83 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 51260 0 0 0 121431 52 0 0 20 0 8 0 391265396 437972992 60031 33554432000 134512640 146736320 4291787072 4291779920 136008172 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7493/statm: 106927 60031 917 2985 0 103861 0
[pid=7493/tid=7556] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7556/stat : 7556 (pb_cplex) S 7492 7492 6357 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 4075720336 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7557] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7557/stat : 7557 (pb_cplex) S 7492 7492 6357 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 4086206096 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7558] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7558/stat : 7558 (pb_cplex) S 7492 7492 6357 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 4096691856 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7559] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7559/stat : 7559 (pb_cplex) S 7492 7492 6357 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 4107177616 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7560] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7560/stat : 7560 (pb_cplex) S 7492 7492 6357 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 3784634000 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7561] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7561/stat : 7561 (pb_cplex) S 7492 7492 6357 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 3774148240 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7562] ppid=7492 vsize=427708 CPUtime=0 cores=1,3,5,7
/proc/7493/task/7562/stat : 7562 (pb_cplex) S 7492 7492 6357 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391311251 437972992 60031 33554432000 134512640 146736320 4291787072 3763662480 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1214.83
Current children cumulated vsize (KiB) 436856

[startup+522.3 s]
/proc/loadavg: 6.92 5.75 4.12 5/193 7583
/proc/meminfo: memFree=28135348/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=458312 CPUtime=1439.75 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) S 7492 7492 6357 0 -1 4202496 57932 0 0 0 143919 56 0 0 20 0 8 0 391265396 469311488 66071 33554432000 134512640 146736320 4291787072 4291783440 144580073 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7493/statm: 114578 66071 917 2985 0 111512 0
[pid=7493/tid=7556] ppid=7492 vsize=458312 CPUtime=30.11 cores=1,3,5,7
/proc/7493/task/7556/stat : 7556 (pb_cplex) R 7492 7492 6357 0 -1 4202560 857 0 0 0 3011 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 4075716816 136008176 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7557] ppid=7492 vsize=458312 CPUtime=29.7 cores=1,3,5,7
/proc/7493/task/7557/stat : 7557 (pb_cplex) R 7492 7492 6357 0 -1 4202560 949 0 0 0 2970 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 4086201556 135455282 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7558] ppid=7492 vsize=458312 CPUtime=30.66 cores=1,3,5,7
/proc/7493/task/7558/stat : 7558 (pb_cplex) R 7492 7492 6357 0 -1 4202560 689 0 0 0 3066 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 4096688168 139044505 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7559] ppid=7492 vsize=458312 CPUtime=27.91 cores=1,3,5,7
/proc/7493/task/7559/stat : 7559 (pb_cplex) S 7492 7492 6357 0 -1 4202560 667 0 0 0 2791 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 4107177616 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7560] ppid=7492 vsize=458312 CPUtime=25.87 cores=1,3,5,7
/proc/7493/task/7560/stat : 7560 (pb_cplex) S 7492 7492 6357 0 -1 4202560 1141 0 0 0 2587 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 3784634000 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7561] ppid=7492 vsize=458312 CPUtime=26.57 cores=1,3,5,7
/proc/7493/task/7561/stat : 7561 (pb_cplex) S 7492 7492 6357 0 -1 4202560 1085 0 0 0 2657 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 3774148240 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7562] ppid=7492 vsize=458312 CPUtime=22.36 cores=1,3,5,7
/proc/7493/task/7562/stat : 7562 (pb_cplex) S 7492 7492 6357 0 -1 4202560 941 0 0 0 2236 0 0 0 20 0 8 0 391311251 469311488 66071 33554432000 134512640 146736320 4291787072 3763662480 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1439.75
Current children cumulated vsize (KiB) 467460

[startup+582.3 s]
/proc/loadavg: 7.57 6.07 4.33 10/193 7583
/proc/meminfo: memFree=28123372/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=463188 CPUtime=1644.25 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 61885 0 0 0 164364 61 0 0 20 0 8 0 391265396 474304512 68750 33554432000 134512640 146736320 4291787072 4291780304 136403112 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7493/statm: 115797 68750 917 2985 0 112731 0
[pid=7493/tid=7556] ppid=7492 vsize=463188 CPUtime=53.93 cores=1,3,5,7
/proc/7493/task/7556/stat : 7556 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1163 0 0 0 5393 0 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 4075716816 136008044 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7557] ppid=7492 vsize=463188 CPUtime=59.4 cores=1,3,5,7
/proc/7493/task/7557/stat : 7557 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1368 0 0 0 5940 0 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 4086202576 136008053 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7558] ppid=7492 vsize=463188 CPUtime=67.88 cores=1,3,5,7
/proc/7493/task/7558/stat : 7558 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1857 0 0 0 6786 2 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 4096688340 135846304 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7559] ppid=7492 vsize=463188 CPUtime=50.6 cores=1,3,5,7
/proc/7493/task/7559/stat : 7559 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1368 0 0 0 5059 1 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 4107173956 136385185 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7560] ppid=7492 vsize=463188 CPUtime=48.61 cores=1,3,5,7
/proc/7493/task/7560/stat : 7560 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1339 0 0 0 4860 1 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 3784629460 135455298 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7561] ppid=7492 vsize=463188 CPUtime=49.29 cores=1,3,5,7
/proc/7493/task/7561/stat : 7561 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1561 0 0 0 4927 2 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 3774144328 135525918 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7562] ppid=7492 vsize=463188 CPUtime=45.03 cores=1,3,5,7
/proc/7493/task/7562/stat : 7562 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1339 0 0 0 4502 1 0 0 20 0 8 0 391311251 474304512 68750 33554432000 134512640 146736320 4291787072 3763658968 136009078 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1644.25
Current children cumulated vsize (KiB) 472336



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+621.9 s]
/proc/loadavg: 8.22 6.42 4.52 10/193 7583
/proc/meminfo: memFree=28113320/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=466860 CPUtime=1799.48 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 65993 0 0 0 179884 64 0 0 20 0 8 0 391265396 478064640 71061 33554432000 134512640 146736320 4291787072 4291779920 136008396 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/7493/statm: 116715 71061 917 2985 0 113649 0
[pid=7493/tid=7556] ppid=7492 vsize=466860 CPUtime=74.21 cores=1,3,5,7
/proc/7493/task/7556/stat : 7556 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1341 0 0 0 7419 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4075716816 136008441 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7557] ppid=7492 vsize=466860 CPUtime=79.73 cores=1,3,5,7
/proc/7493/task/7557/stat : 7557 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1995 0 0 0 7970 3 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4086202644 136003493 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7558] ppid=7492 vsize=466860 CPUtime=86.55 cores=1,3,5,7
/proc/7493/task/7558/stat : 7558 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2615 0 0 0 8653 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4096688768 139046527 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7559] ppid=7492 vsize=466860 CPUtime=69.5 cores=1,3,5,7
/proc/7493/task/7559/stat : 7559 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1604 0 0 0 6948 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4107173768 136077373 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7560] ppid=7492 vsize=466860 CPUtime=69.7 cores=1,3,5,7
/proc/7493/task/7560/stat : 7560 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2297 0 0 0 6968 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 3784630364 135855165 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7561] ppid=7492 vsize=466860 CPUtime=68.69 cores=1,3,5,7
/proc/7493/task/7561/stat : 7561 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2296 0 0 0 6866 3 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 3774144720 136008044 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7562] ppid=7492 vsize=466860 CPUtime=61.98 cores=1,3,5,7
/proc/7493/task/7562/stat : 7562 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1500 0 0 0 6197 1 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 3763659344 136403109 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1799.48
Current children cumulated vsize (KiB) 476008

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+621.9 s]
/proc/loadavg: 8.22 6.42 4.52 10/193 7583
/proc/meminfo: memFree=28113320/32873844 swapFree=7900/7900
[pid=7492] ppid=7490 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7492/stat : 7492 (run) S 7490 7492 6357 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391265396 9367552 269 33554432000 4194304 5064252 140733285424304 140733285423216 225444521550 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/7492/statm: 2287 269 229 213 0 72 0
[pid=7493] ppid=7492 vsize=466860 CPUtime=1799.48 cores=1,3,5,7
/proc/7493/stat : 7493 (pb_cplex) R 7492 7492 6357 0 -1 4202496 65993 0 0 0 179884 64 0 0 20 0 8 0 391265396 478064640 71061 33554432000 134512640 146736320 4291787072 4291779920 136008396 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/7493/statm: 116715 71061 917 2985 0 113649 0
[pid=7493/tid=7556] ppid=7492 vsize=466860 CPUtime=74.21 cores=1,3,5,7
/proc/7493/task/7556/stat : 7556 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1341 0 0 0 7419 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4075716816 136008441 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7557] ppid=7492 vsize=466860 CPUtime=79.73 cores=1,3,5,7
/proc/7493/task/7557/stat : 7557 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1995 0 0 0 7970 3 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4086202644 136003493 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=7493/tid=7558] ppid=7492 vsize=466860 CPUtime=86.55 cores=1,3,5,7
/proc/7493/task/7558/stat : 7558 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2615 0 0 0 8653 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4096688768 139046527 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7559] ppid=7492 vsize=466860 CPUtime=69.5 cores=1,3,5,7
/proc/7493/task/7559/stat : 7559 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1604 0 0 0 6948 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 4107173768 136077373 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7493/tid=7560] ppid=7492 vsize=466860 CPUtime=69.7 cores=1,3,5,7
/proc/7493/task/7560/stat : 7560 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2297 0 0 0 6968 2 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 3784630364 135855165 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=7493/tid=7561] ppid=7492 vsize=466860 CPUtime=68.69 cores=1,3,5,7
/proc/7493/task/7561/stat : 7561 (pb_cplex) R 7492 7492 6357 0 -1 4202560 2296 0 0 0 6866 3 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 3774144720 136008044 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=7493/tid=7562] ppid=7492 vsize=466860 CPUtime=61.98 cores=1,3,5,7
/proc/7493/task/7562/stat : 7562 (pb_cplex) R 7492 7492 6357 0 -1 4202560 1500 0 0 0 6197 1 0 0 20 0 8 0 391311251 478064640 71061 33554432000 134512640 146736320 4291787072 3763659344 136403109 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1799.48
Current children cumulated vsize (KiB) 476008

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7492 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1799.48
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 0.550171
#  lost CPU user time (s): 0.700073
#  lost CPU system time (s): -0.15

Real time (s): 621.917
CPU time (s): 1800.03
CPU user time (s): 1799.54
CPU system time (s): 0.49
CPU usage (%): 289.433
Max. virtual memory (cumulated for all children) (KiB): 476008

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1076
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 354
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.49977 second user time and 4.07838 second system time

The end

Launcher Data 

Begin job on node137 at 2012-06-09 16:16:49
IDJOB=3742705
IDBENCH=90224
IDSOLVER=2325
FILE ID=node137/3742705-1339251409
RUNJOBID= node137-1339246832-6374
PBS_JOBID= 14644344
Free space on /tmp= 70916 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathBA/normalized-BeauxArts_K76.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742705-1339251409/watcher-3742705-1339251409 -o /tmp/evaluation-result-3742705-1339251409/solver-3742705-1339251409 -C 1800 -W 1900 -M 15500  run HOME/instance-3742705-1339251409.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b21b0bbddae7db554b549f6efc66327c
RANDOM SEED=1542200538

node137.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28416664 kB
Buffers:          576488 kB
Cached:          2717184 kB
SwapCached:         4640 kB
Active:          1752056 kB
Inactive:        1797892 kB
Active(anon):     243696 kB
Inactive(anon):     5856 kB
Active(file):    1508360 kB
Inactive(file):  1792036 kB
Unevictable:        7900 kB
Mlocked:            7900 kB
SwapTotal:      67108856 kB
SwapFree:       67097908 kB
Dirty:             16716 kB
Writeback:             0 kB
AnonPages:        251508 kB
Mapped:            12696 kB
Shmem:                 0 kB
Slab:             764996 kB
SReclaimable:     206020 kB
SUnreclaim:       558976 kB
KernelStack:        1480 kB
PageTables:         4640 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     481056 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    188416 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3742705-1339251409.opb

Free space on /tmp at the end= 70904 MiB
End job on node137 at 2012-06-09 16:27:13