Trace number 2697861

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.28 461.693

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900579996--soft-33-100-0.wbo
MD5SUM469cd609ab798a94b23843d73b73e9c6
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark340.634
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1837
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 93832
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 93831
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 677
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697861-1278054866.wbo.
0.00/0.00	c Instance file HOME/instance-2697861-1278054866.wbo
0.00/0.00	c File size is 92475 bytes.
0.00/0.67	c Highest Coefficient sum: 677
0.00/0.67	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.67	c ============================[ Problem Statistics ]=============================
0.00/0.67	c |                                                                             |
0.00/0.67	c |  Parsing time:          0.67         s                                      |
0.00/0.67	c |  Number Variables:      2068                                                |
0.00/0.68	c |  Number Constraints:    2708                                                |
0.00/0.68	c ===============================================================================
1800.22/461.62	c Remaining time 1799.32 sec.
1800.22/461.62	c 
1800.22/461.62	c *** INTERRUPTED ***
1800.22/461.62	s UNKNOWN
1800.22/461.62	c Total CPU time              : 1784.29 s
1800.22/461.62	c Memory used           : 150.47 MB
1800.22/461.62	c CPU time              : 1784.29 s
1800.22/461.62	c 
1800.22/461.62	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697861-1278054866/watcher-2697861-1278054866 -o /tmp/evaluation-result-2697861-1278054866/solver-2697861-1278054866 -C 1800 -W 2000 -M 3800 run HOME/instance-2697861-1278054866.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 20915
/proc/meminfo: memFree=31355676/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0

[startup+0.0913279 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 20915
/proc/meminfo: memFree=31355676/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100318 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 20915
/proc/meminfo: memFree=31355676/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300286 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 20915
/proc/meminfo: memFree=31355676/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700209 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 20915
/proc/meminfo: memFree=31355676/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50106 s]
/proc/loadavg: 0.22 0.05 0.01 3/181 20935
/proc/meminfo: memFree=31318540/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=86928 CPUtime=2.66
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 20210 0 0 0 258 8 0 0 17 0 1 0 146782638 89014272 7593 4089446400 134512640 146736320 4291750080 18446744073709551615 137707895 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/20916/statm: 21732 7593 1071 2985 0 18274 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 95628

[startup+3.10073 s]
/proc/loadavg: 0.22 0.05 0.01 3/181 20984
/proc/meminfo: memFree=31272412/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=122312 CPUtime=4.5
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 27678 0 0 0 441 9 0 0 19 0 8 0 146782638 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 136004548 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/20916/statm: 30578 8144 1080 2985 0 27120 0
[pid=20916/tid=20985] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20985/stat : 20985 (pb_cplex) S 20915 20915 20664 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=20986] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20986/stat : 20986 (pb_cplex) S 20915 20915 20664 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=20987] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20987/stat : 20987 (pb_cplex) S 20915 20915 20664 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=20988] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20988/stat : 20988 (pb_cplex) S 20915 20915 20664 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=20989] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20989/stat : 20989 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=20990] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20990/stat : 20990 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=20991] ppid=20915 vsize=122312 CPUtime=0
/proc/20916/task/20991/stat : 20991 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 8 0 146782848 125247488 8144 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.5
Current children cumulated vsize (KiB) 131012

[startup+6.31715 s]
/proc/loadavg: 0.84 0.18 0.06 8/195 21012
/proc/meminfo: memFree=31247624/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=135864 CPUtime=17.28
/proc/20916/stat : 20916 (pb_cplex) S 20915 20915 20664 0 -1 4202496 38179 0 0 0 1708 20 0 0 16 0 8 0 146782638 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/20916/statm: 33966 11637 1082 2985 0 30508 0
[pid=20916/tid=20985] ppid=20915 vsize=135864 CPUtime=1.59
/proc/20916/task/20985/stat : 20985 (pb_cplex) S 20915 20915 20664 0 -1 4202560 474 0 0 0 158 1 0 0 16 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 7 0 0 0
[pid=20916/tid=20986] ppid=20915 vsize=135864 CPUtime=1.7
/proc/20916/task/20986/stat : 20986 (pb_cplex) S 20915 20915 20664 0 -1 4202560 349 0 0 0 169 1 0 0 15 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 5 0 0 0
[pid=20916/tid=20987] ppid=20915 vsize=135864 CPUtime=1.37
/proc/20916/task/20987/stat : 20987 (pb_cplex) S 20915 20915 20664 0 -1 4202560 569 0 0 0 137 0 0 0 15 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 3 0 0 0
[pid=20916/tid=20988] ppid=20915 vsize=135864 CPUtime=1.5
/proc/20916/task/20988/stat : 20988 (pb_cplex) S 20915 20915 20664 0 -1 4202560 424 0 0 0 149 1 0 0 15 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 2 0 0 0
[pid=20916/tid=20989] ppid=20915 vsize=135864 CPUtime=1.44
/proc/20916/task/20989/stat : 20989 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1542 0 0 0 142 2 0 0 15 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 1 0 0 0
[pid=20916/tid=20990] ppid=20915 vsize=135864 CPUtime=1.61
/proc/20916/task/20990/stat : 20990 (pb_cplex) R 20915 20915 20664 0 -1 4202560 2377 0 0 0 160 1 0 0 16 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 135526330 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=20916/tid=20991] ppid=20915 vsize=135864 CPUtime=1.59
/proc/20916/task/20991/stat : 20991 (pb_cplex) R 20915 20915 20664 0 -1 4202560 772 0 0 0 158 1 0 0 15 0 8 0 146782848 139124736 11637 4089446400 134512640 146736320 4291750080 18446744073709551615 137083661 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 17.28
Current children cumulated vsize (KiB) 144564

[startup+12.7091 s]
/proc/loadavg: 1.49 0.33 0.10 13/195 21012
/proc/meminfo: memFree=31241564/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=135864 CPUtime=41.01
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 48162 0 0 0 4060 41 0 0 16 0 8 0 146782638 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 136403112 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/20916/statm: 33966 11703 1082 2985 0 30508 0
[pid=20916/tid=20985] ppid=20915 vsize=135864 CPUtime=4.5
/proc/20916/task/20985/stat : 20985 (pb_cplex) R 20915 20915 20664 0 -1 4202560 854 0 0 0 446 4 0 0 16 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 136015703 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=20916/tid=20986] ppid=20915 vsize=135864 CPUtime=4.61
/proc/20916/task/20986/stat : 20986 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1582 0 0 0 458 3 0 0 15 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 3 0 0 0
[pid=20916/tid=20987] ppid=20915 vsize=135864 CPUtime=4.22
/proc/20916/task/20987/stat : 20987 (pb_cplex) S 20915 20915 20664 0 -1 4202560 2663 0 0 0 419 3 0 0 15 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 1 0 0 0
[pid=20916/tid=20988] ppid=20915 vsize=135864 CPUtime=4.45
/proc/20916/task/20988/stat : 20988 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1019 0 0 0 442 3 0 0 15 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 5 0 0 0
[pid=20916/tid=20989] ppid=20915 vsize=135864 CPUtime=4.39
/proc/20916/task/20989/stat : 20989 (pb_cplex) S 20915 20915 20664 0 -1 4202560 2654 0 0 0 434 5 0 0 15 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 7 0 0 0
[pid=20916/tid=20990] ppid=20915 vsize=135864 CPUtime=4.56
/proc/20916/task/20990/stat : 20990 (pb_cplex) R 20915 20915 20664 0 -1 4202560 4910 0 0 0 452 4 0 0 15 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=20916/tid=20991] ppid=20915 vsize=135864 CPUtime=4.45
/proc/20916/task/20991/stat : 20991 (pb_cplex) R 20915 20915 20664 0 -1 4202560 1367 0 0 0 442 3 0 0 16 0 8 0 146782848 139124736 11703 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 41.01
Current children cumulated vsize (KiB) 144564

[startup+25.5009 s]
/proc/loadavg: 2.73 0.63 0.20 3/195 21040
/proc/meminfo: memFree=31244168/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=136148 CPUtime=77.31
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 73523 0 0 0 7658 73 0 0 25 0 8 0 146782638 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/20916/statm: 34037 11649 1085 2985 0 30579 0
[pid=20916/tid=21020] ppid=20915 vsize=136148 CPUtime=2.13
/proc/20916/task/21020/stat : 21020 (pb_cplex) S 20915 20915 20664 0 -1 4202560 124 0 0 0 213 0 0 0 21 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 2 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=136148 CPUtime=1.41
/proc/20916/task/21021/stat : 21021 (pb_cplex) S 20915 20915 20664 0 -1 4202560 91 0 0 0 141 0 0 0 19 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=136148 CPUtime=1.68
/proc/20916/task/21022/stat : 21022 (pb_cplex) S 20915 20915 20664 0 -1 4202560 142 0 0 0 168 0 0 0 19 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 6 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=136148 CPUtime=0.85
/proc/20916/task/21023/stat : 21023 (pb_cplex) S 20915 20915 20664 0 -1 4202560 678 0 0 0 85 0 0 0 17 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 5 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=136148 CPUtime=2.23
/proc/20916/task/21024/stat : 21024 (pb_cplex) S 20915 20915 20664 0 -1 4202560 842 0 0 0 223 0 0 0 18 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 7 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=136148 CPUtime=1.02
/proc/20916/task/21025/stat : 21025 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1794 0 0 0 102 0 0 0 16 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=136148 CPUtime=0.83
/proc/20916/task/21026/stat : 21026 (pb_cplex) S 20915 20915 20664 0 -1 4202560 1900 0 0 0 83 0 0 0 17 0 8 0 146784572 139415552 11649 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 77.31
Current children cumulated vsize (KiB) 144848

[startup+51.1496 s]
/proc/loadavg: 5.35 1.46 0.49 8/195 21040
/proc/meminfo: memFree=31237108/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=142436 CPUtime=185.6
/proc/20916/stat : 20916 (pb_cplex) S 20915 20915 20664 0 -1 4202496 109683 0 0 0 18411 149 0 0 16 0 8 0 146782638 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/20916/statm: 35609 13025 1084 2985 0 32151 0
[pid=20916/tid=21020] ppid=20915 vsize=142436 CPUtime=15.48
/proc/20916/task/21020/stat : 21020 (pb_cplex) R 20915 20915 20664 0 -1 4202560 5215 0 0 0 1539 9 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=142436 CPUtime=14.97
/proc/20916/task/21021/stat : 21021 (pb_cplex) S 20915 20915 20664 0 -1 4202560 7374 0 0 0 1489 8 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 3 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=142436 CPUtime=14.96
/proc/20916/task/21022/stat : 21022 (pb_cplex) R 20915 20915 20664 0 -1 4202560 7435 0 0 0 1485 11 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=142436 CPUtime=14.19
/proc/20916/task/21023/stat : 21023 (pb_cplex) R 20915 20915 20664 0 -1 4202560 3704 0 0 0 1409 10 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 136403109 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=142436 CPUtime=15.38
/proc/20916/task/21024/stat : 21024 (pb_cplex) R 20915 20915 20664 0 -1 4202560 1301 0 0 0 1528 10 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=142436 CPUtime=14.33
/proc/20916/task/21025/stat : 21025 (pb_cplex) R 20915 20915 20664 0 -1 4202560 3914 0 0 0 1426 7 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=142436 CPUtime=14.19
/proc/20916/task/21026/stat : 21026 (pb_cplex) R 20915 20915 20664 0 -1 4202560 6973 0 0 0 1409 10 0 0 15 0 8 0 146784572 145854464 13025 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 185.6
Current children cumulated vsize (KiB) 151136

[startup+102.307 s]
/proc/loadavg: 7.49 2.64 0.94 9/195 21042
/proc/meminfo: memFree=31232248/32951124 swapFree=67111528/67111528

################
# More data... #
################

/proc/20916/task/21024/stat : 21024 (pb_cplex) R 20915 20915 20664 0 -1 4202560 6455 0 0 0 4156 31 0 0 15 0 8 0 146784572 151097344 13999 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=147556 CPUtime=40.96
/proc/20916/task/21025/stat : 21025 (pb_cplex) R 20915 20915 20664 0 -1 4202560 7697 0 0 0 4062 34 0 0 15 0 8 0 146784572 151097344 13999 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=147556 CPUtime=40.91
/proc/20916/task/21026/stat : 21026 (pb_cplex) R 20915 20915 20664 0 -1 4202560 10477 0 0 0 4057 34 0 0 15 0 8 0 146784572 151097344 13999 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 399.45
Current children cumulated vsize (KiB) 156256

[startup+162.305 s]
/proc/loadavg: 8.72 3.84 1.46 9/195 21044
/proc/meminfo: memFree=31225560/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=149604 CPUtime=634.55
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 161216 0 0 0 62920 535 0 0 15 0 8 0 146782638 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 136674344 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/20916/statm: 37401 14499 1103 2985 0 33943 0
[pid=20916/tid=21020] ppid=20915 vsize=149604 CPUtime=71.23
/proc/20916/task/21020/stat : 21020 (pb_cplex) R 20915 20915 20664 0 -1 4202560 9330 0 0 0 7069 54 0 0 15 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=149604 CPUtime=70.54
/proc/20916/task/21021/stat : 21021 (pb_cplex) S 20915 20915 20664 0 -1 4202560 14458 0 0 0 6998 56 0 0 15 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=149604 CPUtime=70.63
/proc/20916/task/21022/stat : 21022 (pb_cplex) S 20915 20915 20664 0 -1 4202560 21911 0 0 0 7002 61 0 0 15 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=149604 CPUtime=69.53
/proc/20916/task/21023/stat : 21023 (pb_cplex) S 20915 20915 20664 0 -1 4202560 8763 0 0 0 6899 54 0 0 15 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=149604 CPUtime=70.85
/proc/20916/task/21024/stat : 21024 (pb_cplex) S 20915 20915 20664 0 -1 4202560 8932 0 0 0 7025 60 0 0 15 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=149604 CPUtime=70.06
/proc/20916/task/21025/stat : 21025 (pb_cplex) S 20915 20915 20664 0 -1 4202560 9125 0 0 0 6949 57 0 0 15 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=149604 CPUtime=70.17
/proc/20916/task/21026/stat : 21026 (pb_cplex) R 20915 20915 20664 0 -1 4202560 12585 0 0 0 6959 58 0 0 16 0 8 0 146784572 153194496 14499 4089446400 134512640 146736320 4291750080 18446744073709551615 144580332 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 634.55
Current children cumulated vsize (KiB) 158304

[startup+222.305 s]
/proc/loadavg: 8.83 4.73 1.91 9/195 21046
/proc/meminfo: memFree=31225540/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=149604 CPUtime=871.96
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 173890 0 0 0 86454 742 0 0 15 0 8 0 146782638 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/20916/statm: 37401 14510 1103 2985 0 33943 0
[pid=20916/tid=21020] ppid=20915 vsize=149604 CPUtime=100.82
/proc/20916/task/21020/stat : 21020 (pb_cplex) S 20915 20915 20664 0 -1 4202560 10991 0 0 0 10003 79 0 0 16 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=149604 CPUtime=100.16
/proc/20916/task/21021/stat : 21021 (pb_cplex) S 20915 20915 20664 0 -1 4202560 16373 0 0 0 9935 81 0 0 16 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 5 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=149604 CPUtime=100.01
/proc/20916/task/21022/stat : 21022 (pb_cplex) S 20915 20915 20664 0 -1 4202560 22637 0 0 0 9915 86 0 0 15 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 6 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=149604 CPUtime=98.78
/proc/20916/task/21023/stat : 21023 (pb_cplex) S 20915 20915 20664 0 -1 4202560 9708 0 0 0 9800 78 0 0 15 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 7 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=149604 CPUtime=100.17
/proc/20916/task/21024/stat : 21024 (pb_cplex) S 20915 20915 20664 0 -1 4202560 11343 0 0 0 9932 85 0 0 16 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 7 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=149604 CPUtime=99.58
/proc/20916/task/21025/stat : 21025 (pb_cplex) S 20915 20915 20664 0 -1 4202560 10538 0 0 0 9874 84 0 0 16 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 7 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=149604 CPUtime=99.52
/proc/20916/task/21026/stat : 21026 (pb_cplex) S 20915 20915 20664 0 -1 4202560 14032 0 0 0 9868 84 0 0 15 0 8 0 146784572 153194496 14510 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 871.96
Current children cumulated vsize (KiB) 158304

[startup+282.3 s]
/proc/loadavg: 9.21 5.59 2.38 11/195 21046
/proc/meminfo: memFree=31226588/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=149604 CPUtime=1106.09
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 182758 0 0 0 109653 956 0 0 16 0 8 0 146782638 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/20916/statm: 37401 14519 1103 2985 0 33943 0
[pid=20916/tid=21020] ppid=20915 vsize=149604 CPUtime=129.98
/proc/20916/task/21020/stat : 21020 (pb_cplex) R 20915 20915 20664 0 -1 4202560 11669 0 0 0 12895 103 0 0 15 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 136400479 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=149604 CPUtime=129.27
/proc/20916/task/21021/stat : 21021 (pb_cplex) R 20915 20915 20664 0 -1 4202560 17442 0 0 0 12819 108 0 0 15 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 137341770 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=149604 CPUtime=128.85
/proc/20916/task/21022/stat : 21022 (pb_cplex) R 20915 20915 20664 0 -1 4202560 24050 0 0 0 12771 114 0 0 16 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 136852413 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=149604 CPUtime=127.78
/proc/20916/task/21023/stat : 21023 (pb_cplex) R 20915 20915 20664 0 -1 4202560 11301 0 0 0 12670 108 0 0 15 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 136015261 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=149604 CPUtime=129.21
/proc/20916/task/21024/stat : 21024 (pb_cplex) R 20915 20915 20664 0 -1 4202560 12948 0 0 0 12811 110 0 0 15 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=149604 CPUtime=128.59
/proc/20916/task/21025/stat : 21025 (pb_cplex) R 20915 20915 20664 0 -1 4202560 10941 0 0 0 12748 111 0 0 15 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=149604 CPUtime=128.71
/proc/20916/task/21026/stat : 21026 (pb_cplex) R 20915 20915 20664 0 -1 4202560 15209 0 0 0 12758 113 0 0 15 0 8 0 146784572 153194496 14519 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1106.09
Current children cumulated vsize (KiB) 158304

[startup+342.344 s]
/proc/loadavg: 8.77 6.13 2.77 10/195 21048
/proc/meminfo: memFree=31226104/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=149604 CPUtime=1341.89
/proc/20916/stat : 20916 (pb_cplex) S 20915 20915 20664 0 -1 4202496 194645 0 0 0 133020 1169 0 0 15 0 8 0 146782638 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/20916/statm: 37401 14581 1103 2985 0 33943 0
[pid=20916/tid=21020] ppid=20915 vsize=149604 CPUtime=159.25
/proc/20916/task/21020/stat : 21020 (pb_cplex) R 20915 20915 20664 0 -1 4202560 13979 0 0 0 15799 126 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=149604 CPUtime=158.53
/proc/20916/task/21021/stat : 21021 (pb_cplex) R 20915 20915 20664 0 -1 4202560 18522 0 0 0 15718 135 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 136017748 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=149604 CPUtime=158.1
/proc/20916/task/21022/stat : 21022 (pb_cplex) R 20915 20915 20664 0 -1 4202560 24946 0 0 0 15667 143 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 135450948 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=149604 CPUtime=156.89
/proc/20916/task/21023/stat : 21023 (pb_cplex) R 20915 20915 20664 0 -1 4202560 14013 0 0 0 15553 136 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=149604 CPUtime=158.41
/proc/20916/task/21024/stat : 21024 (pb_cplex) S 20915 20915 20664 0 -1 4202560 14357 0 0 0 15705 136 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=149604 CPUtime=157.84
/proc/20916/task/21025/stat : 21025 (pb_cplex) R 20915 20915 20664 0 -1 4202560 12455 0 0 0 15646 138 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=149604 CPUtime=157.71
/proc/20916/task/21026/stat : 21026 (pb_cplex) R 20915 20915 20664 0 -1 4202560 16293 0 0 0 15634 137 0 0 15 0 8 0 146784572 153194496 14581 4089446400 134512640 146736320 4291750080 18446744073709551615 136400463 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1341.89
Current children cumulated vsize (KiB) 158304

[startup+402.301 s]
/proc/loadavg: 8.84 6.63 3.15 12/195 21050
/proc/meminfo: memFree=31227396/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=149604 CPUtime=1572.76
/proc/20916/stat : 20916 (pb_cplex) S 20915 20915 20664 0 -1 4202496 211385 0 0 0 155895 1381 0 0 16 0 8 0 146782638 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/20916/statm: 37401 14589 1103 2985 0 33943 0
[pid=20916/tid=21020] ppid=20915 vsize=149604 CPUtime=188.08
/proc/20916/task/21020/stat : 21020 (pb_cplex) S 20915 20915 20664 0 -1 4202560 15780 0 0 0 18661 147 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 0 0 0 0
[pid=20916/tid=21021] ppid=20915 vsize=149604 CPUtime=187.19
/proc/20916/task/21021/stat : 21021 (pb_cplex) S 20915 20915 20664 0 -1 4202560 22056 0 0 0 18558 161 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 2 0 0 0
[pid=20916/tid=21022] ppid=20915 vsize=149604 CPUtime=186.66
/proc/20916/task/21022/stat : 21022 (pb_cplex) S 20915 20915 20664 0 -1 4202560 26196 0 0 0 18497 169 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 1 0 0 0
[pid=20916/tid=21023] ppid=20915 vsize=149604 CPUtime=185.53
/proc/20916/task/21023/stat : 21023 (pb_cplex) S 20915 20915 20664 0 -1 4202560 15171 0 0 0 18390 163 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 1 0 0 0
[pid=20916/tid=21024] ppid=20915 vsize=149604 CPUtime=186.98
/proc/20916/task/21024/stat : 21024 (pb_cplex) R 20915 20915 20664 0 -1 4202560 17174 0 0 0 18538 160 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=20916/tid=21025] ppid=20915 vsize=149604 CPUtime=186.06
/proc/20916/task/21025/stat : 21025 (pb_cplex) R 20915 20915 20664 0 -1 4202560 15204 0 0 0 18437 169 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=20916/tid=21026] ppid=20915 vsize=149604 CPUtime=186.22
/proc/20916/task/21026/stat : 21026 (pb_cplex) R 20915 20915 20664 0 -1 4202560 18241 0 0 0 18457 165 0 0 15 0 8 0 146784572 153194496 14589 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1572.76
Current children cumulated vsize (KiB) 158304



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+461.614 s]
/proc/loadavg: 9.03 7.09 3.52 12/195 21066
/proc/meminfo: memFree=31216748/32951124 swapFree=67111528/67111528
[pid=20915] ppid=20913 vsize=8700 CPUtime=0
/proc/20915/stat : 20915 (run) S 20913 20915 20664 0 -1 4202496 364 0 0 0 0 0 0 0 23 0 1 0 146782638 8908800 248 4089446400 4194304 4922060 140734349159296 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/20915/statm: 2175 248 208 178 0 68 0
[pid=20916] ppid=20915 vsize=154080 CPUtime=1800.22
/proc/20916/stat : 20916 (pb_cplex) R 20915 20915 20664 0 -1 4202496 216995 0 0 0 178424 1598 0 0 16 0 8 0 146782638 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/20916/statm: 38520 15990 1102 2985 0 35062 0
[pid=20916/tid=21051] ppid=20915 vsize=154080 CPUtime=25.79
/proc/20916/task/21051/stat : 21051 (pb_cplex) R 20915 20915 20664 0 -1 4202560 305 0 0 0 2556 23 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=20916/tid=21052] ppid=20915 vsize=154080 CPUtime=25.85
/proc/20916/task/21052/stat : 21052 (pb_cplex) S 20915 20915 20664 0 -1 4202560 453 0 0 0 2561 24 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144580073 0 2 4096 16387 18446604470033547712 0 0 -1 5 0 0 0
[pid=20916/tid=21053] ppid=20915 vsize=154080 CPUtime=25.88
/proc/20916/task/21053/stat : 21053 (pb_cplex) R 20915 20915 20664 0 -1 4202560 575 0 0 0 2565 23 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=20916/tid=21054] ppid=20915 vsize=154080 CPUtime=25.86
/proc/20916/task/21054/stat : 21054 (pb_cplex) R 20915 20915 20664 0 -1 4202560 649 0 0 0 2560 26 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=20916/tid=21055] ppid=20915 vsize=154080 CPUtime=25.91
/proc/20916/task/21055/stat : 21055 (pb_cplex) R 20915 20915 20664 0 -1 4202560 690 0 0 0 2568 23 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=20916/tid=21056] ppid=20915 vsize=154080 CPUtime=26.04
/proc/20916/task/21056/stat : 21056 (pb_cplex) R 20915 20915 20664 0 -1 4202560 993 0 0 0 2579 25 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=20916/tid=21057] ppid=20915 vsize=154080 CPUtime=25.99
/proc/20916/task/21057/stat : 21057 (pb_cplex) R 20915 20915 20664 0 -1 4202560 771 0 0 0 2573 26 0 0 15 0 8 0 146823363 157777920 15990 4089446400 134512640 146736320 4291750080 18446744073709551615 139044552 0 2 4096 16387 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1800.22
Current children cumulated vsize (KiB) 162780

Sending SIGTERM to process tree (bottom up)
Solver just ended. DDumping a history of the last processes samples

Child status: 0
Real time (s): 461.693
CPU time (s): 1800.28
CPU user time (s): 1784.29
CPU system time (s): 15.9906
CPU usage (%): 389.93
Max. virtual memory (cumulated for all children) (KiB): 163348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1784.29
system time used= 15.9906
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 217367
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 329525
involuntary context switches= 28736

runsolver used 0.841872 second user time and 1.88171 second system time

The end

Launcher Data 

Begin job on node130 at 2010-07-02 09:14:26
IDJOB=2697861
IDBENCH=78918
IDSOLVER=1210
FILE ID=node130/2697861-1278054866
PBS_JOBID= 11198922
Free space on /tmp= 74184 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900579996--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697861-1278054866/watcher-2697861-1278054866 -o /tmp/evaluation-result-2697861-1278054866/solver-2697861-1278054866 -C 1800 -W 2000 -M 3800  run HOME/instance-2697861-1278054866.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 469cd609ab798a94b23843d73b73e9c6
RANDOM SEED=1729222425

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5237.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31356328 kB
Buffers:        223316 kB
Cached:        1159184 kB
SwapCached:          0 kB
Active:         616104 kB
Inactive:       830556 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31356328 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16932 kB
Writeback:           0 kB
AnonPages:       63988 kB
Mapped:          14892 kB
Slab:            82972 kB
PageTables:       4888 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188900 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74152 MiB
End job on node130 at 2010-07-02 09:22:07