Trace number 2697937

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01OPTIMUM 944.514 253.33

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900557957--soft-33-100-0.wbo
MD5SUMcb2e0a6db987ecdc06dc4066ca6b4222
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark584.43
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1804
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 90822
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 90821
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 717
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697937-1278055006.wbo.
0.00/0.00	c Instance file HOME/instance-2697937-1278055006.wbo
0.00/0.00	c File size is 92306 bytes.
0.62/2.12	c Highest Coefficient sum: 717
0.62/2.12	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.62/2.12	c ============================[ Problem Statistics ]=============================
0.62/2.12	c |                                                                             |
0.62/2.12	c |  Parsing time:          0.64         s                                      |
0.62/2.12	c |  Number Variables:      2035                                                |
0.62/2.12	c |  Number Constraints:    2708                                                |
0.62/2.12	c ===============================================================================
944.49/253.32	c Remaining time 1799.36 sec.
944.49/253.32	s OPTIMUM FOUND
944.49/253.32	c Solution value = 3.00
944.49/253.32	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 x12 -x13 -x14 x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 x42 -x43 -x44 -x45 -x46 x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 -x79 -x80 x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 x95 -x96 -x97 -x98 -x99 x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 x121 -x122 -x123 -x124 -x125 -x126 x127 -x128 -x129 -x130 -x131 -x132 x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 x178 -x179 -x180 -x181 -x182 -x183 -x184 x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231
944.49/253.32	c Total CPU time              : 936.595 s

Verifier Data

OK	3

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697937-1278055006/watcher-2697937-1278055006 -o /tmp/evaluation-result-2697937-1278055006/solver-2697937-1278055006 -C 1800 -W 2000 -M 3800 run HOME/instance-2697937-1278055006.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.46 3.54 1.32 3/186 23146
/proc/meminfo: memFree=31022556/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0

[startup+0.082974 s]
/proc/loadavg: 8.46 3.54 1.32 3/186 23146
/proc/meminfo: memFree=31022556/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100703 s]
/proc/loadavg: 8.46 3.54 1.32 3/186 23146
/proc/meminfo: memFree=31022556/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.379595 s]
/proc/loadavg: 8.46 3.54 1.32 3/186 23146
/proc/meminfo: memFree=31022556/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701548 s]
/proc/loadavg: 8.46 3.54 1.32 3/186 23146
/proc/meminfo: memFree=31022556/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.52036 s]
/proc/loadavg: 8.46 3.54 1.32 11/188 23148
/proc/meminfo: memFree=31020432/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=13488 CPUtime=0.34
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 575 0 0 0 34 0 0 0 25 0 1 0 146795804 13811712 529 4089446400 134512640 146736320 4294599296 18446744073709551615 140714107 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/23147/statm: 3372 529 302 2985 0 283 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 22188

[startup+3.1021 s]
/proc/loadavg: 8.46 3.54 1.32 10/188 23148
/proc/meminfo: memFree=31019936/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=133808 CPUtime=1.77
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 14303 0 0 0 173 4 0 0 15 0 8 0 146795804 137019392 9938 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/23147/statm: 33452 9938 1068 2985 0 29994 0
Current children cumulated CPU time (s) 1.77
Current children cumulated vsize (KiB) 142508
heavy processes:

[startup+6.30054 s]
/proc/loadavg: 8.51 3.63 1.36 3/188 23169
/proc/meminfo: memFree=30994020/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=118028 CPUtime=5.55
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 19967 0 0 0 546 9 0 0 21 0 8 0 146795804 120860672 7817 4089446400 134512640 146736320 4294599296 18446744073709551615 136384857 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/23147/statm: 29507 7817 1080 2985 0 26049 0
Current children cumulated CPU time (s) 5.55
Current children cumulated vsize (KiB) 126728

[startup+12.7234 s]
/proc/loadavg: 8.79 3.77 1.42 10/195 23190
/proc/meminfo: memFree=30973016/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=138480 CPUtime=25.91
/proc/23147/stat : 23147 (pb_cplex) S 23146 23146 22640 0 -1 4202496 36862 0 0 0 2564 27 0 0 16 0 8 0 146795804 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/23147/statm: 34620 12447 1080 2985 0 31162 0
[pid=23147/tid=23184] ppid=23146 vsize=138480 CPUtime=2.44
/proc/23147/task/23184/stat : 23184 (pb_cplex) S 23146 23146 22640 0 -1 4202560 601 0 0 0 242 2 0 0 15 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 3 0 0 0
[pid=23147/tid=23185] ppid=23146 vsize=138480 CPUtime=2.47
/proc/23147/task/23185/stat : 23185 (pb_cplex) R 23146 23146 22640 0 -1 4202560 575 0 0 0 246 1 0 0 16 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23147/tid=23186] ppid=23146 vsize=138480 CPUtime=2.27
/proc/23147/task/23186/stat : 23186 (pb_cplex) S 23146 23146 22640 0 -1 4202560 1988 0 0 0 226 1 0 0 15 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 0 0 0 0
[pid=23147/tid=23187] ppid=23146 vsize=138480 CPUtime=2.32
/proc/23147/task/23187/stat : 23187 (pb_cplex) S 23146 23146 22640 0 -1 4202560 1733 0 0 0 230 2 0 0 15 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 2 0 0 0
[pid=23147/tid=23188] ppid=23146 vsize=138480 CPUtime=2.16
/proc/23147/task/23188/stat : 23188 (pb_cplex) S 23146 23146 22640 0 -1 4202560 4316 0 0 0 214 2 0 0 16 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 4 0 0 0
[pid=23147/tid=23189] ppid=23146 vsize=138480 CPUtime=2.52
/proc/23147/task/23189/stat : 23189 (pb_cplex) S 23146 23146 22640 0 -1 4202560 5672 0 0 0 249 3 0 0 16 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 5 0 0 0
[pid=23147/tid=23190] ppid=23146 vsize=138480 CPUtime=2.42
/proc/23147/task/23190/stat : 23190 (pb_cplex) R 23146 23146 22640 0 -1 4202560 1446 0 0 0 240 2 0 0 15 0 8 0 146796422 141803520 12447 4089446400 134512640 146736320 4294599296 18446744073709551615 135846482 0 2 4096 16387 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.91
Current children cumulated vsize (KiB) 147180

[startup+25.5011 s]
/proc/loadavg: 9.07 4.08 1.56 11/195 23191
/proc/meminfo: memFree=30954168/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=160876 CPUtime=73.43
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 69352 0 0 0 7269 74 0 0 18 0 8 0 146795804 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 136008266 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/23147/statm: 40219 17386 1088 2985 0 36761 0
[pid=23147/tid=23184] ppid=23146 vsize=160876 CPUtime=8.8
/proc/23147/task/23184/stat : 23184 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8804 0 0 0 872 8 0 0 18 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 139044542 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23147/tid=23185] ppid=23146 vsize=160876 CPUtime=7.56
/proc/23147/task/23185/stat : 23185 (pb_cplex) R 23146 23146 22640 0 -1 4202560 4235 0 0 0 750 6 0 0 17 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 136008157 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23147/tid=23186] ppid=23146 vsize=160876 CPUtime=8.18
/proc/23147/task/23186/stat : 23186 (pb_cplex) R 23146 23146 22640 0 -1 4202560 5012 0 0 0 811 7 0 0 18 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 136015725 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23147/tid=23187] ppid=23146 vsize=160876 CPUtime=8.27
/proc/23147/task/23187/stat : 23187 (pb_cplex) R 23146 23146 22640 0 -1 4202560 3626 0 0 0 821 6 0 0 18 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 136008172 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23147/tid=23188] ppid=23146 vsize=160876 CPUtime=7.79
/proc/23147/task/23188/stat : 23188 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8750 0 0 0 770 9 0 0 18 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23147/tid=23189] ppid=23146 vsize=160876 CPUtime=8.38
/proc/23147/task/23189/stat : 23189 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12958 0 0 0 828 10 0 0 17 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 139044580 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23147/tid=23190] ppid=23146 vsize=160876 CPUtime=8.9
/proc/23147/task/23190/stat : 23190 (pb_cplex) S 23146 23146 22640 0 -1 4202560 2460 0 0 0 882 8 0 0 19 0 8 0 146796422 164737024 17386 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 73.43
Current children cumulated vsize (KiB) 169576

[startup+51.1125 s]
/proc/loadavg: 8.80 4.42 1.74 10/195 23275
/proc/meminfo: memFree=30982928/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=149352 CPUtime=164.07
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 107868 0 0 0 16269 138 0 0 16 0 8 0 146795804 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 135999570 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/23147/statm: 37338 15168 1089 2985 0 33880 0
[pid=23147/tid=23199] ppid=23146 vsize=149352 CPUtime=9.13
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 2748 0 0 0 908 5 0 0 16 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=149352 CPUtime=7.96
/proc/23147/task/23200/stat : 23200 (pb_cplex) S 23146 23146 22640 0 -1 4202560 5880 0 0 0 790 6 0 0 15 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 0 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=149352 CPUtime=7.61
/proc/23147/task/23201/stat : 23201 (pb_cplex) S 23146 23146 22640 0 -1 4202560 710 0 0 0 755 6 0 0 15 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=149352 CPUtime=8.21
/proc/23147/task/23202/stat : 23202 (pb_cplex) S 23146 23146 22640 0 -1 4202560 3812 0 0 0 814 7 0 0 15 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 2 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=149352 CPUtime=8.46
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 1907 0 0 0 842 4 0 0 15 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 139044554 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=149352 CPUtime=7.36
/proc/23147/task/23204/stat : 23204 (pb_cplex) R 23146 23146 22640 0 -1 4202560 416 0 0 0 729 7 0 0 15 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=149352 CPUtime=7.8
/proc/23147/task/23205/stat : 23205 (pb_cplex) R 23146 23146 22640 0 -1 4202560 1755 0 0 0 774 6 0 0 15 0 8 0 146799344 152936448 15168 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 164.07
Current children cumulated vsize (KiB) 158052

[startup+102.318 s]
/proc/loadavg: 8.67 5.04 2.09 9/195 23291
/proc/meminfo: memFree=30979212/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=154472 CPUtime=360.09
/proc/23147/stat : 23147 (pb_cplex) S 23146 23146 22640 0 -1 4202496 155584 0 0 0 35702 307 0 0 15 0 8 0 146795804 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/23147/statm: 38618 16186 1089 2985 0 35160 0
[pid=23147/tid=23199] ppid=23146 vsize=154472 CPUtime=33.24
/proc/23147/task/23199/stat : 23199 (pb_cplex) S 23146 23146 22640 0 -1 4202560 16591 0 0 0 3297 27 0 0 15 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 5 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=154472 CPUtime=32.11
/proc/23147/task/23200/stat : 23200 (pb_cplex) S 23146 23146 22640 0 -1 4202560 8271 0 0 0 3184 27 0 0 16 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 1 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=154472 CPUtime=31.81
/proc/23147/task/23201/stat : 23201 (pb_cplex) S 23146 23146 22640 0 -1 4202560 5235 0 0 0 3152 29 0 0 16 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 3 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=154472 CPUtime=32.28
/proc/23147/task/23202/stat : 23202 (pb_cplex) R 23146 23146 22640 0 -1 4202560 10718 0 0 0 3200 28 0 0 15 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=154472 CPUtime=32.74
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 9412 0 0 0 3248 26 0 0 15 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=154472 CPUtime=31.74
/proc/23147/task/23204/stat : 23204 (pb_cplex) R 23146 23146 22640 0 -1 4202560 2760 0 0 0 3148 26 0 0 15 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 136400477 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=154472 CPUtime=32.18
/proc/23147/task/23205/stat : 23205 (pb_cplex) R 23146 23146 22640 0 -1 4202560 7595 0 0 0 3195 23 0 0 16 0 8 0 146799344 158179328 16186 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 360.09
Current children cumulated vsize (KiB) 163172

[startup+162.336 s]
/proc/loadavg: 8.88 5.79 2.53 9/195 23292
/proc/meminfo: memFree=30979756/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0

################
# More data... #
################

[pid=23147/tid=23200] ppid=23146 vsize=152424 CPUtime=93.73
/proc/23147/task/23200/stat : 23200 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12443 0 0 0 9296 77 0 0 15 0 8 0 146799344 156082176 15739 4089446400 134512640 146736320 4294599296 18446744073709551615 139043587 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=152424 CPUtime=93.27
/proc/23147/task/23201/stat : 23201 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8228 0 0 0 9251 76 0 0 15 0 8 0 146799344 156082176 15739 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=152424 CPUtime=94.59
/proc/23147/task/23202/stat : 23202 (pb_cplex) R 23146 23146 22640 0 -1 4202560 16399 0 0 0 9378 81 0 0 15 0 8 0 146799344 156082176 15739 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=152424 CPUtime=94.69
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 13342 0 0 0 9392 77 0 0 15 0 8 0 146799344 156082176 15739 4089446400 134512640 146736320 4294599296 18446744073709551615 135455551 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=152424 CPUtime=93.64
/proc/23147/task/23204/stat : 23204 (pb_cplex) R 23146 23146 22640 0 -1 4202560 6866 0 0 0 9285 79 0 0 15 0 8 0 146799344 156082176 15739 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=152424 CPUtime=93.82
/proc/23147/task/23205/stat : 23205 (pb_cplex) R 23146 23146 22640 0 -1 4202560 13057 0 0 0 9309 73 0 0 15 0 8 0 146799344 156082176 15739 4089446400 134512640 146736320 4294599296 18446744073709551615 139046538 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 859.35
Current children cumulated vsize (KiB) 161124

[startup+243.316 s]
/proc/loadavg: 9.16 6.60 3.08 10/195 23295
/proc/meminfo: memFree=30978072/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=153448 CPUtime=908.12
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 192151 0 0 0 90057 755 0 0 16 0 8 0 146795804 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/23147/statm: 38362 15944 1089 2985 0 34904 0
[pid=23147/tid=23199] ppid=23146 vsize=153448 CPUtime=100.99
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 21257 0 0 0 10016 83 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=153448 CPUtime=99.81
/proc/23147/task/23200/stat : 23200 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12547 0 0 0 9899 82 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=153448 CPUtime=99.12
/proc/23147/task/23201/stat : 23201 (pb_cplex) S 23146 23146 22640 0 -1 4202560 8451 0 0 0 9831 81 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=153448 CPUtime=100.65
/proc/23147/task/23202/stat : 23202 (pb_cplex) S 23146 23146 22640 0 -1 4202560 16641 0 0 0 9978 87 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=153448 CPUtime=100.79
/proc/23147/task/23203/stat : 23203 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14012 0 0 0 9997 82 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=153448 CPUtime=99.83
/proc/23147/task/23204/stat : 23204 (pb_cplex) S 23146 23146 22640 0 -1 4202560 7127 0 0 0 9900 83 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=153448 CPUtime=99.9
/proc/23147/task/23205/stat : 23205 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14293 0 0 0 9911 79 0 0 15 0 8 0 146799344 157130752 15944 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 908.12
Current children cumulated vsize (KiB) 162148

[startup+249.707 s]
/proc/loadavg: 9.21 6.70 3.15 11/195 23295
/proc/meminfo: memFree=30977384/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=152424 CPUtime=931.46
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 193297 0 0 0 92369 777 0 0 16 0 8 0 146795804 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 136004951 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/23147/statm: 38106 15740 1089 2985 0 34648 0
[pid=23147/tid=23199] ppid=23146 vsize=152424 CPUtime=103.87
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 21461 0 0 0 10301 86 0 0 15 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=152424 CPUtime=102.68
/proc/23147/task/23200/stat : 23200 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12728 0 0 0 10184 84 0 0 15 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 136017651 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=152424 CPUtime=101.91
/proc/23147/task/23201/stat : 23201 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8466 0 0 0 10108 83 0 0 15 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=152424 CPUtime=103.56
/proc/23147/task/23202/stat : 23202 (pb_cplex) R 23146 23146 22640 0 -1 4202560 16655 0 0 0 10266 90 0 0 15 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=152424 CPUtime=103.63
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 14013 0 0 0 10278 85 0 0 15 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=152424 CPUtime=102.77
/proc/23147/task/23204/stat : 23204 (pb_cplex) S 23146 23146 22640 0 -1 4202560 7852 0 0 0 10190 87 0 0 16 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 4 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=152424 CPUtime=102.73
/proc/23147/task/23205/stat : 23205 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14294 0 0 0 10191 82 0 0 15 0 8 0 146799344 156082176 15740 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 931.46
Current children cumulated vsize (KiB) 161124

[startup+251.3 s]
/proc/loadavg: 9.21 6.70 3.15 11/195 23295
/proc/meminfo: memFree=30977316/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=151400 CPUtime=937.3
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 194387 0 0 0 92946 784 0 0 16 0 8 0 146795804 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 135845827 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/23147/statm: 37850 15555 1089 2985 0 34392 0
[pid=23147/tid=23199] ppid=23146 vsize=151400 CPUtime=104.57
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 22190 0 0 0 10370 87 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 136000480 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=151400 CPUtime=103.41
/proc/23147/task/23200/stat : 23200 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12832 0 0 0 10256 85 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 136475871 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=151400 CPUtime=102.65
/proc/23147/task/23201/stat : 23201 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8625 0 0 0 10181 84 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 136007612 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=151400 CPUtime=104.3
/proc/23147/task/23202/stat : 23202 (pb_cplex) R 23146 23146 22640 0 -1 4202560 16655 0 0 0 10339 91 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=151400 CPUtime=104.33
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 14013 0 0 0 10347 86 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=151400 CPUtime=103.48
/proc/23147/task/23204/stat : 23204 (pb_cplex) R 23146 23146 22640 0 -1 4202560 7949 0 0 0 10260 88 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=151400 CPUtime=103.47
/proc/23147/task/23205/stat : 23205 (pb_cplex) R 23146 23146 22640 0 -1 4202560 14295 0 0 0 10264 83 0 0 15 0 8 0 146799344 155033600 15555 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 937.3
Current children cumulated vsize (KiB) 160100

[startup+252.106 s]
/proc/loadavg: 9.21 6.70 3.15 8/195 23295
/proc/meminfo: memFree=30977440/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=151400 CPUtime=940.18
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 194600 0 0 0 93232 786 0 0 16 0 8 0 146795804 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 135854505 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/23147/statm: 37850 15497 1089 2985 0 34392 0
[pid=23147/tid=23199] ppid=23146 vsize=151400 CPUtime=104.94
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 22191 0 0 0 10407 87 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=151400 CPUtime=103.78
/proc/23147/task/23200/stat : 23200 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12832 0 0 0 10293 85 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=151400 CPUtime=103
/proc/23147/task/23201/stat : 23201 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8626 0 0 0 10216 84 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=151400 CPUtime=104.62
/proc/23147/task/23202/stat : 23202 (pb_cplex) R 23146 23146 22640 0 -1 4202560 16822 0 0 0 10371 91 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=151400 CPUtime=104.67
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 14032 0 0 0 10380 87 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=151400 CPUtime=103.85
/proc/23147/task/23204/stat : 23204 (pb_cplex) R 23146 23146 22640 0 -1 4202560 7954 0 0 0 10296 89 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=151400 CPUtime=103.85
/proc/23147/task/23205/stat : 23205 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14295 0 0 0 10302 83 0 0 15 0 8 0 146799344 155033600 15497 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 940.18
Current children cumulated vsize (KiB) 160100

[startup+252.913 s]
/proc/loadavg: 9.21 6.70 3.15 8/195 23295
/proc/meminfo: memFree=30977440/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=150376 CPUtime=943.19
/proc/23147/stat : 23147 (pb_cplex) R 23146 23146 22640 0 -1 4202496 194659 0 0 0 93529 790 0 0 15 0 8 0 146795804 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/23147/statm: 37594 15462 1089 2985 0 34136 0
[pid=23147/tid=23199] ppid=23146 vsize=150376 CPUtime=105.28
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 22191 0 0 0 10441 87 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 135450566 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=150376 CPUtime=104.12
/proc/23147/task/23200/stat : 23200 (pb_cplex) R 23146 23146 22640 0 -1 4202560 12832 0 0 0 10327 85 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 139043570 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=150376 CPUtime=103.38
/proc/23147/task/23201/stat : 23201 (pb_cplex) R 23146 23146 22640 0 -1 4202560 8682 0 0 0 10253 85 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=150376 CPUtime=104.99
/proc/23147/task/23202/stat : 23202 (pb_cplex) R 23146 23146 22640 0 -1 4202560 16823 0 0 0 10407 92 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=150376 CPUtime=105.03
/proc/23147/task/23203/stat : 23203 (pb_cplex) R 23146 23146 22640 0 -1 4202560 14033 0 0 0 10416 87 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 136403112 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=150376 CPUtime=104.23
/proc/23147/task/23204/stat : 23204 (pb_cplex) R 23146 23146 22640 0 -1 4202560 7954 0 0 0 10333 90 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=150376 CPUtime=104.24
/proc/23147/task/23205/stat : 23205 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14295 0 0 0 10341 83 0 0 15 0 8 0 146799344 153985024 15462 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 943.19
Current children cumulated vsize (KiB) 159076

[startup+253.301 s]
/proc/loadavg: 9.21 6.70 3.15 8/195 23295
/proc/meminfo: memFree=30978048/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=8700 CPUtime=0
/proc/23146/stat : 23146 (run) S 23144 23146 22640 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146795804 8908800 248 4089446400 4194304 4922060 140733899275488 18446744073709551615 233510116485 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/23146/statm: 2175 248 208 178 0 68 0
[pid=23147] ppid=23146 vsize=148328 CPUtime=944.49
/proc/23147/stat : 23147 (pb_cplex) S 23146 23146 22640 0 -1 4202496 194660 0 0 0 93658 791 0 0 15 0 8 0 146795804 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/23147/statm: 37082 15118 1089 2985 0 33624 0
[pid=23147/tid=23199] ppid=23146 vsize=148328 CPUtime=105.43
/proc/23147/task/23199/stat : 23199 (pb_cplex) R 23146 23146 22640 0 -1 4202560 22192 0 0 0 10456 87 0 0 15 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23147/tid=23200] ppid=23146 vsize=148328 CPUtime=104.3
/proc/23147/task/23200/stat : 23200 (pb_cplex) S 23146 23146 22640 0 -1 4202560 12832 0 0 0 10345 85 0 0 15 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 1 0 0 0
[pid=23147/tid=23201] ppid=23146 vsize=148328 CPUtime=103.54
/proc/23147/task/23201/stat : 23201 (pb_cplex) S 23146 23146 22640 0 -1 4202560 8682 0 0 0 10269 85 0 0 15 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 1 0 0 0
[pid=23147/tid=23202] ppid=23146 vsize=148328 CPUtime=105.13
/proc/23147/task/23202/stat : 23202 (pb_cplex) S 23146 23146 22640 0 -1 4202560 16823 0 0 0 10421 92 0 0 15 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 1 0 0 0
[pid=23147/tid=23203] ppid=23146 vsize=148328 CPUtime=105.17
/proc/23147/task/23203/stat : 23203 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14033 0 0 0 10430 87 0 0 16 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 7 0 0 0
[pid=23147/tid=23204] ppid=23146 vsize=148328 CPUtime=104.44
/proc/23147/task/23204/stat : 23204 (pb_cplex) S 23146 23146 22640 0 -1 4202560 7954 0 0 0 10354 90 0 0 15 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 5 0 0 0
[pid=23147/tid=23205] ppid=23146 vsize=148328 CPUtime=104.47
/proc/23147/task/23205/stat : 23205 (pb_cplex) S 23146 23146 22640 0 -1 4202560 14295 0 0 0 10363 84 0 0 15 0 8 0 146799344 151887872 15118 4089446400 134512640 146736320 4294599296 18446744073709551615 144580073 0 2 4096 16387 18446604471116579904 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 944.49
Current children cumulated vsize (KiB) 157028

Child status: 0
Real time (s): 253.33
CPU time (s): 944.514
CPU user time (s): 936.596
CPU system time (s): 7.9188
CPU usage (%): 372.839
Max. virtual memory (cumulated for all children) (KiB): 172648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 936.596
system time used= 7.9188
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 195053
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 163439
involuntary context switches= 21550

runsolver used 0.534918 second user time and 0.976851 second system time

The end

Launcher Data

Begin job on node145 at 2010-07-02 09:16:46
IDJOB=2697937
IDBENCH=78956
IDSOLVER=1210
FILE ID=node145/2697937-1278055006
PBS_JOBID= 11198891
Free space on /tmp= 74184 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900557957--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697937-1278055006/watcher-2697937-1278055006 -o /tmp/evaluation-result-2697937-1278055006/solver-2697937-1278055006 -C 1800 -W 2000 -M 3800  run HOME/instance-2697937-1278055006.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= cb2e0a6db987ecdc06dc4066ca6b4222
RANDOM SEED=203732205

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31023084 kB
Buffers:        223928 kB
Cached:        1425544 kB
SwapCached:          0 kB
Active:         687568 kB
Inactive:      1089004 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31023084 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16736 kB
Writeback:           0 kB
AnonPages:      127400 kB
Mapped:          19008 kB
Slab:            84084 kB
PageTables:       5692 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   350932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74168 MiB
End job on node145 at 2010-07-02 09:21:00