Trace number 2697990

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01OPTIMUM 499.311 139.481

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900552423--soft-66-100-0.wbo
MD5SUM2f4d2e59134ffbad904dde6d63a6f677
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark12
Best CPU time to get the best result obtained on this benchmark30.4694
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints937
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 46894
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 46893
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 779
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697990-1278055190.wbo.
0.00/0.00	c Instance file HOME/instance-2697990-1278055190.wbo
0.00/0.00	c File size is 88060 bytes.
0.00/0.19	c Highest Coefficient sum: 779
0.00/0.19	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.19	c ============================[ Problem Statistics ]=============================
0.00/0.19	c |                                                                             |
0.00/0.19	c |  Parsing time:          0.19         s                                      |
0.00/0.19	c |  Number Variables:      1168                                                |
0.00/0.19	c |  Number Constraints:    2708                                                |
0.00/0.19	c ===============================================================================
499.23/139.47	c Remaining time 1799.81 sec.
499.23/139.47	s OPTIMUM FOUND
499.23/139.47	c Solution value = 12.00
499.23/139.47	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 x12 x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 x44 -x45 -x46 x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 x97 -x98 -x99 -x100 x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 x120 -x121 -x122 -x123 -x124 -x125 x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 x190 -x191 -x192 -x193 -x194 x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 x209 -x210 -x211 -x212 x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231
499.23/139.47	c Total CPU time              : 495.379 s

Verifier Data 

OK	12

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697990-1278055190/watcher-2697990-1278055190 -o /tmp/evaluation-result-2697990-1278055190/solver-2697990-1278055190 -C 1800 -W 2000 -M 3800 run HOME/instance-2697990-1278055190.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.65 5.81 2.58 10/184 21861
/proc/meminfo: memFree=31185740/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=24036 CPUtime=0
/proc/21861/stat : 21861 (runsolver) R 21859 21861 21610 0 -1 4202560 80 0 0 0 0 0 0 0 22 0 1 0 146815572 24612864 106 4089446400 4194304 4302564 140736323564240 18446744073709551615 210646967287 0 0 4096 24578 0 0 0 17 2 0 0 0
/proc/21861/statm: 6009 106 69 27 0 2647 0

[startup+0.054658 s]
/proc/loadavg: 8.65 5.81 2.58 10/184 21861
/proc/meminfo: memFree=31185740/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100738 s]
/proc/loadavg: 8.65 5.81 2.58 10/184 21861
/proc/meminfo: memFree=31185740/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.381664 s]
/proc/loadavg: 8.65 5.81 2.58 10/184 21861
/proc/meminfo: memFree=31185740/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.74612 s]
/proc/loadavg: 8.65 5.81 2.58 10/184 21861
/proc/meminfo: memFree=31185740/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50587 s]
/proc/loadavg: 8.44 5.82 2.60 12/193 21884
/proc/meminfo: memFree=31161744/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=120944 CPUtime=2.2
/proc/21863/stat : 21863 (pb_cplex) R 21861 21861 21610 0 -1 4202496 16212 0 0 0 215 5 0 0 16 0 8 0 146815572 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/21863/statm: 30236 8277 1084 2985 0 26778 0
[pid=21863/tid=21878] ppid=21861 vsize=120944 CPUtime=0.17
/proc/21863/task/21878/stat : 21878 (pb_cplex) R 21861 21861 21610 0 -1 4202560 420 0 0 0 17 0 0 0 17 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144580332 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21863/tid=21879] ppid=21861 vsize=120944 CPUtime=0.17
/proc/21863/task/21879/stat : 21879 (pb_cplex) R 21861 21861 21610 0 -1 4202560 280 0 0 0 17 0 0 0 15 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21863/tid=21880] ppid=21861 vsize=120944 CPUtime=0.15
/proc/21863/task/21880/stat : 21880 (pb_cplex) R 21861 21861 21610 0 -1 4202560 480 0 0 0 15 0 0 0 15 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21863/tid=21881] ppid=21861 vsize=120944 CPUtime=0.16
/proc/21863/task/21881/stat : 21881 (pb_cplex) S 21861 21861 21610 0 -1 4202560 489 0 0 0 16 0 0 0 15 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21882] ppid=21861 vsize=120944 CPUtime=0.15
/proc/21863/task/21882/stat : 21882 (pb_cplex) S 21861 21861 21610 0 -1 4202560 489 0 0 0 15 0 0 0 15 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21883] ppid=21861 vsize=120944 CPUtime=0.15
/proc/21863/task/21883/stat : 21883 (pb_cplex) S 21861 21861 21610 0 -1 4202560 428 0 0 0 15 0 0 0 15 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21884] ppid=21861 vsize=120944 CPUtime=0.16
/proc/21863/task/21884/stat : 21884 (pb_cplex) S 21861 21861 21610 0 -1 4202560 412 0 0 0 16 0 0 0 15 0 8 0 146815661 123846656 8277 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.2
Current children cumulated vsize (KiB) 129644

[startup+3.15616 s]
/proc/loadavg: 8.44 5.82 2.60 10/193 21884
/proc/meminfo: memFree=31150608/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=129480 CPUtime=3.41
/proc/21863/stat : 21863 (pb_cplex) S 21861 21861 21610 0 -1 4202496 18525 0 0 0 324 17 0 0 16 0 8 0 146815572 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21863/statm: 32370 10296 1077 2985 0 28912 0
[pid=21863/tid=21878] ppid=21861 vsize=129480 CPUtime=0.24
/proc/21863/task/21878/stat : 21878 (pb_cplex) S 21861 21861 21610 0 -1 4202560 800 0 0 0 24 0 0 0 17 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21879] ppid=21861 vsize=129480 CPUtime=0.25
/proc/21863/task/21879/stat : 21879 (pb_cplex) S 21861 21861 21610 0 -1 4202560 545 0 0 0 23 2 0 0 16 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21880] ppid=21861 vsize=129480 CPUtime=0.22
/proc/21863/task/21880/stat : 21880 (pb_cplex) S 21861 21861 21610 0 -1 4202560 567 0 0 0 22 0 0 0 15 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21881] ppid=21861 vsize=129480 CPUtime=0.26
/proc/21863/task/21881/stat : 21881 (pb_cplex) S 21861 21861 21610 0 -1 4202560 643 0 0 0 25 1 0 0 16 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21882] ppid=21861 vsize=129480 CPUtime=0.24
/proc/21863/task/21882/stat : 21882 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1019 0 0 0 23 1 0 0 16 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 5 0 0 0
[pid=21863/tid=21883] ppid=21861 vsize=129480 CPUtime=0.83
/proc/21863/task/21883/stat : 21883 (pb_cplex) R 21861 21861 21610 0 -1 4202560 770 0 0 0 78 5 0 0 17 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 136017485 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21863/tid=21884] ppid=21861 vsize=129480 CPUtime=0.22
/proc/21863/task/21884/stat : 21884 (pb_cplex) S 21861 21861 21610 0 -1 4202560 834 0 0 0 21 1 0 0 16 0 8 0 146815661 132587520 10296 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.41
Current children cumulated vsize (KiB) 138180

[startup+6.3006 s]
/proc/loadavg: 8.44 5.82 2.60 3/193 21905
/proc/meminfo: memFree=31154364/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=140980 CPUtime=7.07
/proc/21863/stat : 21863 (pb_cplex) R 21861 21861 21610 0 -1 4202496 32502 0 0 0 671 36 0 0 18 0 8 0 146815572 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 139023109 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/21863/statm: 35245 12196 1099 2985 0 31787 0
[pid=21863/tid=21899] ppid=21861 vsize=140980 CPUtime=0.1
/proc/21863/task/21899/stat : 21899 (pb_cplex) R 21861 21861 21610 0 -1 4202560 1162 0 0 0 10 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136420128 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21863/tid=21900] ppid=21861 vsize=140980 CPUtime=0.1
/proc/21863/task/21900/stat : 21900 (pb_cplex) R 21861 21861 21610 0 -1 4202560 714 0 0 0 10 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21863/tid=21901] ppid=21861 vsize=140980 CPUtime=0.1
/proc/21863/task/21901/stat : 21901 (pb_cplex) R 21861 21861 21610 0 -1 4202560 690 0 0 0 10 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136017763 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21863/tid=21902] ppid=21861 vsize=140980 CPUtime=0.1
/proc/21863/task/21902/stat : 21902 (pb_cplex) R 21861 21861 21610 0 -1 4202560 626 0 0 0 10 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136007289 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21863/tid=21903] ppid=21861 vsize=140980 CPUtime=0.1
/proc/21863/task/21903/stat : 21903 (pb_cplex) R 21861 21861 21610 0 -1 4202560 1120 0 0 0 10 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21863/tid=21904] ppid=21861 vsize=140980 CPUtime=0.11
/proc/21863/task/21904/stat : 21904 (pb_cplex) R 21861 21861 21610 0 -1 4202560 270 0 0 0 11 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136403112 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21863/tid=21905] ppid=21861 vsize=140980 CPUtime=0.12
/proc/21863/task/21905/stat : 21905 (pb_cplex) R 21861 21861 21610 0 -1 4202560 47 0 0 0 12 0 0 0 16 0 8 0 146816044 144363520 12196 4089446400 134512640 146736320 4289853568 18446744073709551615 136017496 0 2 4096 16387 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.07
Current children cumulated vsize (KiB) 149680

[startup+12.7005 s]
/proc/loadavg: 8.16 5.84 2.64 8/193 21905
/proc/meminfo: memFree=31133108/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=145076 CPUtime=30.92
/proc/21863/stat : 21863 (pb_cplex) R 21861 21861 21610 0 -1 4202496 39660 0 0 0 3035 57 0 0 15 0 8 0 146815572 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 136674344 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/21863/statm: 36269 13948 1080 2985 0 32811 0
[pid=21863/tid=21899] ppid=21861 vsize=145076 CPUtime=2.95
/proc/21863/task/21899/stat : 21899 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1990 0 0 0 293 2 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21900] ppid=21861 vsize=145076 CPUtime=3.07
/proc/21863/task/21900/stat : 21900 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1231 0 0 0 304 3 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21901] ppid=21861 vsize=145076 CPUtime=3.2
/proc/21863/task/21901/stat : 21901 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1408 0 0 0 319 1 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 0 0 0 0
[pid=21863/tid=21902] ppid=21861 vsize=145076 CPUtime=2.99
/proc/21863/task/21902/stat : 21902 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1718 0 0 0 297 2 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21903] ppid=21861 vsize=145076 CPUtime=3
/proc/21863/task/21903/stat : 21903 (pb_cplex) S 21861 21861 21610 0 -1 4202560 3223 0 0 0 297 3 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21904] ppid=21861 vsize=145076 CPUtime=2.88
/proc/21863/task/21904/stat : 21904 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1175 0 0 0 286 2 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21905] ppid=21861 vsize=145076 CPUtime=3.17
/proc/21863/task/21905/stat : 21905 (pb_cplex) R 21861 21861 21610 0 -1 4202560 87 0 0 0 314 3 0 0 15 0 8 0 146816044 148557824 13948 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 30.92
Current children cumulated vsize (KiB) 153776

[startup+25.5013 s]
/proc/loadavg: 8.28 5.94 2.71 11/193 21905
/proc/meminfo: memFree=31131852/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=146100 CPUtime=71.18
/proc/21863/stat : 21863 (pb_cplex) S 21861 21861 21610 0 -1 4202496 47376 0 0 0 7029 89 0 0 15 0 8 0 146815572 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/21863/statm: 36525 14438 1080 2985 0 33067 0
[pid=21863/tid=21899] ppid=21861 vsize=146100 CPUtime=8.03
/proc/21863/task/21899/stat : 21899 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2634 0 0 0 797 6 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21900] ppid=21861 vsize=146100 CPUtime=8.09
/proc/21863/task/21900/stat : 21900 (pb_cplex) S 21861 21861 21610 0 -1 4202560 3990 0 0 0 801 8 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 5 0 0 0
[pid=21863/tid=21901] ppid=21861 vsize=146100 CPUtime=8.18
/proc/21863/task/21901/stat : 21901 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2158 0 0 0 813 5 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21902] ppid=21861 vsize=146100 CPUtime=7.75
/proc/21863/task/21902/stat : 21902 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2393 0 0 0 769 6 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 1 0 0 0
[pid=21863/tid=21903] ppid=21861 vsize=146100 CPUtime=7.88
/proc/21863/task/21903/stat : 21903 (pb_cplex) R 21861 21861 21610 0 -1 4202560 3514 0 0 0 781 7 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21863/tid=21904] ppid=21861 vsize=146100 CPUtime=7.91
/proc/21863/task/21904/stat : 21904 (pb_cplex) S 21861 21861 21610 0 -1 4202560 3127 0 0 0 785 6 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 5 0 0 0
[pid=21863/tid=21905] ppid=21861 vsize=146100 CPUtime=8.18
/proc/21863/task/21905/stat : 21905 (pb_cplex) S 21861 21861 21610 0 -1 4202560 707 0 0 0 811 7 0 0 15 0 8 0 146816044 149606400 14438 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 71.18
Current children cumulated vsize (KiB) 154800

[startup+51.101 s]
/proc/loadavg: 8.31 6.17 2.89 11/193 21928
/proc/meminfo: memFree=31132440/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=148028 CPUtime=157.1
/proc/21863/stat : 21863 (pb_cplex) S 21861 21861 21610 0 -1 4202496 100412 0 0 0 15566 144 0 0 16 0 8 0 146815572 151580672 14164 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21863/statm: 37007 14164 1092 2985 0 33549 0
[pid=21863/tid=21922] ppid=21861 vsize=148028 CPUtime=5.14
/proc/21863/task/21922/stat : 21922 (pb_cplex) S 21861 21861 21610 0 -1 4202560 3415 0 0 0 511 3 0 0 16 0 8 0 146819468 151580672 14164 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 1 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=148028 CPUtime=5.42
/proc/21863/task/21923/stat : 21923 (pb_cplex) S 21861 21861 21610 0 -1 4202560 3553 0 0 0 539 3 0 0 16 0 8 0 146819468 151580672 14164 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=148028 CPUtime=5.44
/proc/21863/task/21924/stat : 21924 (pb_cplex) S 21861 21861 21610 0 -1 4202560 970 0 0 0 541 3 0 0 16 0 8 0 146819468 151580672 14164 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=21863/tid=21923] ppid=21861 vsize=154172 CPUtime=42.78
/proc/21863/task/21923/stat : 21923 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4577 0 0 0 4246 32 0 0 15 0 8 0 146819468 157872128 15578 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=154172 CPUtime=43.34
/proc/21863/task/21924/stat : 21924 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1895 0 0 0 4303 31 0 0 15 0 8 0 146819468 157872128 15578 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=154172 CPUtime=43.66
/proc/21863/task/21925/stat : 21925 (pb_cplex) R 21861 21861 21610 0 -1 4202560 10207 0 0 0 4338 28 0 0 15 0 8 0 146819468 157872128 15578 4089446400 134512640 146736320 4289853568 18446744073709551615 135451425 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=154172 CPUtime=42.46
/proc/21863/task/21926/stat : 21926 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2000 0 0 0 4219 27 0 0 15 0 8 0 146819468 157872128 15578 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=154172 CPUtime=42.19
/proc/21863/task/21927/stat : 21927 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1739 0 0 0 4190 29 0 0 15 0 8 0 146819468 157872128 15578 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=154172 CPUtime=42.72
/proc/21863/task/21928/stat : 21928 (pb_cplex) R 21861 21861 21610 0 -1 4202560 7039 0 0 0 4239 33 0 0 15 0 8 0 146819468 157872128 15578 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 461.88
Current children cumulated vsize (KiB) 162872

[startup+134.501 s]
/proc/loadavg: 8.69 6.82 3.39 10/193 21930
/proc/meminfo: memFree=31131492/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=152124 CPUtime=482.91
/proc/21863/stat : 21863 (pb_cplex) R 21861 21861 21610 0 -1 4202496 114733 0 0 0 47913 378 0 0 16 0 8 0 146815572 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 136400583 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21863/statm: 38031 15098 1092 2985 0 34573 0
[pid=21863/tid=21922] ppid=21861 vsize=152124 CPUtime=45.75
/proc/21863/task/21922/stat : 21922 (pb_cplex) R 21861 21861 21610 0 -1 4202560 4661 0 0 0 4540 35 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=152124 CPUtime=45.21
/proc/21863/task/21923/stat : 21923 (pb_cplex) R 21861 21861 21610 0 -1 4202560 4580 0 0 0 4487 34 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 136385268 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=152124 CPUtime=46.07
/proc/21863/task/21924/stat : 21924 (pb_cplex) R 21861 21861 21610 0 -1 4202560 1896 0 0 0 4573 34 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=152124 CPUtime=46.17
/proc/21863/task/21925/stat : 21925 (pb_cplex) R 21861 21861 21610 0 -1 4202560 10209 0 0 0 4587 30 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 137341942 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=152124 CPUtime=45.09
/proc/21863/task/21926/stat : 21926 (pb_cplex) R 21861 21861 21610 0 -1 4202560 2147 0 0 0 4479 30 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=152124 CPUtime=44.83
/proc/21863/task/21927/stat : 21927 (pb_cplex) R 21861 21861 21610 0 -1 4202560 1742 0 0 0 4452 31 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 136015727 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=152124 CPUtime=45.18
/proc/21863/task/21928/stat : 21928 (pb_cplex) R 21861 21861 21610 0 -1 4202560 7040 0 0 0 4483 35 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 136015865 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 482.91
Current children cumulated vsize (KiB) 160824

[startup+137.706 s]
/proc/loadavg: 8.71 6.86 3.42 10/193 21930
/proc/meminfo: memFree=31131232/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=152124 CPUtime=493.34
/proc/21863/stat : 21863 (pb_cplex) S 21861 21861 21610 0 -1 4202496 114845 0 0 0 48947 387 0 0 15 0 8 0 146815572 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21863/statm: 38031 15098 1092 2985 0 34573 0
[pid=21863/tid=21922] ppid=21861 vsize=152124 CPUtime=47.14
/proc/21863/task/21922/stat : 21922 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4662 0 0 0 4677 37 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=152124 CPUtime=46.44
/proc/21863/task/21923/stat : 21923 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4689 0 0 0 4608 36 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=152124 CPUtime=47.36
/proc/21863/task/21924/stat : 21924 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1896 0 0 0 4701 35 0 0 16 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 4 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=152124 CPUtime=47.43
/proc/21863/task/21925/stat : 21925 (pb_cplex) S 21861 21861 21610 0 -1 4202560 10210 0 0 0 4712 31 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=152124 CPUtime=46.31
/proc/21863/task/21926/stat : 21926 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2147 0 0 0 4600 31 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 5 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=152124 CPUtime=46.14
/proc/21863/task/21927/stat : 21927 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1742 0 0 0 4582 32 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 1 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=152124 CPUtime=46.44
/proc/21863/task/21928/stat : 21928 (pb_cplex) R 21861 21861 21610 0 -1 4202560 7040 0 0 0 4608 36 0 0 15 0 8 0 146819468 155774976 15098 4089446400 134512640 146736320 4289853568 18446744073709551615 135852724 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 493.34
Current children cumulated vsize (KiB) 160824

[startup+138.502 s]
/proc/loadavg: 8.71 6.86 3.42 10/193 21930
/proc/meminfo: memFree=31131232/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=149052 CPUtime=495.95
/proc/21863/stat : 21863 (pb_cplex) R 21861 21861 21610 0 -1 4202496 114857 0 0 0 49205 390 0 0 16 0 8 0 146815572 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/21863/statm: 37263 14638 1092 2985 0 33805 0
[pid=21863/tid=21922] ppid=21861 vsize=149052 CPUtime=47.48
/proc/21863/task/21922/stat : 21922 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4662 0 0 0 4710 38 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=149052 CPUtime=46.77
/proc/21863/task/21923/stat : 21923 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4689 0 0 0 4641 36 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 4 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=149052 CPUtime=47.67
/proc/21863/task/21924/stat : 21924 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1896 0 0 0 4732 35 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=149052 CPUtime=47.73
/proc/21863/task/21925/stat : 21925 (pb_cplex) S 21861 21861 21610 0 -1 4202560 10210 0 0 0 4742 31 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 0 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=149052 CPUtime=46.65
/proc/21863/task/21926/stat : 21926 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2158 0 0 0 4633 32 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 1 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=149052 CPUtime=46.47
/proc/21863/task/21927/stat : 21927 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1742 0 0 0 4615 32 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=149052 CPUtime=46.8
/proc/21863/task/21928/stat : 21928 (pb_cplex) S 21861 21861 21610 0 -1 4202560 7041 0 0 0 4643 37 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 495.95
Current children cumulated vsize (KiB) 157752

[startup+138.901 s]
/proc/loadavg: 8.71 6.86 3.42 10/193 21930
/proc/meminfo: memFree=31131728/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=149052 CPUtime=497.52
/proc/21863/stat : 21863 (pb_cplex) R 21861 21861 21610 0 -1 4202496 114857 0 0 0 49361 391 0 0 15 0 8 0 146815572 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/21863/statm: 37263 14638 1092 2985 0 33805 0
[pid=21863/tid=21922] ppid=21861 vsize=149052 CPUtime=47.7
/proc/21863/task/21922/stat : 21922 (pb_cplex) R 21861 21861 21610 0 -1 4202560 4662 0 0 0 4732 38 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=149052 CPUtime=46.97
/proc/21863/task/21923/stat : 21923 (pb_cplex) R 21861 21861 21610 0 -1 4202560 4689 0 0 0 4661 36 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=149052 CPUtime=47.87
/proc/21863/task/21924/stat : 21924 (pb_cplex) R 21861 21861 21610 0 -1 4202560 1896 0 0 0 4752 35 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=149052 CPUtime=47.92
/proc/21863/task/21925/stat : 21925 (pb_cplex) R 21861 21861 21610 0 -1 4202560 10210 0 0 0 4761 31 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=149052 CPUtime=46.83
/proc/21863/task/21926/stat : 21926 (pb_cplex) R 21861 21861 21610 0 -1 4202560 2158 0 0 0 4651 32 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=149052 CPUtime=46.62
/proc/21863/task/21927/stat : 21927 (pb_cplex) R 21861 21861 21610 0 -1 4202560 1742 0 0 0 4630 32 0 0 15 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=149052 CPUtime=46.98
/proc/21863/task/21928/stat : 21928 (pb_cplex) S 21861 21861 21610 0 -1 4202560 7041 0 0 0 4661 37 0 0 16 0 8 0 146819468 152629248 14638 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 497.52
Current children cumulated vsize (KiB) 157752

[startup+139.308 s]
/proc/loadavg: 8.71 6.86 3.42 10/193 21930
/proc/meminfo: memFree=31131728/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=148028 CPUtime=498.9
/proc/21863/stat : 21863 (pb_cplex) S 21861 21861 21610 0 -1 4202496 114857 0 0 0 49498 392 0 0 15 0 8 0 146815572 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21863/statm: 37007 14488 1092 2985 0 33549 0
[pid=21863/tid=21922] ppid=21861 vsize=148028 CPUtime=47.84
/proc/21863/task/21922/stat : 21922 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4662 0 0 0 4746 38 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 6 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=148028 CPUtime=47.14
/proc/21863/task/21923/stat : 21923 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4689 0 0 0 4678 36 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=148028 CPUtime=48.03
/proc/21863/task/21924/stat : 21924 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1896 0 0 0 4767 36 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 1 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=148028 CPUtime=48.16
/proc/21863/task/21925/stat : 21925 (pb_cplex) S 21861 21861 21610 0 -1 4202560 10210 0 0 0 4784 32 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 5 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=148028 CPUtime=47.01
/proc/21863/task/21926/stat : 21926 (pb_cplex) R 21861 21861 21610 0 -1 4202560 2158 0 0 0 4669 32 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=148028 CPUtime=46.79
/proc/21863/task/21927/stat : 21927 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1742 0 0 0 4646 33 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=148028 CPUtime=47.17
/proc/21863/task/21928/stat : 21928 (pb_cplex) S 21861 21861 21610 0 -1 4202560 7041 0 0 0 4680 37 0 0 15 0 8 0 146819468 151580672 14488 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 498.9
Current children cumulated vsize (KiB) 156728

[startup+139.413 s]
/proc/loadavg: 8.71 6.86 3.42 10/193 21930
/proc/meminfo: memFree=31131728/32951132 swapFree=67111528/67111528
[pid=21861] ppid=21859 vsize=8700 CPUtime=0
/proc/21861/stat : 21861 (run) S 21859 21861 21610 0 -1 4202496 363 0 0 0 0 0 0 0 24 0 1 0 146815572 8908800 248 4089446400 4194304 4922060 140736427228048 18446744073709551615 210646965381 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21861/statm: 2175 248 208 178 0 68 0
[pid=21863] ppid=21861 vsize=145980 CPUtime=499.23
/proc/21863/stat : 21863 (pb_cplex) S 21861 21861 21610 0 -1 4202496 114857 0 0 0 49531 392 0 0 15 0 8 0 146815572 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/21863/statm: 36495 14129 1092 2985 0 33037 0
[pid=21863/tid=21922] ppid=21861 vsize=145980 CPUtime=47.85
/proc/21863/task/21922/stat : 21922 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4662 0 0 0 4747 38 0 0 15 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21923] ppid=21861 vsize=145980 CPUtime=47.18
/proc/21863/task/21923/stat : 21923 (pb_cplex) S 21861 21861 21610 0 -1 4202560 4689 0 0 0 4682 36 0 0 16 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 7 0 0 0
[pid=21863/tid=21924] ppid=21861 vsize=145980 CPUtime=48.09
/proc/21863/task/21924/stat : 21924 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1896 0 0 0 4773 36 0 0 15 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 2 0 0 0
[pid=21863/tid=21925] ppid=21861 vsize=145980 CPUtime=48.22
/proc/21863/task/21925/stat : 21925 (pb_cplex) S 21861 21861 21610 0 -1 4202560 10210 0 0 0 4790 32 0 0 15 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 1 0 0 0
[pid=21863/tid=21926] ppid=21861 vsize=145980 CPUtime=47.07
/proc/21863/task/21926/stat : 21926 (pb_cplex) S 21861 21861 21610 0 -1 4202560 2158 0 0 0 4675 32 0 0 16 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 4 0 0 0
[pid=21863/tid=21927] ppid=21861 vsize=145980 CPUtime=46.83
/proc/21863/task/21927/stat : 21927 (pb_cplex) S 21861 21861 21610 0 -1 4202560 1742 0 0 0 4650 33 0 0 15 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144580073 0 2 4096 16387 18446604453913168896 0 0 -1 4 0 0 0
[pid=21863/tid=21928] ppid=21861 vsize=145980 CPUtime=47.22
/proc/21863/task/21928/stat : 21928 (pb_cplex) R 21861 21861 21610 0 -1 4202560 7041 0 0 0 4685 37 0 0 15 0 8 0 146819468 149483520 14129 4089446400 134512640 146736320 4289853568 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 499.23
Current children cumulated vsize (KiB) 154680

Child status: 0
Real time (s): 139.481
CPU time (s): 499.311
CPU user time (s): 495.38
CPU system time (s): 3.9314
CPU usage (%): 357.979
Max. virtual memory (cumulated for all children) (KiB): 183008

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 495.38
system time used= 3.9314
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 115250
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 80469
involuntary context switches= 15547

runsolver used 0.315951 second user time and 0.593909 second system time

The end

Launcher Data 

Begin job on node129 at 2010-07-02 09:19:51
IDJOB=2697990
IDBENCH=78983
IDSOLVER=1210
FILE ID=node129/2697990-1278055190
PBS_JOBID= 11198924
Free space on /tmp= 74164 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900552423--soft-66-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697990-1278055190/watcher-2697990-1278055190 -o /tmp/evaluation-result-2697990-1278055190/solver-2697990-1278055190 -C 1800 -W 2000 -M 3800  run HOME/instance-2697990-1278055190.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 2f4d2e59134ffbad904dde6d63a6f677
RANDOM SEED=1934137626

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      31186392 kB
Buffers:        221180 kB
Cached:        1277500 kB
SwapCached:          0 kB
Active:         782936 kB
Inactive:       833172 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      31186392 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16688 kB
Writeback:           4 kB
AnonPages:      118064 kB
Mapped:          19240 kB
Slab:            83224 kB
PageTables:       5144 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   340724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74148 MiB
End job on node129 at 2010-07-02 09:22:10