Trace number 3728417

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
wbo 1.72OPTIMUM 455.11 455.361

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900566157--soft-0-100-0.wbo
MD5SUM5b6bb33016643c054f0ad34369984077
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark48.4186
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 136368
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 136367
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 801
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |   wbo:                     1.72 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728417-1338675823.wbo.
0.00/0.00	c Instance file HOME/instance-3728417-1338675823.wbo
0.00/0.00	c File size is 96779 bytes.
0.00/0.00	c Highest Coefficient sum: 801
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      2938                                                |
0.00/0.00	c |  Number Clauses:        2684                                                |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 23                                                  |
0.00/0.00	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    PB Constraint                                       |
0.00/0.01	c |                                                                             |
0.00/0.01	c ============================[ Search Statistics ]==============================
0.00/0.01	c | Time (s)  | ID |      Bound      |               Shared Clauses             |
0.00/0.01	c |           |    | value      type |  expCls         impCls        Lit/impCl  |
0.00/0.01	c ===============================================================================
405.81/406.02	c | 406.03    | 0  | 1            lb |  0                0                0.00  |
455.11/455.33	c | 455.34    | 0  | 1            ub |  0                0                0.00  |
455.11/455.33	c ===============================================================================
455.11/455.33	c Wall Clock Time: 455.34 s
455.11/455.33	o 1
455.11/455.33	c Best Solution: 1
455.11/455.33	s OPTIMUM FOUND
455.11/455.33	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 x9 -x10 -x11 x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 x95 -x96 -x97 -x98 -x99 x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 x150 -x151 x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728417-1338675823/watcher-3728417-1338675823 -o /tmp/evaluation-result-3728417-1338675823/solver-3728417-1338675823 -C 1800 -W 1900 -M 15500 wbo1.72 -file-format=wbo HOME/instance-3728417-1338675823.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 7671
/proc/meminfo: memFree=28696308/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=3600 CPUtime=0 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) R 7669 7671 7067 0 -1 4202496 380 0 0 0 0 0 0 0 20 0 1 0 333707892 3686400 333 33554432000 4194304 5964350 140737421492288 140735848347144 5368066 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 900 333 168 433 0 440 0

[startup+0.0495989 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 7671
/proc/meminfo: memFree=28696308/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84288 CPUtime=0.04 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 1403 0 0 0 4 0 0 0 20 0 2 0 333707892 86310912 1332 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21072 1332 193 433 0 20636 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 84288

[startup+0.100164 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 7671
/proc/meminfo: memFree=28696308/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84288 CPUtime=0.09 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 1566 0 0 0 9 0 0 0 20 0 2 0 333707892 86310912 1495 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21072 1495 193 433 0 20636 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 84288

[startup+0.300114 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 7671
/proc/meminfo: memFree=28696308/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84288 CPUtime=0.29 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 2115 0 0 0 29 0 0 0 20 0 2 0 333707892 86310912 2044 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21072 2044 193 433 0 20636 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 84288

[startup+0.700116 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 7671
/proc/meminfo: memFree=28696308/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84432 CPUtime=0.68 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 3120 0 0 0 68 0 0 0 20 0 2 0 333707892 86458368 3049 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21108 3049 193 433 0 20672 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 84432

[startup+1.50027 s]
/proc/loadavg: 2.04 2.03 2.00 3/179 7673
/proc/meminfo: memFree=28682396/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84504 CPUtime=1.49 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 4799 0 0 0 148 1 0 0 20 0 2 0 333707892 86532096 4728 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21126 4730 193 433 0 20690 0
[pid=7671/tid=7673] ppid=7669 vsize=84504 CPUtime=1.47 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 3914 0 0 0 147 0 0 0 20 0 2 0 333707893 86532096 4730 33554432000 4194304 5964350 140737421492288 140064551131128 5136340 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 84504

[startup+3.1003 s]
/proc/loadavg: 2.04 2.03 2.00 3/179 7673
/proc/meminfo: memFree=28671088/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84504 CPUtime=3.09 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 8686 0 0 0 307 2 0 0 20 0 2 0 333707892 86532096 8615 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21126 8615 193 433 0 20690 0
[pid=7671/tid=7673] ppid=7669 vsize=84504 CPUtime=3.06 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 7799 0 0 0 305 1 0 0 20 0 2 0 333707893 86532096 8615 33554432000 4194304 5964350 140737421492288 140064551131128 4381527 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 84504

[startup+6.30033 s]
/proc/loadavg: 2.04 2.03 2.00 3/179 7673
/proc/meminfo: memFree=28643436/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=84504 CPUtime=6.29 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 15377 0 0 0 625 4 0 0 20 0 2 0 333707892 86532096 15306 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 21126 15306 193 433 0 20690 0
[pid=7671/tid=7673] ppid=7669 vsize=84504 CPUtime=6.25 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 14490 0 0 0 622 3 0 0 20 0 2 0 333707893 86532096 15306 33554432000 4194304 5964350 140737421492288 140064551130936 5136340 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 84504

[startup+12.7003 s]
/proc/loadavg: 2.04 2.03 2.00 3/179 7673
/proc/meminfo: memFree=28593744/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=150148 CPUtime=12.68 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 27374 0 0 0 1262 6 0 0 20 0 2 0 333707892 153751552 27303 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 37537 27303 193 433 0 37101 0
[pid=7671/tid=7673] ppid=7669 vsize=150148 CPUtime=12.64 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 26487 0 0 0 1259 5 0 0 20 0 2 0 333707893 153751552 27303 33554432000 4194304 5964350 140737421492288 140064551131128 4400007 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 150148

[startup+25.5004 s]
/proc/loadavg: 2.10 2.04 2.01 3/179 7673
/proc/meminfo: memFree=28510416/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=215844 CPUtime=25.47 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 45184 0 0 0 2537 10 0 0 20 0 2 0 333707892 221024256 45113 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 53961 45113 193 433 0 53525 0
[pid=7671/tid=7673] ppid=7669 vsize=215844 CPUtime=25.4 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 44297 0 0 0 2530 10 0 0 20 0 2 0 333707893 221024256 45113 33554432000 4194304 5964350 140737421492288 140064551131128 4220672 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 215844

[startup+51.1004 s]
/proc/loadavg: 2.06 2.04 2.00 3/179 7673
/proc/meminfo: memFree=28388400/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=281380 CPUtime=51.06 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 56872 0 0 0 5093 13 0 0 20 0 2 0 333707892 288133120 56794 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 70345 56794 193 433 0 69909 0
[pid=7671/tid=7673] ppid=7669 vsize=281380 CPUtime=50.92 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 55985 0 0 0 5079 13 0 0 20 0 2 0 333707893 288133120 56794 33554432000 4194304 5964350 140737421492288 140064551131128 4400023 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 281380

[startup+102.307 s]
/proc/loadavg: 2.02 2.03 2.00 3/179 7673
/proc/meminfo: memFree=28262692/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=412692 CPUtime=102.24 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 88205 0 0 0 10202 22 0 0 20 0 2 0 333707892 422596608 88131 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 103173 88131 193 433 0 102737 0
[pid=7671/tid=7673] ppid=7669 vsize=412692 CPUtime=101.98 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 87318 0 0 0 10175 23 0 0 20 0 2 0 333707893 422596608 88131 33554432000 4194304 5964350 140737421492288 140064551131128 4400023 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 412692

[startup+162.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/179 7673
/proc/meminfo: memFree=28206240/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=478372 CPUtime=162.19 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 102592 0 0 0 16193 26 0 0 20 0 2 0 333707892 489852928 101988 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 119593 101988 193 433 0 119157 0
[pid=7671/tid=7673] ppid=7669 vsize=478372 CPUtime=161.79 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 101705 0 0 0 16151 28 0 0 20 0 2 0 333707893 489852928 101988 33554432000 4194304 5964350 140737421492288 140064551131160 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.19
Current children cumulated vsize (KiB) 478372

[startup+222.3 s]
/proc/loadavg: 2.11 2.06 2.01 3/179 7673
/proc/meminfo: memFree=28110788/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=544196 CPUtime=222.15 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 126570 0 0 0 22182 33 0 0 20 0 2 0 333707892 557256704 125947 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 136049 125947 193 433 0 135613 0
[pid=7671/tid=7673] ppid=7669 vsize=544196 CPUtime=221.6 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 125683 0 0 0 22124 36 0 0 20 0 2 0 333707893 557256704 125947 33554432000 4194304 5964350 140737421492288 140064551131128 4399840 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 222.15
Current children cumulated vsize (KiB) 544196

[startup+282.3 s]
/proc/loadavg: 2.07 2.06 2.01 3/179 7674
/proc/meminfo: memFree=28042108/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=544340 CPUtime=282.13 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 132718 0 0 0 28179 34 0 0 20 0 2 0 333707892 557404160 132896 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 136085 132896 193 433 0 135649 0
[pid=7671/tid=7673] ppid=7669 vsize=544340 CPUtime=281.44 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 131831 0 0 0 28106 38 0 0 20 0 2 0 333707893 557404160 132896 33554432000 4194304 5964350 140737421492288 140064551131128 4400390 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 282.13
Current children cumulated vsize (KiB) 544340

[startup+342.3 s]
/proc/loadavg: 2.02 2.04 2.00 3/179 7674
/proc/meminfo: memFree=27976168/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=675556 CPUtime=342.12 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 149219 0 0 0 34172 40 0 0 20 0 2 0 333707892 691769344 149397 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168889 149397 193 433 0 168453 0
[pid=7671/tid=7673] ppid=7669 vsize=675556 CPUtime=341.28 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 148332 0 0 0 34084 44 0 0 20 0 2 0 333707893 691769344 149397 33554432000 4194304 5964350 140737421492288 140064551131272 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 342.12
Current children cumulated vsize (KiB) 675556

[startup+402.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/180 7677
/proc/meminfo: memFree=27874852/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=742064 CPUtime=402.11 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174502 0 0 0 40164 47 0 0 20 0 2 0 333707892 759873536 174680 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 185516 174680 193 433 0 185080 0
[pid=7671/tid=7673] ppid=7669 vsize=742064 CPUtime=401.13 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173615 0 0 0 40060 53 0 0 20 0 2 0 333707893 759873536 174680 33554432000 4194304 5964350 140737421492288 140064551131128 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 402.11
Current children cumulated vsize (KiB) 742064

Solver just ended. Dumping a history of the last processes samples

[startup+409.5 s]
/proc/loadavg: 2.09 2.05 2.01 3/180 7677
/proc/meminfo: memFree=27976408/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=409.31 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174506 0 0 0 40883 48 0 0 20 0 2 0 333707892 690290688 149091 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149091 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=408.31 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173619 0 0 0 40777 54 0 0 20 0 2 0 333707893 690290688 149091 33554432000 4194304 5964350 140737421492288 140064551132088 4388112 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 409.31
Current children cumulated vsize (KiB) 674112

[startup+435.1 s]
/proc/loadavg: 2.12 2.06 2.01 3/180 7677
/proc/meminfo: memFree=27944576/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=434.9 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174513 0 0 0 43442 48 0 0 20 0 2 0 333707892 690290688 149098 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149098 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=433.84 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173626 0 0 0 43330 54 0 0 20 0 2 0 333707893 690290688 149098 33554432000 4194304 5964350 140737421492288 140064551132088 4392925 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 434.9
Current children cumulated vsize (KiB) 674112

[startup+447.9 s]
/proc/loadavg: 2.10 2.06 2.01 3/179 7677
/proc/meminfo: memFree=27944584/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=447.7 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174525 0 0 0 44722 48 0 0 20 0 2 0 333707892 690290688 149110 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149110 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=446.61 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173638 0 0 0 44607 54 0 0 20 0 2 0 333707893 690290688 149110 33554432000 4194304 5964350 140737421492288 140064551132088 4399976 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 447.7
Current children cumulated vsize (KiB) 674112

[startup+451.1 s]
/proc/loadavg: 2.10 2.06 2.01 3/179 7677
/proc/meminfo: memFree=27944708/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=450.9 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174525 0 0 0 45042 48 0 0 20 0 2 0 333707892 690290688 149110 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149110 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=449.8 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173638 0 0 0 44926 54 0 0 20 0 2 0 333707893 690290688 149110 33554432000 4194304 5964350 140737421492288 140064551132088 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 450.9
Current children cumulated vsize (KiB) 674112

[startup+452.7 s]
/proc/loadavg: 2.10 2.06 2.01 3/179 7677
/proc/meminfo: memFree=27944708/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=452.5 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174525 0 0 0 45202 48 0 0 20 0 2 0 333707892 690290688 149110 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149110 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=451.4 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173638 0 0 0 45086 54 0 0 20 0 2 0 333707893 690290688 149110 33554432000 4194304 5964350 140737421492288 140064551132088 4388229 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 452.5
Current children cumulated vsize (KiB) 674112

[startup+454.307 s]
/proc/loadavg: 2.09 2.05 2.01 3/179 7677
/proc/meminfo: memFree=27944708/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=454.11 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174525 0 0 0 45363 48 0 0 20 0 2 0 333707892 690290688 149110 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149110 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=453 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173638 0 0 0 45246 54 0 0 20 0 2 0 333707893 690290688 149110 33554432000 4194304 5964350 140737421492288 140064551132088 4390872 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 454.11
Current children cumulated vsize (KiB) 674112

[startup+455.1 s]
/proc/loadavg: 2.09 2.05 2.01 3/179 7677
/proc/meminfo: memFree=27944708/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=454.9 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174525 0 0 0 45442 48 0 0 20 0 2 0 333707892 690290688 149110 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149110 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=453.79 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173638 0 0 0 45325 54 0 0 20 0 2 0 333707893 690290688 149110 33554432000 4194304 5964350 140737421492288 140064551132088 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 454.9
Current children cumulated vsize (KiB) 674112

[startup+455.3 s]
/proc/loadavg: 2.09 2.05 2.01 3/179 7677
/proc/meminfo: memFree=27944708/32873844 swapFree=7632/7632
[pid=7671] ppid=7669 vsize=674112 CPUtime=455.11 cores=1,3,5,7
/proc/7671/stat : 7671 (wbo1.72) S 7669 7671 7067 0 -1 4202496 174525 0 0 0 45463 48 0 0 20 0 2 0 333707892 690290688 149110 33554432000 4194304 5964350 140737421492288 140737421491808 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7671/statm: 168528 149110 197 433 0 168092 0
[pid=7671/tid=7673] ppid=7669 vsize=674112 CPUtime=454 cores=1,3,5,7
/proc/7671/task/7673/stat : 7673 (wbo1.72) R 7669 7671 7067 0 -1 4202560 173638 0 0 0 45346 54 0 0 20 0 2 0 333707893 690290688 149110 33554432000 4194304 5964350 140737421492288 140064551132088 4222416 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 455.11
Current children cumulated vsize (KiB) 674112

Child status: 255

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7671 and gives
#  childrusage.ru_utime.tv_sec=453
#  childrusage.ru_utime.tv_usec=496058
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=573912
# CPU time returned by wait4() is 454.07
# while last known CPU time is 455.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 455.361
CPU time (s): 455.11
CPU user time (s): 454.63
CPU system time (s): 0.48
CPU usage (%): 99.9449
Max. virtual memory (cumulated for all children) (KiB): 742064

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 453.496
system time used= 0.573912
maximum resident set size= 698736
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 174528
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 147
involuntary context switches= 543

runsolver used 0.836872 second user time and 1.89371 second system time

The end

Launcher Data 

Begin job on node130 at 2012-06-03 00:23:43
IDJOB=3728417
IDBENCH=79298
IDSOLVER=2315
FILE ID=node130/3728417-1338675823
RUNJOBID= node130-1338674713-7515
PBS_JOBID= 14636509
Free space on /tmp= 70976 MiB

SOLVER NAME= wbo 1.72
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900566157--soft-0-100-0.wbo
COMMAND LINE= wbo1.72 -file-format=wbo BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728417-1338675823/watcher-3728417-1338675823 -o /tmp/evaluation-result-3728417-1338675823/solver-3728417-1338675823 -C 1800 -W 1900 -M 15500  wbo1.72 -file-format=wbo HOME/instance-3728417-1338675823.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5b6bb33016643c054f0ad34369984077
RANDOM SEED=844481650

node130.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5228.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28696672 kB
Buffers:          395096 kB
Cached:          2190280 kB
SwapCached:         4252 kB
Active:          1789376 kB
Inactive:        1525788 kB
Active(anon):     721856 kB
Inactive(anon):     8136 kB
Active(file):    1067520 kB
Inactive(file):  1517652 kB
Unevictable:        7632 kB
Mlocked:            7632 kB
SwapTotal:      67108856 kB
SwapFree:       67099280 kB
Dirty:              5444 kB
Writeback:             0 kB
AnonPages:        733796 kB
Mapped:            10116 kB
Shmem:                 4 kB
Slab:             719192 kB
SReclaimable:     160972 kB
SUnreclaim:       558220 kB
KernelStack:        1488 kB
PageTables:         5520 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     147944 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    622592 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70972 MiB
End job on node130 at 2012-06-03 00:31:18