Trace number 3742542

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.11 1800.65

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K141.opb
MD5SUMe981076bb5354ded6cb9b093a6d1a03e
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables16779
Total number of constraints17063
Number of constraints which are clauses16922
Number of constraints which are cardinality constraints (but not clauses)141
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint141
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 142
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742542-1338772182.opb
0.00/0.00	c File size is 1144017 bytes.
0.09/0.11	c Highest Coefficient sum: 142
0.09/0.11	c Parsing was ok!!
0.09/0.11	c Total parsing time: 0.106 s
0.09/0.12	c Var: 16779 Constr: 17063 16922/141/0 Lit: 109699 Watch. Lit: 50621
0.09/0.12	c Obj. Vars: 0 (0 % of total variables)
7.28/7.39	c Pre-processing Time: 7.38 s
7.28/7.39	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
7.28/7.39	c        0  15259    15649   103418    6    47373  142602      0      0 7.38
7.28/7.39	c Switching off LPR mode.
1800.05/1800.60	c      100  15259    15749   109382    6    47573  156863    100     13 7.44
1800.05/1800.60	c      250  15259    15899   131129    8    47873  172550    250     32 7.59
1800.05/1800.60	c      475  15259    16124   145649    9    48323  189806    475     60 7.88
1800.05/1800.60	c      813  15259    16462   187852   11    48999  208787    813     99 8.20
1800.05/1800.60	c     1322  15259    16971   225047   13    50017  229666   1322    152 8.65
1800.05/1800.60	c     2085  15259    17734   313954   17    51543  252633   2085    225 9.23
1800.05/1800.60	c     3232  15259    18881   514676   27    53837  277897   3232    318 10.16
1800.05/1800.60	c     4953  15259    20602   745164   36    57279  305687   4953    419 11.80
1800.05/1800.60	c     7537  15259    23186  1128230   48    62447  336256   7537    547 13.76
1800.05/1800.60	c    11416  15259    27065  1807486   66    70205  369882  11416    629 18.13
1800.05/1800.60	c    17238  15259    32887  2527195   76    81849  406871  17238    661 26.05
1800.05/1800.60	c    25975  15259    41624  4488020  107    99323  447559  25975    634 40.94
1800.05/1800.60	c    39088  15259    54737 12500231  228   125549  492315  39088    553 70.64
1800.05/1800.60	c    58759  15259    74408 27966433  375   164891  541547  58759    476 123.44
1800.05/1800.60	c    88270  15259   103919 52869753  508   223913  595702  88270    317 277.97
1800.05/1800.60	c   132540  15259   148189 69474764  468   312453  655273 132540    251 527.77
1800.05/1800.60	c   198950  15259   214599 119561695  557   445273  720801 198950    167 1189.48
1800.05/1800.60	c Caught signal: 15
1800.05/1800.60	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.05/1800.60	c   17   253920 156820  8693105   269569 163088957 253920    141 1800.06
1800.05/1800.60	s UNKNOWN
1800.05/1800.60	c Total time: 1800.06 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742542-1338772182/watcher-3742542-1338772182 -o /tmp/evaluation-result-3742542-1338772182/solver-3742542-1338772182 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742542-1338772182.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 23277
/proc/meminfo: memFree=27315968/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=2660 CPUtime=0 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) D 23275 23277 20253 0 -1 4194304 96 0 0 0 0 0 0 0 20 0 1 0 343345058 2723840 48 33554432000 134512640 135840783 4293029792 4293027828 11203524 0 0 4096 0 18446744072100609316 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 665 48 37 325 0 32 0

[startup+0.087197 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 23277
/proc/meminfo: memFree=27315968/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=8984 CPUtime=0.07 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 1478 0 0 0 7 0 0 0 20 0 1 0 343345058 9199616 1414 33554432000 134512640 135840783 4293029792 4293027088 1754407 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2246 1414 539 325 0 902 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 8984

[startup+0.100232 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 23277
/proc/meminfo: memFree=27315968/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=9112 CPUtime=0.09 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 1553 0 0 0 9 0 0 0 20 0 1 0 343345058 9330688 1489 33554432000 134512640 135840783 4293029792 4293028784 134525286 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2278 1490 570 325 0 934 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9112

[startup+0.300193 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 23277
/proc/meminfo: memFree=27315968/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=10944 CPUtime=0.28 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 2286 0 0 0 28 0 0 0 20 0 1 0 343345058 11206656 1942 33554432000 134512640 135840783 4293029792 4292827520 134583223 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2736 1942 344 325 0 1672 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 10944

[startup+0.700178 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 23277
/proc/meminfo: memFree=27315968/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=10944 CPUtime=0.68 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 2289 0 0 0 68 0 0 0 20 0 1 0 343345058 11206656 1945 33554432000 134512640 135840783 4293029792 4292827400 8647176 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2736 1945 344 325 0 1672 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 10944

[startup+1.50018 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23278
/proc/meminfo: memFree=27308488/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=10944 CPUtime=1.48 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 2289 0 0 0 148 0 0 0 20 0 1 0 343345058 11206656 1945 33554432000 134512640 135840783 4293029792 4292827548 3761200 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2736 1945 344 325 0 1672 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 10944

[startup+3.10018 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23278
/proc/meminfo: memFree=27307752/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=10944 CPUtime=3.08 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 2290 0 0 0 308 0 0 0 20 0 1 0 343345058 11206656 1946 33554432000 134512640 135840783 4293029792 4292827408 134550779 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2736 1946 344 325 0 1672 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 10944

[startup+6.30018 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23278
/proc/meminfo: memFree=27301676/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=10944 CPUtime=6.29 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 2291 0 0 0 628 1 0 0 20 0 1 0 343345058 11206656 1947 33554432000 134512640 135840783 4293029792 4292827408 134551048 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 2736 1947 344 325 0 1672 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 10944

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23278
/proc/meminfo: memFree=27289812/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=21820 CPUtime=12.68 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 5209 0 0 0 1266 2 0 0 20 0 1 0 343345058 22343680 4700 33554432000 134512640 135840783 4293029792 4293028880 1752324 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 5455 4700 349 325 0 4391 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 21820

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23281
/proc/meminfo: memFree=27255160/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=43288 CPUtime=25.48 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 10563 0 0 0 2544 4 0 0 20 0 1 0 343345058 44326912 10054 33554432000 134512640 135840783 4293029792 4293029152 134550767 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 10822 10054 349 325 0 9758 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 43288

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23281
/proc/meminfo: memFree=27184508/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=93224 CPUtime=51.06 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 23053 0 0 0 5099 7 0 0 20 0 1 0 343345058 95461376 22544 33554432000 134512640 135840783 4293029792 4293029152 134551071 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23277/statm: 23306 22544 349 325 0 22242 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 93224

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23282
/proc/meminfo: memFree=26927448/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=300572 CPUtime=102.26 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 74883 0 0 0 10209 17 0 0 20 0 1 0 343345058 307785728 74374 33554432000 134512640 135840783 4293029792 4293029152 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 75143 74374 349 325 0 74079 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 300572

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23282
/proc/meminfo: memFree=26773480/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=416248 CPUtime=162.25 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 103827 0 0 0 16202 23 0 0 20 0 1 0 343345058 426237952 103318 33554432000 134512640 135840783 4293029792 4293029152 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 104062 103318 349 325 0 102998 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 416248

[startup+222.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23282
/proc/meminfo: memFree=26568660/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=567276 CPUtime=222.25 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 141584 0 0 0 22195 30 0 0 20 0 1 0 343345058 580890624 141075 33554432000 134512640 135840783 4293029792 4293029152 134551324 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 141819 141075 349 325 0 140755 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 567276

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23282
/proc/meminfo: memFree=26403148/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=692852 CPUtime=282.23 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 172956 0 0 0 28187 36 0 0 20 0 1 0 343345058 709480448 172447 33554432000 134512640 135840783 4293029792 4293029152 134550872 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 173213 172447 349 325 0 172149 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 692852

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23282
/proc/meminfo: memFree=26283764/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=763164 CPUtime=342.22 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 190538 0 0 0 34182 40 0 0 20 0 1 0 343345058 781479936 190029 33554432000 134512640 135840783 4293029792 4293029152 134551175 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 190791 190029 349 325 0 189727 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 763164

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23283
/proc/meminfo: memFree=26147392/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=807836 CPUtime=402.21 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 201713 0 0 0 40178 43 0 0 20 0 1 0 343345058 827224064 201204 33554432000 134512640 135840783 4293029792 4293029152 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 201959 201204 349 325 0 200895 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 807836

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23283
/proc/meminfo: memFree=26001844/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=857344 CPUtime=462.21 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 214078 0 0 0 46175 46 0 0 20 0 1 0 343345058 877920256 213569 33554432000 134512640 135840783 4293029792 4293029104 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 214336 213569 349 325 0 213272 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 857344

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23283
/proc/meminfo: memFree=25831744/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=904048 CPUtime=522.19 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 225765 0 0 0 52171 48 0 0 20 0 1 0 343345058 925745152 225256 33554432000 134512640 135840783 4293029792 4293029152 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 226012 225256 349 325 0 224948 0
Current children cumulated CPU time (s) 522.19
Current children cumulated vsize (KiB) 904048

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23283
/proc/meminfo: memFree=25702936/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=952592 CPUtime=582.19 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 237893 0 0 0 58167 52 0 0 20 0 1 0 343345058 975454208 237384 33554432000 134512640 135840783 4293029792 4293029152 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 238148 237384 349 325 0 237084 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 952592

[startup+642.3 s]

################
# More data... #
################

[startup+882.307 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23287
/proc/meminfo: memFree=25298168/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1173288 CPUtime=882.14 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 293073 0 0 0 88147 67 0 0 20 0 1 0 343345058 1201446912 292564 33554432000 134512640 135840783 4293029792 4293029152 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 293322 292564 349 325 0 292258 0
Current children cumulated CPU time (s) 882.14
Current children cumulated vsize (KiB) 1173288

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23287
/proc/meminfo: memFree=25219596/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1222196 CPUtime=942.11 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 305316 0 0 0 94142 69 0 0 20 0 1 0 343345058 1251528704 304787 33554432000 134512640 135840783 4293029792 4293029152 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 305549 304787 349 325 0 304485 0
Current children cumulated CPU time (s) 942.11
Current children cumulated vsize (KiB) 1222196

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23289
/proc/meminfo: memFree=25103952/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1282964 CPUtime=1002.08 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 320557 0 0 0 100135 73 0 0 20 0 1 0 343345058 1313755136 319995 33554432000 134512640 135840783 4293029792 4293029152 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 320741 319995 349 325 0 319677 0
Current children cumulated CPU time (s) 1002.08
Current children cumulated vsize (KiB) 1282964

[startup+1062.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/178 23289
/proc/meminfo: memFree=24949104/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1373660 CPUtime=1062.06 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 343270 0 0 0 106128 78 0 0 20 0 1 0 343345058 1406627840 342677 33554432000 134512640 135840783 4293029792 4293029104 134551081 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 343415 342677 349 325 0 342351 0
Current children cumulated CPU time (s) 1062.06
Current children cumulated vsize (KiB) 1373660

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 23289
/proc/meminfo: memFree=24753216/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1458500 CPUtime=1122.05 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 364488 0 0 0 112123 82 0 0 20 0 1 0 343345058 1493504000 363871 33554432000 134512640 135840783 4293029792 4293029152 134551084 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 364625 363871 349 325 0 363561 0
Current children cumulated CPU time (s) 1122.05
Current children cumulated vsize (KiB) 1458500

[startup+1182.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/178 23289
/proc/meminfo: memFree=24539964/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1537632 CPUtime=1182.02 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 384312 0 0 0 118116 86 0 0 20 0 1 0 343345058 1574535168 383668 33554432000 134512640 135840783 4293029792 4293029152 134551312 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 384408 383668 349 325 0 383344 0
Current children cumulated CPU time (s) 1182.02
Current children cumulated vsize (KiB) 1537632

[startup+1242.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/179 23292
/proc/meminfo: memFree=24363520/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1587772 CPUtime=1241.99 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 396855 0 0 0 124111 88 0 0 20 0 1 0 343345058 1625878528 396183 33554432000 134512640 135840783 4293029792 4293029152 134551058 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 396943 396183 349 325 0 395879 0
Current children cumulated CPU time (s) 1241.99
Current children cumulated vsize (KiB) 1587772

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23293
/proc/meminfo: memFree=24199628/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1626984 CPUtime=1301.98 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 406703 0 0 0 130106 92 0 0 20 0 1 0 343345058 1666031616 406010 33554432000 134512640 135840783 4293029792 4293029152 134551312 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 406746 406010 349 325 0 405682 0
Current children cumulated CPU time (s) 1301.98
Current children cumulated vsize (KiB) 1626984

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23293
/proc/meminfo: memFree=24002620/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1673512 CPUtime=1361.95 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 418356 0 0 0 136101 94 0 0 20 0 1 0 343345058 1713676288 417636 33554432000 134512640 135840783 4293029792 4293010928 134586822 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 418378 417636 349 325 0 417314 0
Current children cumulated CPU time (s) 1361.95
Current children cumulated vsize (KiB) 1673512

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23332
/proc/meminfo: memFree=26041316/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1766176 CPUtime=1421.92 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 441556 0 0 0 142094 98 0 0 20 0 1 0 343345058 1808564224 440792 33554432000 134512640 135840783 4293029792 4293029152 134551312 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 441544 440792 349 325 0 440480 0
Current children cumulated CPU time (s) 1421.92
Current children cumulated vsize (KiB) 1766176

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23332
/proc/meminfo: memFree=25780696/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1868256 CPUtime=1481.89 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 467128 0 0 0 148085 104 0 0 20 0 1 0 343345058 1913094144 466327 33554432000 134512640 135840783 4293029792 4293029152 134551324 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 467064 466327 349 325 0 466000 0
Current children cumulated CPU time (s) 1481.89
Current children cumulated vsize (KiB) 1868256

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23332
/proc/meminfo: memFree=25583192/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1956612 CPUtime=1541.87 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 489244 0 0 0 154079 108 0 0 20 0 1 0 343345058 2003570688 488408 33554432000 134512640 135840783 4293029792 4293029152 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 489153 488408 349 325 0 488089 0
Current children cumulated CPU time (s) 1541.87
Current children cumulated vsize (KiB) 1956612

[startup+1602.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/178 23611
/proc/meminfo: memFree=25807884/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=1988760 CPUtime=1601.83 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 497321 0 0 0 160073 110 0 0 20 0 1 0 343345058 2036490240 496440 33554432000 134512640 135840783 4293029792 4293029152 134550957 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 497190 496440 349 325 0 496126 0
Current children cumulated CPU time (s) 1601.83
Current children cumulated vsize (KiB) 1988760

[startup+1662.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 23611
/proc/meminfo: memFree=25623908/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=2027452 CPUtime=1661.8 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 507031 0 0 0 166067 113 0 0 20 0 1 0 343345058 2076110848 506115 33554432000 134512640 135840783 4293029792 4293029152 134551093 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 506863 506115 349 325 0 505799 0
Current children cumulated CPU time (s) 1661.8
Current children cumulated vsize (KiB) 2027452

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23611
/proc/meminfo: memFree=25511716/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=2055488 CPUtime=1721.77 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 514065 0 0 0 172063 114 0 0 20 0 1 0 343345058 2104819712 513115 33554432000 134512640 135840783 4293029792 4293029152 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 513872 513115 349 325 0 512808 0
Current children cumulated CPU time (s) 1721.77
Current children cumulated vsize (KiB) 2055488

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23611
/proc/meminfo: memFree=25380680/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=2099856 CPUtime=1781.75 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 525165 0 0 0 178058 117 0 0 20 0 1 0 343345058 2150252544 524196 33554432000 134512640 135840783 4293029792 4293029152 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 524964 524196 349 325 0 523900 0
Current children cumulated CPU time (s) 1781.75
Current children cumulated vsize (KiB) 2099856



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23612
/proc/meminfo: memFree=25351020/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=2109472 CPUtime=1800.05 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 527597 0 0 0 179887 118 0 0 20 0 1 0 343345058 2160099328 526622 33554432000 134512640 135840783 4293029792 4293029152 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 527368 526622 349 325 0 526304 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 2109472

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23612
/proc/meminfo: memFree=25351020/32873648 swapFree=6864/6864
[pid=23277] ppid=23275 vsize=2109472 CPUtime=1800.05 cores=0,2,4,6
/proc/23277/stat : 23277 (bsolo3.0.17) R 23275 23277 20253 0 -1 4202496 527597 0 0 0 179887 118 0 0 20 0 1 0 343345058 2160099328 526622 33554432000 134512640 135840783 4293029792 4293029152 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23277/statm: 527368 526622 349 325 0 526304 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 2109472

Child status: 15
Real time (s): 1800.65
CPU time (s): 1800.11
CPU user time (s): 1798.88
CPU system time (s): 1.23181
CPU usage (%): 99.97
Max. virtual memory (cumulated for all children) (KiB): 2109472

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.88
system time used= 1.23181
maximum resident set size= 2106488
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 527600
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 491
involuntary context switches= 1970

runsolver used 3.35149 second user time and 9.13461 second system time

The end

Launcher Data 

Begin job on node113 at 2012-06-04 03:09:42
IDJOB=3742542
IDBENCH=90203
IDSOLVER=2318
FILE ID=node113/3742542-1338772182
RUNJOBID= node113-1338748314-20269
PBS_JOBID= 14636785
Free space on /tmp= 70972 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K141.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742542-1338772182/watcher-3742542-1338772182 -o /tmp/evaluation-result-3742542-1338772182/solver-3742542-1338772182 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742542-1338772182.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e981076bb5354ded6cb9b093a6d1a03e
RANDOM SEED=1354078355

node113.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27315968 kB
Buffers:          539100 kB
Cached:          3499856 kB
SwapCached:         2028 kB
Active:          2368688 kB
Inactive:        2287700 kB
Active(anon):     617008 kB
Inactive(anon):     1912 kB
Active(file):    1751680 kB
Inactive(file):  2285788 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67099708 kB
Dirty:              7776 kB
Writeback:             0 kB
AnonPages:        664900 kB
Mapped:            12544 kB
Shmem:                 0 kB
Slab:             763664 kB
SReclaimable:     207764 kB
SUnreclaim:       555900 kB
KernelStack:        1488 kB
PageTables:         4872 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     737600 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     43008 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70964 MiB
End job on node113 at 2012-06-04 03:39:45