Trace number 3741628

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.11 1800.74

General information on the benchmark

Name/OPT-BIGINT-LIN/
heinz/normalized-air04.opb
MD5SUMbe0d50f47077f17e0f3c28ea78925374
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark71079
Best CPU time to get the best result obtained on this benchmark1800.09
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables8904
Total number of constraints823
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)823
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint368
Number of terms in the objective function 8904
Biggest coefficient in the objective function 2258
Number of bits for the biggest coefficient in the objective function 12
Sum of the numbers in the objective function 5135151
Number of bits of the sum of numbers in the objective function 23
Biggest number in a constraint 2258
Number of bits of the biggest number in a constraint 12
Biggest sum of numbers in a constraint 5135151
Number of bits of the biggest sum of numbers23
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741628-1338761218.opb
0.00/0.00	c File size is 749943 bytes.
0.00/0.01	c Coefficients are big enough for not using lower bounding.
0.04/0.07	c Highest Coefficient sum: 5.13515e+06
0.04/0.07	c Parsing was ok!!
0.04/0.07	c Total parsing time: 0.068 s
0.04/0.07	c Var: 8904 Constr: 1646 825/821/0 Lit: 145930 Watch. Lit: 74611
0.04/0.07	c Obj. Vars: 8904 (100 % of total variables)
0.89/0.94	c Pre-processing Time: 0.942 s
1800.07/1800.71	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1800.07/1800.71	c        0   7518     1231   112692   91    58122  514511      0      0 0.94
1800.07/1800.71	c      100   7518     1331   120212   90    58322  565963    100    101 0.98
1800.07/1800.71	c      251   7518     1482   131512   88    58624  622560    251    244 1.02
1800.07/1800.71	c      476   7517     1707   149763   87    59073  684817    476    436 1.09
1800.07/1800.71	c      814   7516     2045   171059   83    59748  753299    814    695 1.17
1800.07/1800.71	c     1322   7516     2553   204443   80    60764  828629   1322    987 1.34
1800.07/1800.71	c     2087   7516     3318   260466   78    62294  911492   2087   1334 1.56
1800.07/1800.71	c     3233   7515     4464   375887   84    64585  500000   3233   1693 1.91
1800.07/1800.71	c     4954   7513     6185   539104   87    68025  550001   4954   2046 2.42
1800.07/1800.71	c     7539   7512     8770   866021   98    73194  605002   7539   2233 3.38
1800.07/1800.71	c    11418   7512    12649  1709449  135    80952  665503  11418   2069 5.52
1800.07/1800.71	c    17240   7512    18471  3051914  165    92596  732054  17240   1676 10.28
1800.07/1800.71	c    25977   7509    27208  4937161  181   110067  805260  25977   1308 19.86
1800.07/1800.71	c    39087   7507    40318  7140960  177   136285  885787  39087   1128 34.65
1800.07/1800.71	c    58757   7501    59988 11023422  183   175619  974366  58757    874 67.21
1800.07/1800.71	c    88267   7500    89498 17888868  199   234638  500000  88267    531 166.01
1800.07/1800.71	c   132537   7491   133768 29456022  220   323169  550001 132537    343 385.78
1800.07/1800.71	c   198947   7490   200178 54078193  270   455988  605002 198947    224 884.63
1800.07/1800.71	c Caught signal: 15
1800.07/1800.71	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.07/1800.71	c   17   281979 169570  6378744   283210 94653615 281979    156 1800.09
1800.07/1800.71	s UNKNOWN
1800.07/1800.71	c Total time: 1800.09 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741628-1338761218/watcher-3741628-1338761218 -o /tmp/evaluation-result-3741628-1338761218/solver-3741628-1338761218 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741628-1338761218.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.99 1.99 3/175 7528
/proc/meminfo: memFree=25511672/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=13244 CPUtime=0 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 488 0 0 0 0 0 0 0 20 0 1 0 342247231 13561856 425 33554432000 134512640 135840783 4287725216 4287723936 2319655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 3311 425 330 325 0 2063 0

[startup+0.0503829 s]
/proc/loadavg: 1.92 1.99 1.99 3/175 7528
/proc/meminfo: memFree=25511672/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=7200 CPUtime=0.04 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 1056 0 0 0 4 0 0 0 20 0 1 0 342247231 7372800 993 33554432000 134512640 135840783 4287725216 4287724208 134525286 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 1800 993 451 325 0 552 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 7200

[startup+0.100246 s]
/proc/loadavg: 1.92 1.99 1.99 3/175 7528
/proc/meminfo: memFree=25511672/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=9556 CPUtime=0.09 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 1889 0 0 0 9 0 0 0 20 0 1 0 342247231 9785344 1642 33554432000 134512640 135840783 4287725216 4287617484 5379120 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 2389 1642 343 325 0 1325 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9556

[startup+0.300228 s]
/proc/loadavg: 1.92 1.99 1.99 3/175 7528
/proc/meminfo: memFree=25511672/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=9556 CPUtime=0.29 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 1891 0 0 0 29 0 0 0 20 0 1 0 342247231 9785344 1644 33554432000 134512640 135840783 4287725216 4287617484 5379120 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 2389 1644 343 325 0 1325 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9556

[startup+0.700228 s]
/proc/loadavg: 1.92 1.99 1.99 3/175 7528
/proc/meminfo: memFree=25511672/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=9556 CPUtime=0.69 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 1891 0 0 0 69 0 0 0 20 0 1 0 342247231 9785344 1644 33554432000 134512640 135840783 4287725216 4287617484 5379120 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 2389 1644 343 325 0 1325 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 9556

[startup+1.50024 s]
/proc/loadavg: 1.92 1.99 1.99 3/176 7529
/proc/meminfo: memFree=25503712/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=10564 CPUtime=1.49 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 2457 0 0 0 149 0 0 0 20 0 1 0 342247231 10817536 1897 33554432000 134512640 135840783 4287725216 4287723552 134545942 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 2641 1897 348 325 0 1577 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 10564

[startup+3.10023 s]
/proc/loadavg: 1.93 1.99 1.99 3/176 7529
/proc/meminfo: memFree=25497760/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=17840 CPUtime=3.08 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 4274 0 0 0 308 0 0 0 20 0 1 0 342247231 18268160 3714 33554432000 134512640 135840783 4287725216 4287724512 134573166 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 4460 3714 348 325 0 3396 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 17840

[startup+6.30032 s]
/proc/loadavg: 1.93 1.99 1.99 3/177 7530
/proc/meminfo: memFree=25473556/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=32928 CPUtime=6.28 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 8060 0 0 0 627 1 0 0 20 0 1 0 342247231 33718272 7500 33554432000 134512640 135840783 4287725216 4287724576 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 8232 7500 348 325 0 7168 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 32928

[startup+12.7003 s]
/proc/loadavg: 1.93 1.99 1.99 3/177 7530
/proc/meminfo: memFree=25438372/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=55568 CPUtime=12.69 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 13716 0 0 0 1266 3 0 0 20 0 1 0 342247231 56901632 13156 33554432000 134512640 135840783 4287725216 4287724576 134550863 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 13892 13156 348 325 0 12828 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 55568

[startup+25.5003 s]
/proc/loadavg: 1.95 1.99 1.99 3/177 7530
/proc/meminfo: memFree=25341504/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=83688 CPUtime=25.48 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 20745 0 0 0 2544 4 0 0 20 0 1 0 342247231 85696512 20185 33554432000 134512640 135840783 4287725216 4287724576 134551294 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 20922 20185 348 325 0 19858 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 83688

[startup+51.1003 s]
/proc/loadavg: 1.96 1.99 1.99 3/177 7530
/proc/meminfo: memFree=25196764/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=126192 CPUtime=51.08 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 31380 0 0 0 5101 7 0 0 20 0 1 0 342247231 129220608 30820 33554432000 134512640 135840783 4287725216 4287724516 2325061 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 31548 30820 348 325 0 30484 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 126192

[startup+102.307 s]
/proc/loadavg: 1.98 1.99 1.99 3/176 7530
/proc/meminfo: memFree=25101832/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=190084 CPUtime=102.28 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 47351 0 0 0 10215 13 0 0 20 0 1 0 342247231 194646016 46791 33554432000 134512640 135840783 4287725216 4287724688 134552407 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 47521 46791 348 325 0 46457 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 190084

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7531
/proc/meminfo: memFree=25033032/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=242120 CPUtime=162.26 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 60351 0 0 0 16208 18 0 0 20 0 1 0 342247231 247930880 59791 33554432000 134512640 135840783 4287725216 4287724576 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 60530 59791 348 325 0 59466 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 242120

[startup+222.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/178 7534
/proc/meminfo: memFree=24975020/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=289024 CPUtime=222.25 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 72100 0 0 0 22201 24 0 0 20 0 1 0 342247231 295960576 71540 33554432000 134512640 135840783 4287725216 4287724576 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 72256 71540 348 325 0 71192 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 289024

[startup+282.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7534
/proc/meminfo: memFree=24917520/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=339516 CPUtime=282.24 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 84720 0 0 0 28195 29 0 0 20 0 1 0 342247231 347664384 84160 33554432000 134512640 135840783 4287725216 4287724528 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 84879 84160 348 325 0 83815 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 339516

[startup+342.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7535
/proc/meminfo: memFree=24864848/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=373252 CPUtime=342.24 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 93129 0 0 0 34191 33 0 0 20 0 1 0 342247231 382210048 92569 33554432000 134512640 135840783 4287725216 4287724352 2317214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 93313 92569 348 325 0 92249 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 373252

[startup+402.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7535
/proc/meminfo: memFree=24812424/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=407144 CPUtime=402.22 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 101626 0 0 0 40184 38 0 0 20 0 1 0 342247231 416915456 101066 33554432000 134512640 135840783 4287725216 4287724576 134551324 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 101786 101066 348 325 0 100722 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 407144

[startup+462.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7535
/proc/meminfo: memFree=24743012/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=462216 CPUtime=462.19 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 115408 0 0 0 46175 44 0 0 20 0 1 0 342247231 473309184 114824 33554432000 134512640 135840783 4287725216 4287724576 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 115554 114824 348 325 0 114490 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 462216

[startup+522.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7535
/proc/meminfo: memFree=24674344/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=517964 CPUtime=522.15 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 129395 0 0 0 52167 48 0 0 20 0 1 0 342247231 530395136 128763 33554432000 134512640 135840783 4287725216 4287724576 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 129491 128763 348 325 0 128427 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 517964

[startup+582.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/177 7535
/proc/meminfo: memFree=24583852/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=562616 CPUtime=582.09 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 140625 0 0 0 58158 51 0 0 20 0 1 0 342247231 576118784 139945 33554432000 134512640 135840783 4287725216 4287724576 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 140654 139945 348 325 0 139590 0
Current children cumulated CPU time (s) 582.09
Current children cumulated vsize (KiB) 562616

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 7539
/proc/meminfo: memFree=24281068/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=716148 CPUtime=881.88 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 179184 0 0 0 88121 67 0 0 20 0 1 0 342247231 733335552 178311 33554432000 134512640 135840783 4287725216 4287724576 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 179037 178311 348 325 0 177973 0
Current children cumulated CPU time (s) 881.88
Current children cumulated vsize (KiB) 716148

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7540
/proc/meminfo: memFree=24231220/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=739892 CPUtime=941.87 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 185118 0 0 0 94117 70 0 0 20 0 1 0 342247231 757649408 184245 33554432000 134512640 135840783 4287725216 4287724576 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 184973 184245 348 325 0 183909 0
Current children cumulated CPU time (s) 941.87
Current children cumulated vsize (KiB) 739892

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7540
/proc/meminfo: memFree=24180752/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=769468 CPUtime=1001.86 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 192530 0 0 0 100113 73 0 0 20 0 1 0 342247231 787935232 191657 33554432000 134512640 135840783 4287725216 4287724576 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 192367 191657 348 325 0 191303 0
Current children cumulated CPU time (s) 1001.86
Current children cumulated vsize (KiB) 769468

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7540
/proc/meminfo: memFree=24136732/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=800492 CPUtime=1061.86 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 200268 0 0 0 106110 76 0 0 20 0 1 0 342247231 819703808 199395 33554432000 134512640 135840783 4287725216 4287724576 134550913 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 200123 199395 348 325 0 199059 0
Current children cumulated CPU time (s) 1061.86
Current children cumulated vsize (KiB) 800492

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7540
/proc/meminfo: memFree=24104244/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=825032 CPUtime=1121.85 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 206390 0 0 0 112106 79 0 0 20 0 1 0 342247231 844832768 205517 33554432000 134512640 135840783 4287725216 4287724528 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 206258 205517 348 325 0 205194 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 825032

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7540
/proc/meminfo: memFree=24063200/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=849120 CPUtime=1181.84 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 212444 0 0 0 118101 83 0 0 20 0 1 0 342247231 869498880 211571 33554432000 134512640 135840783 4287725216 4287724576 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 212280 211571 348 325 0 211216 0
Current children cumulated CPU time (s) 1181.84
Current children cumulated vsize (KiB) 849120

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7580
/proc/meminfo: memFree=26049600/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=884820 CPUtime=1241.83 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 221345 0 0 0 124097 86 0 0 20 0 1 0 342247231 906055680 220472 33554432000 134512640 135840783 4287725216 4287724576 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 221205 220472 348 325 0 220141 0
Current children cumulated CPU time (s) 1241.83
Current children cumulated vsize (KiB) 884820

[startup+1302.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 7580
/proc/meminfo: memFree=26014012/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=920200 CPUtime=1301.82 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 230214 0 0 0 130094 88 0 0 20 0 1 0 342247231 942284800 229341 33554432000 134512640 135840783 4287725216 4287724576 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 230050 229341 348 325 0 228986 0
Current children cumulated CPU time (s) 1301.82
Current children cumulated vsize (KiB) 920200

[startup+1362.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 7580
/proc/meminfo: memFree=25950028/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=984376 CPUtime=1361.81 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 246257 0 0 0 136088 93 0 0 20 0 1 0 342247231 1008001024 245384 33554432000 134512640 135840783 4287725216 4287724576 134551071 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 246094 245384 348 325 0 245030 0
Current children cumulated CPU time (s) 1361.81
Current children cumulated vsize (KiB) 984376

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7583
/proc/meminfo: memFree=25878100/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1057140 CPUtime=1421.81 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 264431 0 0 0 142083 98 0 0 20 0 1 0 342247231 1082511360 263558 33554432000 134512640 135840783 4287725216 4287724576 134550808 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 264285 263558 348 325 0 263221 0
Current children cumulated CPU time (s) 1421.81
Current children cumulated vsize (KiB) 1057140

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7583
/proc/meminfo: memFree=25840660/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1094660 CPUtime=1481.79 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 273810 0 0 0 148078 101 0 0 20 0 1 0 342247231 1120931840 272937 33554432000 134512640 135840783 4287725216 4287724528 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 273665 272937 348 325 0 272601 0
Current children cumulated CPU time (s) 1481.79
Current children cumulated vsize (KiB) 1094660

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7584
/proc/meminfo: memFree=25803956/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1127900 CPUtime=1541.78 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 282129 0 0 0 154073 105 0 0 20 0 1 0 342247231 1154969600 281256 33554432000 134512640 135840783 4287725216 4287724576 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 281975 281256 348 325 0 280911 0
Current children cumulated CPU time (s) 1541.78
Current children cumulated vsize (KiB) 1127900

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7584
/proc/meminfo: memFree=25632340/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1167416 CPUtime=1601.77 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 292000 0 0 0 160069 108 0 0 20 0 1 0 342247231 1195433984 291127 33554432000 134512640 135840783 4287725216 4287724576 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 291854 291127 348 325 0 290790 0
Current children cumulated CPU time (s) 1601.77
Current children cumulated vsize (KiB) 1167416

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 7584
/proc/meminfo: memFree=25480748/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1194732 CPUtime=1661.74 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 298861 0 0 0 166064 110 0 0 20 0 1 0 342247231 1223405568 297958 33554432000 134512640 135840783 4287725216 4287724576 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 298683 297958 348 325 0 297619 0
Current children cumulated CPU time (s) 1661.74
Current children cumulated vsize (KiB) 1194732

[startup+1722.3 s]
/proc/loadavg: 2.10 2.04 2.01 3/177 7584
/proc/meminfo: memFree=25380956/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1216372 CPUtime=1721.71 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 304311 0 0 0 172058 113 0 0 20 0 1 0 342247231 1245564928 303363 33554432000 134512640 135840783 4287725216 4287724576 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 304093 303363 348 325 0 303029 0
Current children cumulated CPU time (s) 1721.71
Current children cumulated vsize (KiB) 1216372

[startup+1782.3 s]
/proc/loadavg: 2.07 2.04 2.01 3/177 7584
/proc/meminfo: memFree=25309684/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1235740 CPUtime=1781.68 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 309203 0 0 0 178052 116 0 0 20 0 1 0 342247231 1265397760 308226 33554432000 134512640 135840783 4287725216 4287724576 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 308935 308226 348 325 0 307871 0
Current children cumulated CPU time (s) 1781.68
Current children cumulated vsize (KiB) 1235740



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 2.12 2.05 2.01 3/177 7584
/proc/meminfo: memFree=25283984/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1242212 CPUtime=1800.07 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 310830 0 0 0 179891 116 0 0 20 0 1 0 342247231 1272025088 309844 33554432000 134512640 135840783 4287725216 4287724576 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 310553 309844 348 325 0 309489 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 1242212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.71 s]
/proc/loadavg: 2.12 2.05 2.01 3/177 7584
/proc/meminfo: memFree=25283984/32873844 swapFree=7384/7384
[pid=7528] ppid=7526 vsize=1242212 CPUtime=1800.07 cores=1,3,5,7
/proc/7528/stat : 7528 (bsolo3.0.17) R 7526 7528 5940 0 -1 4202496 310830 0 0 0 179891 116 0 0 20 0 1 0 342247231 1272025088 309844 33554432000 134512640 135840783 4287725216 4287724576 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7528/statm: 310553 309844 348 325 0 309489 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 1242212

Child status: 15
Real time (s): 1800.74
CPU time (s): 1800.11
CPU user time (s): 1798.92
CPU system time (s): 1.19082
CPU usage (%): 99.9652
Max. virtual memory (cumulated for all children) (KiB): 1242212

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.92
system time used= 1.19082
maximum resident set size= 1239376
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 310833
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 449
involuntary context switches= 1839

runsolver used 3.2605 second user time and 10.2454 second system time

The end

Launcher Data 

Begin job on node136 at 2012-06-04 00:06:58
IDJOB=3741628
IDBENCH=89888
IDSOLVER=2318
FILE ID=node136/3741628-1338761218
RUNJOBID= node136-1338749655-5957
PBS_JOBID= 14636804
Free space on /tmp= 69616 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/OPT-BIGINT-LIN/heinz/normalized-air04.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741628-1338761218/watcher-3741628-1338761218 -o /tmp/evaluation-result-3741628-1338761218/solver-3741628-1338761218 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741628-1338761218.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= be0d50f47077f17e0f3c28ea78925374
RANDOM SEED=1277355404

node136.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        25511564 kB
Buffers:         1273820 kB
Cached:          3803820 kB
SwapCached:        20316 kB
Active:          4278492 kB
Inactive:        2176088 kB
Active(anon):    1349292 kB
Inactive(anon):    22308 kB
Active(file):    2929200 kB
Inactive(file):  2153780 kB
Unevictable:        7384 kB
Mlocked:            7384 kB
SwapTotal:      67108856 kB
SwapFree:       67083208 kB
Dirty:              7312 kB
Writeback:             0 kB
AnonPages:       1360844 kB
Mapped:            10948 kB
Shmem:                 0 kB
Slab:             763824 kB
SReclaimable:     204940 kB
SUnreclaim:       558884 kB
KernelStack:        1440 kB
PageTables:         6596 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1476016 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    954368 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69772 MiB
End job on node136 at 2012-06-04 00:37:01