Trace number 1774385

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
kw 2009-03-20UNSAT 362.484 362.582

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l46_lambda.cnf
MD5SUMeb4d0d02a25a8a84182ddd3b6d1fa8b5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark269.152
Satisfiable
(Un)Satisfiability was proved
Number of variables33090
Number of clauses165828
Sum of the clauses size478271
Maximum clause length9
Minimum clause length1
Number of clauses of size 14268
Number of clauses of size 241089
Number of clauses of size 397665
Number of clauses of size 415752
Number of clauses of size 56916
Number of clauses of size over 5138

Solver Data

0.00/0.00	c kw (KillerWhale) version 0.6
0.00/0.00	c Copyright 2007-2009 Johan Alfredsson, Oepir
0.00/0.00	c johan@oepir.com
362.40/362.56	c 361.64 seconds
362.40/362.56	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1774385-1241280793/watcher-1774385-1241280793 -o /tmp/evaluation-result-1774385-1241280793/solver-1774385-1241280793 -C 10000 -W 12000 -M 1800 HOME/kw HOME/instance-1774385-1241280793.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 12000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.98 0.99 3/64 26050
/proc/meminfo: memFree=1739648/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=5824 CPUtime=0
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 792 0 0 0 0 0 0 0 18 0 1 0 156112553 5963776 776 1992294400 4194304 6412682 548682068864 18446744073709551615 5487243 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 1456 780 208 541 0 906 0

[startup+0.0444299 s]
/proc/loadavg: 0.99 0.98 0.99 3/64 26050
/proc/meminfo: memFree=1739648/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=23132 CPUtime=0.03
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 4974 0 0 0 2 1 0 0 18 0 1 0 156112553 23687168 4958 1992294400 4194304 6412682 548682068864 18446744073709551615 5487243 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 5783 4958 221 541 0 5233 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23132

[startup+0.101436 s]
/proc/loadavg: 0.99 0.98 0.99 3/64 26050
/proc/meminfo: memFree=1739648/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=23792 CPUtime=0.09
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 5164 0 0 0 8 1 0 0 18 0 1 0 156112553 24363008 5148 1992294400 4194304 6412682 548682068864 18446744073709551615 5487243 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 5948 5148 221 541 0 5398 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23792

[startup+0.301459 s]
/proc/loadavg: 0.99 0.98 0.99 3/64 26050
/proc/meminfo: memFree=1739648/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=26300 CPUtime=0.29
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 5865 0 0 0 27 2 0 0 19 0 1 0 156112553 26931200 5849 1992294400 4194304 6412682 548682068864 18446744073709551615 5487243 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 6575 5849 221 541 0 6025 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26300

[startup+0.701505 s]
/proc/loadavg: 0.99 0.98 0.99 3/64 26050
/proc/meminfo: memFree=1739648/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=32276 CPUtime=0.69
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 7511 0 0 0 67 2 0 0 22 0 1 0 156112553 33050624 7495 1992294400 4194304 6412682 548682068864 18446744073709551615 5487243 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 8069 7495 221 541 0 7519 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 32276

[startup+1.50167 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 26051
/proc/meminfo: memFree=1700344/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=47332 CPUtime=1.49
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 11199 0 0 0 139 10 0 0 25 0 1 0 156112553 48467968 10989 1992294400 4194304 6412682 548682068864 18446744073709551615 5554256 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 11833 10989 248 541 0 11283 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 47332

[startup+3.10179 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 26051
/proc/meminfo: memFree=1692216/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=48592 CPUtime=3.09
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 11813 0 0 0 296 13 0 0 25 0 1 0 156112553 49758208 11344 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 12148 11344 255 541 0 11598 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 48592

[startup+6.30116 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 26051
/proc/meminfo: memFree=1692600/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=48816 CPUtime=6.28
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 11929 0 0 0 613 15 0 0 25 0 1 0 156112553 49987584 11460 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 12204 11460 258 541 0 11654 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 48816

[startup+12.7019 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 26051
/proc/meminfo: memFree=1691192/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=50112 CPUtime=12.68
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 12273 0 0 0 1250 18 0 0 25 0 1 0 156112553 51314688 11804 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 12528 11804 258 541 0 11978 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 50112

[startup+25.5014 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 26051
/proc/meminfo: memFree=1688568/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=53048 CPUtime=25.49
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 12937 0 0 0 2524 25 0 0 25 0 1 0 156112553 54321152 12468 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 13262 12468 258 541 0 12712 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 53048

[startup+51.1014 s]
/proc/loadavg: 1.07 1.00 1.00 2/65 26051
/proc/meminfo: memFree=1685176/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=56464 CPUtime=51.07
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 13815 0 0 0 5075 32 0 0 25 0 1 0 156112553 57819136 13346 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 14116 13346 258 541 0 13566 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 56464

[startup+102.305 s]
/proc/loadavg: 1.10 1.02 1.00 2/65 26051
/proc/meminfo: memFree=1675320/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=67920 CPUtime=102.26
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 16276 0 0 0 10181 45 0 0 25 0 1 0 156112553 69550080 15807 1992294400 4194304 6412682 548682068864 18446744073709551615 4286819 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 16980 15807 258 541 0 16430 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 67920

[startup+162.301 s]
/proc/loadavg: 1.11 1.03 1.00 2/65 26051
/proc/meminfo: memFree=1666360/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=78008 CPUtime=162.25
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 19093 0 0 0 16168 57 0 0 25 0 1 0 156112553 79880192 18030 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 19502 18030 258 541 0 18952 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 78008

[startup+222.301 s]
/proc/loadavg: 1.10 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1659128/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=87548 CPUtime=222.23
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 21286 0 0 0 22155 68 0 0 25 0 1 0 156112553 89649152 19858 1992294400 4194304 6412682 548682068864 18446744073709551615 4285745 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 21887 19858 258 541 0 21337 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 87548

[startup+282.301 s]
/proc/loadavg: 1.10 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1649208/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=99256 CPUtime=282.21
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 24130 0 0 0 28144 77 0 0 25 0 1 0 156112553 101638144 22282 1992294400 4194304 6412682 548682068864 18446744073709551615 4286794 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 24814 22282 258 541 0 24264 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 99256

[startup+342.301 s]
/proc/loadavg: 1.08 1.05 1.00 2/65 26051
/proc/meminfo: memFree=1642616/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=106780 CPUtime=342.2
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26245 0 0 0 34131 89 0 0 25 0 1 0 156112553 109342720 23914 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26695 23914 258 541 0 26145 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 106780

Solver just ended. Dumping a history of the last processes samples

[startup+345.502 s]
/proc/loadavg: 1.08 1.05 1.00 2/65 26051
/proc/meminfo: memFree=1642616/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=106780 CPUtime=345.39
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26255 0 0 0 34450 89 0 0 25 0 1 0 156112553 109342720 23924 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26695 23924 258 541 0 26145 0
Current children cumulated CPU time (s) 345.39
Current children cumulated vsize (KiB) 106780

[startup+351.901 s]
/proc/loadavg: 1.07 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1642360/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=106940 CPUtime=351.8
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26314 0 0 0 35090 90 0 0 25 0 1 0 156112553 109506560 23983 1992294400 4194304 6412682 548682068864 18446744073709551615 4286819 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26735 23983 258 541 0 26185 0
Current children cumulated CPU time (s) 351.8
Current children cumulated vsize (KiB) 106940

[startup+358.301 s]
/proc/loadavg: 1.07 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1641976/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=107260 CPUtime=358.19
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26407 0 0 0 35728 91 0 0 25 0 1 0 156112553 109834240 24076 1992294400 4194304 6412682 548682068864 18446744073709551615 4286778 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26815 24076 258 541 0 26265 0
Current children cumulated CPU time (s) 358.19
Current children cumulated vsize (KiB) 107260

[startup+359.901 s]
/proc/loadavg: 1.07 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1641720/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=107580 CPUtime=359.79
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26472 0 0 0 35888 91 0 0 25 0 1 0 156112553 110161920 24141 1992294400 4194304 6412682 548682068864 18446744073709551615 5550983 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26895 24141 258 541 0 26345 0
Current children cumulated CPU time (s) 359.79
Current children cumulated vsize (KiB) 107580

[startup+361.501 s]
/proc/loadavg: 1.07 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1641720/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=107580 CPUtime=361.4
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26557 0 0 0 36048 92 0 0 25 0 1 0 156112553 110161920 24226 1992294400 4194304 6412682 548682068864 18446744073709551615 4286888 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26895 24226 258 541 0 26345 0
Current children cumulated CPU time (s) 361.4
Current children cumulated vsize (KiB) 107580

[startup+362.302 s]
/proc/loadavg: 1.06 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1641336/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=107580 CPUtime=362.2
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26568 0 0 0 36128 92 0 0 25 0 1 0 156112553 110161920 24237 1992294400 4194304 6412682 548682068864 18446744073709551615 4304779 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26895 24237 258 541 0 26345 0
Current children cumulated CPU time (s) 362.2
Current children cumulated vsize (KiB) 107580

[startup+362.502 s]
/proc/loadavg: 1.06 1.04 1.00 2/65 26051
/proc/meminfo: memFree=1641336/2055920 swapFree=4180392/4192956
[pid=26050] ppid=26048 vsize=107580 CPUtime=362.4
/proc/26050/stat : 26050 (kw) R 26048 26050 25845 0 -1 0 26568 0 0 0 36148 92 0 0 25 0 1 0 156112553 110161920 24237 1992294400 4194304 6412682 548682068864 18446744073709551615 4304775 0 0 4096 0 0 0 0 17 1 0 0
/proc/26050/statm: 26895 24237 258 541 0 26345 0
Current children cumulated CPU time (s) 362.4
Current children cumulated vsize (KiB) 107580

Child status: 20
Real time (s): 362.582
CPU time (s): 362.484
CPU user time (s): 361.546
CPU system time (s): 0.937857
CPU usage (%): 99.9729
Max. virtual memory (cumulated for all children) (KiB): 107580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 361.546
system time used= 0.937857
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26575
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 898

runsolver used 0.268959 second user time and 0.795879 second system time

The end

Launcher Data

Begin job on node20 at 2009-05-02 18:13:13
IDJOB=1774385
IDBENCH=70941
IDSOLVER=611
FILE ID=node20/1774385-1241280793
PBS_JOBID= 9225034
Free space on /tmp= 66496 MiB

SOLVER NAME= kw 2009-03-20
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l46_lambda.cnf
COMMAND LINE= HOME/kw BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1774385-1241280793/watcher-1774385-1241280793 -o /tmp/evaluation-result-1774385-1241280793/solver-1774385-1241280793 -C 10000 -W 12000 -M 1800  HOME/kw HOME/instance-1774385-1241280793.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= eb4d0d02a25a8a84182ddd3b6d1fa8b5
RANDOM SEED=319931602

node20.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1740064 kB
Buffers:         74964 kB
Cached:         148964 kB
SwapCached:       6320 kB
Active:          68196 kB
Inactive:       163820 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1740064 kB
SwapTotal:     4192956 kB
SwapFree:      4180392 kB
Dirty:            5280 kB
Writeback:           0 kB
Mapped:          13520 kB
Slab:            69916 kB
Committed_AS:   789432 kB
PageTables:       1396 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66492 MiB
End job on node20 at 2009-05-02 18:19:16