Trace number 1724139

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT hrpUNSAT 332.651 332.751

General information on the benchmark

Namesimon-s03-fifo8-300.cnf
MD5SUMbc88ff447c824a634465ac9483a47d5c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark28.2557
Satisfiable
(Un)Satisfiability was proved
Number of variables194762
Number of clauses530713
Sum of the clauses size1200865
Maximum clause length11
Minimum clause length1
Number of clauses of size 14539
Number of clauses of size 2407666
Number of clauses of size 3101726
Number of clauses of size 413487
Number of clauses of size 51199
Number of clauses of size over 52096

Solver Data

332.60/332.73	c Solved by Filtered 
332.60/332.73	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1724139-1240692867/watcher-1724139-1240692867 -o /tmp/evaluation-result-1724139-1240692867/solver-1724139-1240692867 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/SApperloT-hrp -seed=1399076589 HOME/instance-1724139-1240692867.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 18514
/proc/meminfo: memFree=1864664/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=7636 CPUtime=0
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 916 0 0 0 0 0 0 0 18 0 1 0 97319147 7819264 901 1992294400 134512640 135712473 4294956208 18446744073709551615 134547530 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 1909 906 92 292 0 1614 0

[startup+0.08768 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 18514
/proc/meminfo: memFree=1864664/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=13852 CPUtime=0.07
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 2660 0 0 0 7 0 0 0 18 0 1 0 97319147 14184448 2644 1992294400 134512640 135712473 4294956208 18446744073709551615 135148566 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 3463 2645 97 292 0 3168 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 13852

[startup+0.101683 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 18514
/proc/meminfo: memFree=1864664/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=14248 CPUtime=0.1
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 2757 0 0 0 9 1 0 0 18 0 1 0 97319147 14589952 2741 1992294400 134512640 135712473 4294956208 18446744073709551615 135148566 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 3562 2741 97 292 0 3267 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 14248

[startup+0.301706 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 18514
/proc/meminfo: memFree=1864664/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=18604 CPUtime=0.29
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 3942 0 0 0 28 1 0 0 19 0 1 0 97319147 19050496 3926 1992294400 134512640 135712473 4294956208 18446744073709551615 135148566 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 4651 3926 97 292 0 4356 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 18604

[startup+0.701754 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 18514
/proc/meminfo: memFree=1864664/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=26548 CPUtime=0.69
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 5988 0 0 0 67 2 0 0 23 0 1 0 97319147 27185152 5972 1992294400 134512640 135712473 4294956208 18446744073709551615 135208030 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 6637 5973 97 292 0 6342 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 26548

[startup+1.50185 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1832976/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=35216 CPUtime=1.49
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 8237 0 0 0 146 3 0 0 25 0 1 0 97319147 36061184 8122 1992294400 134512640 135712473 4294956208 18446744073709551615 134563915 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 8804 8122 105 292 0 8509 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 35216

[startup+3.10104 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1832592/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=35728 CPUtime=3.08
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 8420 0 0 0 305 3 0 0 25 0 1 0 97319147 36585472 8176 1992294400 134512640 135712473 4294956208 18446744073709551615 134568111 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 8932 8176 105 292 0 8637 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 35728

[startup+6.30141 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1832144/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=36272 CPUtime=6.29
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 8581 0 0 0 625 4 0 0 25 0 1 0 97319147 37142528 8337 1992294400 134512640 135712473 4294956208 18446744073709551615 134611929 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 9068 8337 106 292 0 8773 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 36272

[startup+12.7012 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1830928/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=37460 CPUtime=12.69
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 8886 0 0 0 1265 4 0 0 25 0 1 0 97319147 38359040 8642 1992294400 134512640 135712473 4294956208 18446744073709551615 134563915 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 9365 8642 109 292 0 9070 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 37460

[startup+25.5017 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1829200/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=39144 CPUtime=25.48
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 9304 0 0 0 2544 4 0 0 25 0 1 0 97319147 40083456 9060 1992294400 134512640 135712473 4294956208 18446744073709551615 134538708 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 9786 9060 109 292 0 9491 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 39144

[startup+51.1017 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1823952/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=44392 CPUtime=51.07
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 10627 0 0 0 5101 6 0 0 25 0 1 0 97319147 45457408 10383 1992294400 134512640 135712473 4294956208 18446744073709551615 135148566 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 11098 10383 109 292 0 10803 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 44392

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1816912/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=51508 CPUtime=102.27
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 12359 0 0 0 10219 8 0 0 25 0 1 0 97319147 52744192 12115 1992294400 134512640 135712473 4294956208 18446744073709551615 134564314 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 12877 12115 110 292 0 12582 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 51508

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1809424/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=58776 CPUtime=162.24
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 14220 0 0 0 16215 9 0 0 25 0 1 0 97319147 60186624 13976 1992294400 134512640 135712473 4294956208 18446744073709551615 134564193 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 14694 13976 110 292 0 14399 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 58776

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1803344/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=65384 CPUtime=222.23
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 15864 0 0 0 22212 11 0 0 25 0 1 0 97319147 66953216 15491 1992294400 134512640 135712473 4294956208 18446744073709551615 134564193 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 16346 15491 110 292 0 16051 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 65384

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1796560/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=72132 CPUtime=282.21
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 17597 0 0 0 28208 13 0 0 25 0 1 0 97319147 73863168 17224 1992294400 134512640 135712473 4294956208 18446744073709551615 134564193 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 18033 17224 110 292 0 17738 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 72132

Solver just ended. Dumping a history of the last processes samples

[startup+307.102 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1793680/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=74796 CPUtime=307
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18284 0 0 0 30686 14 0 0 25 0 1 0 97319147 76591104 17911 1992294400 134512640 135712473 4294956208 18446744073709551615 134564193 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 18699 17911 110 292 0 18404 0
Current children cumulated CPU time (s) 307
Current children cumulated vsize (KiB) 74796

[startup+319.901 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1793104/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=75456 CPUtime=319.79
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18449 0 0 0 31965 14 0 0 25 0 1 0 97319147 77266944 18076 1992294400 134512640 135712473 4294956208 18446744073709551615 134563915 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 18864 18076 110 292 0 18569 0
Current children cumulated CPU time (s) 319.79
Current children cumulated vsize (KiB) 75456

[startup+326.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1792464/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=75988 CPUtime=326.2
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18581 0 0 0 32605 15 0 0 25 0 1 0 97319147 77811712 18208 1992294400 134512640 135712473 4294956208 18446744073709551615 134564193 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 18997 18208 110 292 0 18702 0
Current children cumulated CPU time (s) 326.2
Current children cumulated vsize (KiB) 75988

[startup+329.502 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1792144/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=76384 CPUtime=329.4
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18655 0 0 0 32925 15 0 0 25 0 1 0 97319147 78217216 18282 1992294400 134512640 135712473 4294956208 18446744073709551615 134564153 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 19096 18282 110 292 0 18801 0
Current children cumulated CPU time (s) 329.4
Current children cumulated vsize (KiB) 76384

[startup+331.106 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1792016/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=76384 CPUtime=331
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18678 0 0 0 33085 15 0 0 25 0 1 0 97319147 78217216 18305 1992294400 134512640 135712473 4294956208 18446744073709551615 134564153 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 19096 18305 110 292 0 18801 0
Current children cumulated CPU time (s) 331
Current children cumulated vsize (KiB) 76384

[startup+331.902 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1792016/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=76384 CPUtime=331.8
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18678 0 0 0 33165 15 0 0 25 0 1 0 97319147 78217216 18305 1992294400 134512640 135712473 4294956208 18446744073709551615 134563915 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 19096 18305 110 292 0 18801 0
Current children cumulated CPU time (s) 331.8
Current children cumulated vsize (KiB) 76384

[startup+332.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1792016/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=76384 CPUtime=332.2
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18679 0 0 0 33205 15 0 0 25 0 1 0 97319147 78217216 18306 1992294400 134512640 135712473 4294956208 18446744073709551615 134564822 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 19096 18306 110 292 0 18801 0
Current children cumulated CPU time (s) 332.2
Current children cumulated vsize (KiB) 76384

[startup+332.702 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18515
/proc/meminfo: memFree=1792016/2055920 swapFree=4180664/4192956
[pid=18514] ppid=18512 vsize=76384 CPUtime=332.6
/proc/18514/stat : 18514 (SApperloT-hrp) R 18512 18514 18357 0 -1 4194304 18679 0 0 0 33245 15 0 0 25 0 1 0 97319147 78217216 18306 1992294400 134512640 135712473 4294956208 18446744073709551615 134576016 0 0 4096 0 0 0 0 17 0 0 0
/proc/18514/statm: 19096 18306 110 292 0 18801 0
Current children cumulated CPU time (s) 332.6
Current children cumulated vsize (KiB) 76384

Child status: 0
Real time (s): 332.751
CPU time (s): 332.651
CPU user time (s): 332.489
CPU system time (s): 0.161975
CPU usage (%): 99.97
Max. virtual memory (cumulated for all children) (KiB): 76384

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 332.489
system time used= 0.161975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18701
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 692

runsolver used 0.272958 second user time and 0.944856 second system time

The end

Launcher Data

Begin job on node73 at 2009-04-25 22:54:28
IDJOB=1724139
IDBENCH=71758
IDSOLVER=510
FILE ID=node73/1724139-1240692867
PBS_JOBID= 9186715
Free space on /tmp= 66304 MiB

SOLVER NAME= SApperloT hrp
BENCH NAME= SAT_RACE06/simon-s03-fifo8-300.cnf
COMMAND LINE= HOME/SApperloT-hrp -seed=RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1724139-1240692867/watcher-1724139-1240692867 -o /tmp/evaluation-result-1724139-1240692867/solver-1724139-1240692867 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/SApperloT-hrp -seed=1399076589 HOME/instance-1724139-1240692867.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= bc88ff447c824a634465ac9483a47d5c
RANDOM SEED=1399076589

node73.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1865144 kB
Buffers:         12008 kB
Cached:         126360 kB
SwapCached:       5860 kB
Active:          33408 kB
Inactive:       113136 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1865144 kB
SwapTotal:     4192956 kB
SwapFree:      4180664 kB
Dirty:           10668 kB
Writeback:           0 kB
Mapped:          13888 kB
Slab:            30236 kB
Committed_AS:   395956 kB
PageTables:       1396 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66304 MiB
End job on node73 at 2009-04-25 23:00:01