Trace number 1724299

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ManySAT 1.1 aimd 1/2009-03-20UNSAT 20.2469 12.9349

General information on the benchmark

Namemanol-pipe-g7nidw.cnf
MD5SUMa0303c742e981cc0d4711ad3ac66f146
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark6.89895
Satisfiable
(Un)Satisfiability was proved
Number of variables75496
Number of clauses222379
Sum of the clauses size518883
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2148252
Number of clauses of size 374126
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.18/0.21	c ==============================================================================
0.18/0.21	c |           |     ORIGINAL     |              LEARNT              |          |
0.18/0.21	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.18/0.21	c ==============================================================================
0.18/0.21	c |         0 |  222378   518882 |   66713       0        0     nan |  0.000 % |
1.39/1.47	c |         0 |   95236   376800 |      --       0       --      -- |     --   | -127140/-142077
1.39/1.48	c ==============================================================================
1.39/1.48	c Result  :   #vars: 12806   #clauses: 95236   #literals: 376800
1.39/1.48	c CPU time:   1.40379 s
1.39/1.48	c ==============================================================================
20.17/12.92	c This is ManySAT 1.1 : 2 thread(s) on 2 core(s).
20.17/12.92	c ============================[ Problem Statistics ]=============================
20.17/12.92	c |                                                                             |
20.17/12.92	c threadId              : 1
20.17/12.92	c restarts              : 863
20.17/12.92	c conflicts             : 89344          (4992 /sec)
20.17/12.92	c decisions             : 419602         (1.79 % random) (23446 /sec)
20.17/12.92	c propagations          : 9335582        (521649 /sec)
20.17/12.92	c conflict literals     : 1584256        (38.65 % deleted)
20.17/12.92	c Memory used           : 41.48 MB
20.17/12.92	c CPU time              : 17.8963 s
20.17/12.92	
20.17/12.92	c --->m=2, e=8, aimd=1, HOME/20257_many.cnf	time: 8.94814	conflicts: 89344        
20.17/12.92	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1724299-1240694394/watcher-1724299-1240694394 -o /tmp/evaluation-result-1724299-1240694394/solver-1724299-1240694394 -C 1200 -W 1800 -M 1800 --output-limit 1,15 manysat.sh HOME/instance-1724299-1240694394.cnf aimd 1 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 20257
/proc/meminfo: memFree=1592504/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=0
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 286 0 0 0 0 0 0 0 18 0 1 0 97472784 5484544 235 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 235 195 169 0 50 0
[pid=20258] ppid=20257 vsize=956 CPUtime=0
/proc/20258/stat : 20258 (SatElite) R 20257 20257 20097 0 -1 4194304 153 0 0 0 0 0 0 0 19 0 1 0 97472784 978944 137 1992294400 134512640 135034092 4294956096 18446744073709551615 134673244 0 0 4096 3 0 0 0 17 0 0 0
/proc/20258/statm: 239 144 50 127 0 109 0

[startup+0.0149489 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 20257
/proc/meminfo: memFree=1592504/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=0
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 286 0 0 0 0 0 0 0 18 0 1 0 97472784 5484544 235 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 235 195 169 0 50 0
[pid=20258] ppid=20257 vsize=2608 CPUtime=0
/proc/20258/stat : 20258 (SatElite) R 20257 20257 20097 0 -1 4194304 523 0 0 0 0 0 0 0 19 0 1 0 97472784 2670592 507 1992294400 134512640 135034092 4294956096 18446744073709551615 134545186 0 0 4096 3 0 0 0 17 0 0 0
/proc/20258/statm: 652 507 50 127 0 522 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 7964

[startup+0.101966 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 20257
/proc/meminfo: memFree=1592504/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=0
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 286 0 0 0 0 0 0 0 18 0 1 0 97472784 5484544 235 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 235 195 169 0 50 0
[pid=20258] ppid=20257 vsize=16136 CPUtime=0.09
/proc/20258/stat : 20258 (SatElite) R 20257 20257 20097 0 -1 4194304 3435 0 0 0 7 2 0 0 19 0 1 0 97472784 16523264 3419 1992294400 134512640 135034092 4294956096 18446744073709551615 134691005 0 0 4096 3 0 0 0 17 0 0 0
/proc/20258/statm: 4034 3422 50 127 0 3904 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 21492

[startup+0.302003 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 20257
/proc/meminfo: memFree=1592504/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=0
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 286 0 0 0 0 0 0 0 18 0 1 0 97472784 5484544 235 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 235 195 169 0 50 0
[pid=20258] ppid=20257 vsize=37284 CPUtime=0.29
/proc/20258/stat : 20258 (SatElite) R 20257 20257 20097 0 -1 4194304 8353 0 0 0 25 4 0 0 21 0 1 0 97472784 38178816 7684 1992294400 134512640 135034092 4294956096 18446744073709551615 134658161 0 0 4096 3 0 0 0 17 0 0 0
/proc/20258/statm: 9321 7684 68 127 0 9191 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 42640

[startup+0.701081 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 20257
/proc/meminfo: memFree=1592504/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=0
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 286 0 0 0 0 0 0 0 18 0 1 0 97472784 5484544 235 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 235 195 169 0 50 0
[pid=20258] ppid=20257 vsize=39324 CPUtime=0.69
/proc/20258/stat : 20258 (SatElite) R 20257 20257 20097 0 -1 4194304 8820 0 0 0 63 6 0 0 24 0 1 0 97472784 40267776 8151 1992294400 134512640 135034092 4294956096 18446744073709551615 134673244 0 0 4096 3 0 0 0 17 0 0 0
/proc/20258/statm: 9831 8151 68 127 0 9701 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 44680

[startup+1.50224 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 20259
/proc/meminfo: memFree=1553000/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=0
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 286 0 0 0 0 0 0 0 18 0 1 0 97472784 5484544 235 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 235 195 169 0 50 0
[pid=20258] ppid=20257 vsize=40384 CPUtime=1.49
/proc/20258/stat : 20258 (SatElite) R 20257 20257 20097 0 -1 4194304 10036 0 0 0 142 7 0 0 25 0 1 0 97472784 41353216 8502 1992294400 134512640 135034092 4294956096 18446744073709551615 134765087 0 0 4096 3 0 0 0 17 0 0 0
/proc/20258/statm: 10096 8502 68 127 0 9966 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 45740

[startup+3.10137 s]
/proc/loadavg: 1.00 1.00 1.00 3/67 20261
/proc/meminfo: memFree=1566112/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=1.62
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 312 10039 0 0 0 0 154 8 16 0 1 0 97472784 5484544 238 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 238 195 169 0 50 0
[pid=20260] ppid=20257 vsize=30496 CPUtime=2.24
/proc/20260/stat : 20260 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194304 4679 0 0 0 213 11 0 0 17 0 2 0 97472948 31227904 4665 1992294400 134512640 135305190 4294956144 18446744073709551615 134543899 0 0 4096 3 18446744073709551615 0 0 17 1 0 0
/proc/20260/statm: 7624 4665 83 193 0 7428 0
[pid=20260/tid=20261] ppid=20257 vsize=30496 CPUtime=1.23
/proc/20260/task/20261/stat : 20261 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194368 604 0 0 0 119 4 0 0 16 0 2 0 97472962 31227904 4665 1992294400 134512640 135305190 4294956144 18446744073709551615 134528292 0 0 4096 3 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3.86
Current children cumulated vsize (KiB) 35852

[startup+6.302 s]
/proc/loadavg: 1.24 1.05 1.02 2/67 20261
/proc/meminfo: memFree=1562656/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=1.62
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 312 10039 0 0 0 0 154 8 16 0 1 0 97472784 5484544 238 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 238 195 169 0 50 0
[pid=20260] ppid=20257 vsize=33328 CPUtime=5.98
/proc/20260/stat : 20260 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194304 5447 0 0 0 531 67 0 0 20 0 2 0 97472948 34127872 5433 1992294400 134512640 135305190 4294956144 18446744073709551615 134529134 0 0 4096 3 18446744073709551615 0 0 17 0 0 0
/proc/20260/statm: 8332 5433 83 193 0 8136 0
[pid=20260/tid=20261] ppid=20257 vsize=33328 CPUtime=3.3
/proc/20260/task/20261/stat : 20261 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194368 1028 0 0 0 297 33 0 0 17 0 2 0 97472962 34127872 5433 1992294400 134512640 135305190 4294956144 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 7.6
Current children cumulated vsize (KiB) 38684

[startup+12.7022 s]
/proc/loadavg: 1.30 1.07 1.02 3/67 20261
/proc/meminfo: memFree=1554536/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=1.62
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 312 10039 0 0 0 0 154 8 16 0 1 0 97472784 5484544 238 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 238 195 169 0 50 0
[pid=20260] ppid=20257 vsize=42476 CPUtime=18.15
/proc/20260/stat : 20260 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194304 7460 0 0 0 1745 70 0 0 17 0 2 0 97472948 43495424 7446 1992294400 134512640 135305190 4294956144 18446744073709551615 134529379 0 0 4096 3 18446744073709551615 0 0 17 0 0 0
/proc/20260/statm: 10619 7446 83 193 0 10423 0
[pid=20260/tid=20261] ppid=20257 vsize=42476 CPUtime=9.18
/proc/20260/task/20261/stat : 20261 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194368 1827 0 0 0 883 35 0 0 17 0 2 0 97472962 43495424 7446 1992294400 134512640 135305190 4294956144 18446744073709551615 134529257 0 0 4096 3 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 19.77
Current children cumulated vsize (KiB) 47832

Solver just ended. Dumping a history of the last processes samples

[startup+12.8023 s]
/proc/loadavg: 1.30 1.07 1.02 3/67 20261
/proc/meminfo: memFree=1554536/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=1.62
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 312 10039 0 0 0 0 154 8 16 0 1 0 97472784 5484544 238 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 238 195 169 0 50 0
[pid=20260] ppid=20257 vsize=42476 CPUtime=18.35
/proc/20260/stat : 20260 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194304 7460 0 0 0 1765 70 0 0 17 0 2 0 97472948 43495424 7446 1992294400 134512640 135305190 4294956144 18446744073709551615 134834440 0 0 4096 3 18446744073709551615 0 0 17 0 0 0
/proc/20260/statm: 10619 7446 83 193 0 10423 0
[pid=20260/tid=20261] ppid=20257 vsize=42476 CPUtime=9.28
/proc/20260/task/20261/stat : 20261 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194368 1827 0 0 0 893 35 0 0 17 0 2 0 97472962 43495424 7446 1992294400 134512640 135305190 4294956144 18446744073709551615 134657578 0 0 4096 3 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 19.97
Current children cumulated vsize (KiB) 47832

[startup+12.9023 s]
/proc/loadavg: 1.30 1.07 1.02 3/67 20261
/proc/meminfo: memFree=1554536/2055920 swapFree=4180280/4192956
[pid=20257] ppid=20255 vsize=5356 CPUtime=1.62
/proc/20257/stat : 20257 (manysat.sh) S 20255 20257 20097 0 -1 4194304 312 10039 0 0 0 0 154 8 16 0 1 0 97472784 5484544 238 1992294400 4194304 4889804 548682068784 18446744073709551615 217871606596 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20257/statm: 1339 238 195 169 0 50 0
[pid=20260] ppid=20257 vsize=42476 CPUtime=18.55
/proc/20260/stat : 20260 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194304 7460 0 0 0 1785 70 0 0 17 0 2 0 97472948 43495424 7446 1992294400 134512640 135305190 4294956144 18446744073709551615 134529661 0 0 4096 3 18446744073709551615 0 0 17 0 0 0
/proc/20260/statm: 10619 7446 83 193 0 10423 0
[pid=20260/tid=20261] ppid=20257 vsize=42476 CPUtime=9.38
/proc/20260/task/20261/stat : 20261 (manysat1.1_stat) R 20257 20257 20097 0 -1 4194368 1827 0 0 0 903 35 0 0 17 0 2 0 97472962 43495424 7446 1992294400 134512640 135305190 4294956144 18446744073709551615 134657578 0 0 4096 3 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 20.17
Current children cumulated vsize (KiB) 47832

Child status: 20
Real time (s): 12.9349
CPU time (s): 20.2469
CPU user time (s): 19.446
CPU system time (s): 0.800878
CPU usage (%): 156.53
Max. virtual memory (cumulated for all children) (KiB): 47832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 19.446
system time used= 0.800878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17980
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1937
involuntary context switches= 177

runsolver used 0.041993 second user time and 0.138978 second system time

The end

Launcher Data 

Begin job on node28 at 2009-04-25 23:19:55
IDJOB=1724299
IDBENCH=71767
IDSOLVER=514
FILE ID=node28/1724299-1240694394
PBS_JOBID= 9186724
Free space on /tmp= 66240 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20
BENCH NAME= SAT_RACE06/manol-pipe-g7nidw.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1724299-1240694394/watcher-1724299-1240694394 -o /tmp/evaluation-result-1724299-1240694394/solver-1724299-1240694394 -C 1200 -W 1800 -M 1800 --output-limit 1,15  manysat.sh HOME/instance-1724299-1240694394.cnf aimd 1

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= a0303c742e981cc0d4711ad3ac66f146
RANDOM SEED=1415918526

node28.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1592984 kB
Buffers:         43044 kB
Cached:         365220 kB
SwapCached:       5856 kB
Active:         158292 kB
Inactive:       258428 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1592984 kB
SwapTotal:     4192956 kB
SwapFree:      4180280 kB
Dirty:            5112 kB
Writeback:           0 kB
Mapped:          13712 kB
Slab:            32084 kB
Committed_AS:   404564 kB
PageTables:       1420 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66240 MiB
End job on node28 at 2009-04-25 23:20:08