Trace number 2083705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pcs-restart 0.3.2UNSAT 270.699 272.051

DiagnosticValue
ASSIGNMENTS6959

General information on the benchmark

Namecsp/fapp/fapp04/
normalized-fapp04-0300-0.xml
MD5SUM3d5c26105aab0ca21b22d7bc9b077a6e
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark5.16521
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints3360
Maximum constraint arity2
Maximum domain size270
Number of constraints which are defined in extension0
Number of constraints which are defined in intension3360
Global constraints used (with number of constraints)

Solver Data 

0.00/0.01	c has big domains
0.00/0.01	c big-domain mode
0.18/0.21	c Seed is 102029728
0.18/0.21	c Constructing HOME/instance-2083705-1247723637.xml  with 21104 constraints
0.27/0.37	c Solving 6959 backtracks 13 restarts
270.63/272.04	s UNSATISFIABLE
270.63/272.04	d ASSIGNMENTS 6959

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2083705-1247723637/watcher-2083705-1247723637 -o /tmp/evaluation-result-2083705-1247723637/solver-2083705-1247723637 -C 1800 -W 2000 -M 900 HOME/pcssolve -s 102029728 HOME/instance-2083705-1247723637.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.94 2.00 1.99 4/85 19282
/proc/meminfo: memFree=1166184/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=5356 CPUtime=0
/proc/19282/stat : 19282 (pcssolve) R 19280 19282 17311 0 -1 4194304 290 0 0 0 0 0 0 0 21 0 1 0 59426432 5484544 241 996147200 4194304 4889804 548682068800 18446744073709551615 209560595103 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/19282/statm: 1339 241 200 169 0 50 0
[pid=19283] ppid=19282 vsize=5356 CPUtime=0
/proc/19283/stat : 19283 (pcssolve) R 19282 19282 17311 0 -1 4194368 22 0 0 0 0 0 0 0 22 0 1 0 59426432 5484544 243 996147200 4194304 4889804 548682068800 18446744073709551615 209560595751 0 0 4096 0 0 0 0 17 1 0 0
/proc/19283/statm: 1339 243 202 169 0 50 0
[pid=19284] ppid=19282 vsize=5356 CPUtime=0
/proc/19284/stat : 19284 (pcssolve) R 19282 19282 17311 0 -1 4194368 0 0 0 0 0 0 0 0 21 0 1 0 59426432 5484544 241 996147200 4194304 4889804 548682068800 18446744073709551615 209560595103 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/19284/statm: 1339 241 200 169 0 50 0

[startup+0.126946 s]
/proc/loadavg: 1.94 2.00 1.99 4/85 19282
/proc/meminfo: memFree=1166184/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=7112 CPUtime=0.1
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 1495 662 0 0 10 0 0 0 18 0 1 0 59426432 7282688 1005 996147200 134512640 135215973 4294956304 18446744073709551615 4294960144 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 1778 1005 386 171 0 703 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 7112

[startup+0.202375 s]
/proc/loadavg: 1.94 2.00 1.99 4/85 19282
/proc/meminfo: memFree=1166184/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=9456 CPUtime=0.18
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 2184 662 0 0 17 1 0 0 18 0 1 0 59426432 9682944 1418 996147200 134512640 135215973 4294956304 18446744073709551615 134809019 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 2364 1418 386 171 0 1289 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 9456

[startup+0.300971 s]
/proc/loadavg: 1.94 2.00 1.99 4/85 19282
/proc/meminfo: memFree=1166184/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=11328 CPUtime=0.27
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 2847 662 0 0 26 1 0 0 19 0 1 0 59426432 11599872 1877 996147200 134512640 135215973 4294956304 18446744073709551615 134608549 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 2832 1877 386 171 0 1757 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 11328

[startup+0.701038 s]
/proc/loadavg: 1.94 2.00 1.99 4/85 19282
/proc/meminfo: memFree=1166184/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=15136 CPUtime=0.68
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 4275 662 0 0 66 2 0 0 23 0 1 0 59426432 15499264 2822 996147200 134512640 135215973 4294956304 18446744073709551615 134585780 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 3784 2822 410 171 0 2709 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 15136

[startup+1.50117 s]
/proc/loadavg: 1.94 2.00 1.99 3/86 19287
/proc/meminfo: memFree=1156256/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=15504 CPUtime=1.47
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 4394 662 0 0 145 2 0 0 25 0 1 0 59426432 15876096 2881 996147200 134512640 135215973 4294956304 18446744073709551615 134600784 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 3876 2881 410 171 0 2801 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 15504

[startup+3.10246 s]
/proc/loadavg: 1.94 2.00 1.99 3/86 19287
/proc/meminfo: memFree=1155680/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=16844 CPUtime=3.07
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 4776 662 0 0 305 2 0 0 25 0 1 0 59426432 17248256 3158 996147200 134512640 135215973 4294956304 18446744073709551615 134589811 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 4211 3158 410 171 0 3136 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 16844

[startup+6.30199 s]
/proc/loadavg: 1.94 2.00 1.99 4/86 19287
/proc/meminfo: memFree=1142752/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=17036 CPUtime=6.25
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 4874 662 0 0 623 2 0 0 25 0 1 0 59426432 17444864 3256 996147200 134512640 135215973 4294956304 18446744073709551615 135094718 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 4259 3256 413 171 0 3184 0
Current children cumulated CPU time (s) 6.25
Current children cumulated vsize (KiB) 17036

[startup+12.7011 s]
/proc/loadavg: 1.95 2.00 1.99 3/86 19287
/proc/meminfo: memFree=1112544/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=17992 CPUtime=12.62
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 5113 662 0 0 1260 2 0 0 25 0 1 0 59426432 18423808 3495 996147200 134512640 135215973 4294956304 18446744073709551615 134585549 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 4498 3495 413 171 0 3423 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 17992

[startup+25.5012 s]
/proc/loadavg: 1.96 2.00 1.99 3/86 19287
/proc/meminfo: memFree=1048032/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=19680 CPUtime=25.35
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 5552 662 0 0 2533 2 0 0 25 0 1 0 59426432 20152320 3934 996147200 134512640 135215973 4294956304 18446744073709551615 134583626 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 4920 3934 413 171 0 3845 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 19680

[startup+51.1016 s]
/proc/loadavg: 2.03 2.01 2.00 3/86 19287
/proc/meminfo: memFree=957664/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=23800 CPUtime=50.82
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 6677 662 0 0 5080 2 0 0 25 0 1 0 59426432 24371200 4850 996147200 134512640 135215973 4294956304 18446744073709551615 134585786 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 5950 4850 413 171 0 4875 0
Current children cumulated CPU time (s) 50.82
Current children cumulated vsize (KiB) 23800

[startup+102.301 s]
/proc/loadavg: 2.08 2.02 2.00 3/86 19287
/proc/meminfo: memFree=857888/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=29220 CPUtime=101.78
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 8069 662 0 0 10175 3 0 0 25 0 1 0 59426432 29921280 6209 996147200 134512640 135215973 4294956304 18446744073709551615 134583604 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 7305 6209 413 171 0 6230 0
Current children cumulated CPU time (s) 101.78
Current children cumulated vsize (KiB) 29220

[startup+162.301 s]
/proc/loadavg: 2.37 2.11 2.03 3/86 19288
/proc/meminfo: memFree=818520/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=34584 CPUtime=161.47
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 9451 662 0 0 16144 3 0 0 25 0 1 0 59426432 35414016 7526 996147200 134512640 135215973 4294956304 18446744073709551615 134585388 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 8646 7526 413 171 0 7571 0
Current children cumulated CPU time (s) 161.47
Current children cumulated vsize (KiB) 34584

[startup+222.307 s]
/proc/loadavg: 2.41 2.17 2.06 3/85 19288
/proc/meminfo: memFree=811800/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=40888 CPUtime=221.18
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 11068 662 0 0 22114 4 0 0 25 0 1 0 59426432 41869312 9143 996147200 134512640 135215973 4294956304 18446744073709551615 134597655 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 10222 9143 413 171 0 9147 0
Current children cumulated CPU time (s) 221.18
Current children cumulated vsize (KiB) 40888

Solver just ended. Dumping a history of the last processes samples

[startup+230.402 s]
/proc/loadavg: 2.35 2.17 2.06 3/85 19288
/proc/meminfo: memFree=811288/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=41420 CPUtime=229.24
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 11236 662 0 0 22920 4 0 0 25 0 1 0 59426432 42414080 9311 996147200 134512640 135215973 4294956304 18446744073709551615 4158960056 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 10355 9311 413 171 0 9280 0
Current children cumulated CPU time (s) 229.24
Current children cumulated vsize (KiB) 41420

[startup+256.001 s]
/proc/loadavg: 2.23 2.15 2.05 3/85 19288
/proc/meminfo: memFree=808152/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=44560 CPUtime=254.71
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12044 662 0 0 25466 5 0 0 25 0 1 0 59426432 45629440 10119 996147200 134512640 135215973 4294956304 18446744073709551615 134585694 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11140 10119 413 171 0 10065 0
Current children cumulated CPU time (s) 254.71
Current children cumulated vsize (KiB) 44560

[startup+262.402 s]
/proc/loadavg: 2.21 2.15 2.05 3/85 19288
/proc/meminfo: memFree=807128/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=45508 CPUtime=261.08
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12285 662 0 0 26103 5 0 0 25 0 1 0 59426432 46600192 10360 996147200 134512640 135215973 4294956304 18446744073709551615 135096312 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11377 10360 413 171 0 10302 0
Current children cumulated CPU time (s) 261.08
Current children cumulated vsize (KiB) 45508

[startup+268.801 s]
/proc/loadavg: 2.19 2.15 2.05 3/85 19288
/proc/meminfo: memFree=806296/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=46296 CPUtime=267.45
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12491 662 0 0 26740 5 0 0 25 0 1 0 59426432 47407104 10566 996147200 134512640 135215973 4294956304 18446744073709551615 134585658 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11574 10566 413 171 0 10499 0
Current children cumulated CPU time (s) 267.45
Current children cumulated vsize (KiB) 46296

[startup+270.402 s]
/proc/loadavg: 2.18 2.14 2.05 3/85 19288
/proc/meminfo: memFree=806104/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=46452 CPUtime=269.04
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12532 662 0 0 26899 5 0 0 25 0 1 0 59426432 47566848 10607 996147200 134512640 135215973 4294956304 18446744073709551615 134585880 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11613 10607 413 171 0 10538 0
Current children cumulated CPU time (s) 269.04
Current children cumulated vsize (KiB) 46452

[startup+271.202 s]
/proc/loadavg: 2.18 2.14 2.05 3/85 19288
/proc/meminfo: memFree=805976/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=46528 CPUtime=269.83
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12551 662 0 0 26978 5 0 0 25 0 1 0 59426432 47644672 10626 996147200 134512640 135215973 4294956304 18446744073709551615 134583616 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11632 10626 413 171 0 10557 0
Current children cumulated CPU time (s) 269.83
Current children cumulated vsize (KiB) 46528

[startup+271.602 s]
/proc/loadavg: 2.18 2.14 2.05 3/85 19288
/proc/meminfo: memFree=805976/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=46604 CPUtime=270.23
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12570 662 0 0 27018 5 0 0 25 0 1 0 59426432 47722496 10645 996147200 134512640 135215973 4294956304 18446744073709551615 134585800 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11651 10645 413 171 0 10576 0
Current children cumulated CPU time (s) 270.23
Current children cumulated vsize (KiB) 46604

[startup+272.001 s]
/proc/loadavg: 2.18 2.14 2.05 3/85 19288
/proc/meminfo: memFree=805848/2055920 swapFree=4192812/4192956
[pid=19282] ppid=19280 vsize=46176 CPUtime=270.63
/proc/19282/stat : 19282 (pcs.big) R 19280 19282 17311 0 -1 4194304 12722 662 0 0 27058 5 0 0 25 0 1 0 59426432 47284224 10448 996147200 134512640 135215973 4294956304 18446744073709551615 134532677 0 0 4096 0 0 0 0 17 1 0 0
/proc/19282/statm: 11544 10448 413 171 0 10469 0
Current children cumulated CPU time (s) 270.63
Current children cumulated vsize (KiB) 46176

Child status: 0
Real time (s): 272.051
CPU time (s): 270.699
CPU user time (s): 270.628
CPU system time (s): 0.070989
CPU usage (%): 99.5028
Max. virtual memory (cumulated for all children) (KiB): 47116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 270.628
system time used= 0.070989
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13386
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 3157

runsolver used 0.320951 second user time and 0.803877 second system time

The end

Launcher Data 

Begin job on node68 at 2009-07-16 07:53:57
IDJOB=2083705
IDBENCH=57905
IDSOLVER=734
FILE ID=node68/2083705-1247723637
PBS_JOBID= 9521429
Free space on /tmp= 66412 MiB

SOLVER NAME= pcs-restart 0.2.restart
BENCH NAME= CPAI08/csp/fapp/fapp04/normalized-fapp04-0300-0.xml
COMMAND LINE= HOME/pcssolve -s RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2083705-1247723637/watcher-2083705-1247723637 -o /tmp/evaluation-result-2083705-1247723637/solver-2083705-1247723637 -C 1800 -W 2000 -M 900  HOME/pcssolve -s 102029728 HOME/instance-2083705-1247723637.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 3d5c26105aab0ca21b22d7bc9b077a6e
RANDOM SEED=102029728

node68.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.258
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.258
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1166664 kB
Buffers:         73772 kB
Cached:         275340 kB
SwapCached:          0 kB
Active:         555816 kB
Inactive:       264232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1166664 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            2244 kB
Writeback:           0 kB
Mapped:         491604 kB
Slab:            53060 kB
Committed_AS:  1353028 kB
PageTables:       2912 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66412 MiB
End job on node68 at 2009-07-16 07:58:30