Trace number 2082539

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pcs-restart 0.3.2SAT 120.977 121.588

DiagnosticValue
ASSIGNMENTS23392

General information on the benchmark

Namecsp/super-jobShop/
super-jobShop-enddr2/normalized-super-jobShop-enddr2-3.xml
MD5SUMbe1747164e3ac921fa9d6050fe7cf8ff
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark3.68944
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints845
Maximum constraint arity2
Maximum domain size139
Number of constraints which are defined in extension0
Number of constraints which are defined in intension845
Global constraints used (with number of constraints)

Solver Data 

0.00/0.01	c has big domains
0.00/0.01	c big-domain mode
0.18/0.20	c Seed is 706592285
0.18/0.20	c Constructing HOME/instance-2082539-1247721345.xml  with 5015 constraints
0.18/0.20	c Solving 23392 backtracks 16 restarts
120.88/121.57	s SATISFIABLE
120.88/121.57	c V0=0, V1=1, V2=32, V3=61, V4=88, V5=87, V6=99, V7=98, V8=109, V9=108, V10=55, V11=54, V12=68, V13=67, V14=79, V15=80, V16=88, V17=87, V18=98, V19=99, V20=14, V21=15, V22=23, V23=22, V24=33, V25=34, V26=47, V27=46, V28=50, V29=51, V30=0, V31=1, V32=5, V33=4, V34=14, V35=15, V36=24, V37=23, V38=33, V39=34, V40=48, V41=49, V42=55, V43=54, V44=61, V45=60, V46=76, V47=77, V48=86, V49=85, V50=79, V51=61, V52=108, V53=107, V54=142, V55=143, V56=155, V57=154, V58=166, V59=167, V60=5, V61=4, V62=69, V63=61, V64=113, V65=112, V66=125, V67=126, V68=140, V69=139, V70=16, V71=17, V72=40, V73=61, V74=96, V75=97, V76=113, V77=112, V78=124, V79=125, V80=42, V81=43, V82=88, V83=87, V84=126, V85=125, V86=142, V87=143, V88=156, V89=155, V90=23, V91=22, V92=34, V93=33, V94=47, V95=46, V96=60, V97=61, V98=68, V99=67, 
120.88/121.57	v 0 1 32 61 88 87 99 98 109 108 55 54 68 67 79 80 88 87 98 99 14 15 23 22 33 34 47 46 50 51 0 1 5 4 14 15 24 23 33 34 48 49 55 54 61 60 76 77 86 85 79 61 108 107 142 143 155 154 166 167 5 4 69 61 113 112 125 126 140 139 16 17 40 61 96 97 113 112 124 125 42 43 88 87 126 125 142 143 156 155 23 22 34 33 47 46 60 61 68 67 
120.88/121.58	d ASSIGNMENTS 23392

Verifier Data 

OK

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2082539-1247721345/watcher-2082539-1247721345 -o /tmp/evaluation-result-2082539-1247721345/solver-2082539-1247721345 -C 1800 -W 2000 -M 900 HOME/pcssolve -s 706592285 HOME/instance-2082539-1247721345.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.99 4/81 14898
/proc/meminfo: memFree=1386944/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=5356 CPUtime=0
/proc/14898/stat : 14898 (pcssolve) R 14896 14898 12146 0 -1 4194304 309 317 0 0 0 0 0 0 16 0 1 0 59200785 5484544 242 996147200 4194304 4889804 548682068800 18446744073709551615 233588714143 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/14898/statm: 1339 242 201 169 0 50 0
[pid=14901] ppid=14898 vsize=3676 CPUtime=0
/proc/14901/stat : 14901 (fgrep) R 14898 14898 12146 0 -1 4194304 121 0 0 0 0 0 0 0 16 0 1 0 59200786 3764224 89 996147200 4194304 4274172 548682068976 18446744073709551615 233588594016 0 0 4096 0 0 0 0 17 1 0 0
/proc/14901/statm: 919 104 84 19 0 43 0

[startup+0.161515 s]
/proc/loadavg: 1.92 1.98 1.99 4/81 14898
/proc/meminfo: memFree=1386944/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=8420 CPUtime=0.14
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 1911 661 0 0 14 0 0 0 18 0 1 0 59200785 8622080 1268 996147200 134512640 135215973 4294956304 18446744073709551615 134908148 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2105 1268 408 171 0 1030 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 8420

[startup+0.202521 s]
/proc/loadavg: 1.92 1.98 1.99 4/81 14898
/proc/meminfo: memFree=1386944/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=8420 CPUtime=0.18
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 1967 661 0 0 18 0 0 0 18 0 1 0 59200785 8622080 1324 996147200 134512640 135215973 4294956304 18446744073709551615 134648297 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2105 1324 408 171 0 1030 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 8420

[startup+0.302539 s]
/proc/loadavg: 1.92 1.98 1.99 4/81 14898
/proc/meminfo: memFree=1386944/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=9648 CPUtime=0.29
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 2327 661 0 0 28 1 0 0 19 0 1 0 59200785 9879552 1475 996147200 134512640 135215973 4294956304 18446744073709551615 134648262 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2412 1475 408 171 0 1337 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9648

[startup+0.70261 s]
/proc/loadavg: 1.92 1.98 1.99 4/81 14898
/proc/meminfo: memFree=1386944/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=9784 CPUtime=0.68
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 2365 661 0 0 67 1 0 0 23 0 1 0 59200785 10018816 1513 996147200 134512640 135215973 4294956304 18446744073709551615 4158960056 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2446 1513 408 171 0 1371 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 9784

[startup+1.50176 s]
/proc/loadavg: 1.92 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1382264/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=9976 CPUtime=1.48
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 2407 661 0 0 147 1 0 0 25 0 1 0 59200785 10215424 1555 996147200 134512640 135215973 4294956304 18446744073709551615 134951265 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2494 1555 408 171 0 1419 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 9976

[startup+3.10104 s]
/proc/loadavg: 1.92 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1381944/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=10332 CPUtime=3.07
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 2492 661 0 0 306 1 0 0 25 0 1 0 59200785 10579968 1640 996147200 134512640 135215973 4294956304 18446744073709551615 134592062 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2583 1640 408 171 0 1508 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 10332

[startup+6.30262 s]
/proc/loadavg: 1.93 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1380856/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=11436 CPUtime=6.25
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 2823 661 0 0 624 1 0 0 25 0 1 0 59200785 11710464 1938 996147200 134512640 135215973 4294956304 18446744073709551615 134907410 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 2859 1938 408 171 0 1784 0
Current children cumulated CPU time (s) 6.25
Current children cumulated vsize (KiB) 11436

[startup+12.7018 s]
/proc/loadavg: 1.93 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1378304/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=13904 CPUtime=12.62
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 3485 661 0 0 1260 2 0 0 25 0 1 0 59200785 14237696 2535 996147200 134512640 135215973 4294956304 18446744073709551615 134525220 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 3476 2535 408 171 0 2401 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 13904

[startup+25.5011 s]
/proc/loadavg: 1.95 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1373312/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=18912 CPUtime=25.36
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 4901 661 0 0 2532 4 0 0 25 0 1 0 59200785 19365888 3757 996147200 134512640 135215973 4294956304 18446744073709551615 134585694 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 4728 3757 408 171 0 3653 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 18912

[startup+51.1017 s]
/proc/loadavg: 1.96 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1361856/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=30652 CPUtime=50.84
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 8175 661 0 0 5078 6 0 0 25 0 1 0 59200785 31387648 6645 996147200 134512640 135215973 4294956304 18446744073709551615 134600148 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 7663 6645 408 171 0 6588 0
Current children cumulated CPU time (s) 50.84
Current children cumulated vsize (KiB) 30652

[startup+102.303 s]
/proc/loadavg: 1.98 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1345664/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=46840 CPUtime=101.77
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 12660 661 0 0 10169 8 0 0 25 0 1 0 59200785 47964160 10617 996147200 134512640 135215973 4294956304 18446744073709551615 134599844 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 11710 10617 408 171 0 10635 0
Current children cumulated CPU time (s) 101.77
Current children cumulated vsize (KiB) 46840

Solver just ended. Dumping a history of the last processes samples

[startup+102.408 s]
/proc/loadavg: 1.98 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1345664/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=46840 CPUtime=101.87
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 12663 661 0 0 10179 8 0 0 25 0 1 0 59200785 47964160 10620 996147200 134512640 135215973 4294956304 18446744073709551615 134532946 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 11710 10620 408 171 0 10635 0
Current children cumulated CPU time (s) 101.87
Current children cumulated vsize (KiB) 46840

[startup+115.201 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1341504/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=50848 CPUtime=114.61
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 13789 661 0 0 11452 9 0 0 25 0 1 0 59200785 52068352 11746 996147200 134512640 135215973 4294956304 18446744073709551615 4158960095 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 12712 11746 408 171 0 11637 0
Current children cumulated CPU time (s) 114.61
Current children cumulated vsize (KiB) 50848

[startup+118.402 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1340160/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=51936 CPUtime=117.79
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 14114 661 0 0 11770 9 0 0 25 0 1 0 59200785 53182464 12071 996147200 134512640 135215973 4294956304 18446744073709551615 134648311 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 12984 12071 408 171 0 11909 0
Current children cumulated CPU time (s) 117.79
Current children cumulated vsize (KiB) 51936

[startup+120.006 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1339200/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=52548 CPUtime=119.38
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 14274 661 0 0 11929 9 0 0 25 0 1 0 59200785 53809152 12231 996147200 134512640 135215973 4294956304 18446744073709551615 134585701 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 13137 12231 408 171 0 12062 0
Current children cumulated CPU time (s) 119.38
Current children cumulated vsize (KiB) 52548

[startup+120.801 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1339200/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=52780 CPUtime=120.18
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 14359 661 0 0 12008 10 0 0 25 0 1 0 59200785 54046720 12316 996147200 134512640 135215973 4294956304 18446744073709551615 134532946 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 13195 12316 408 171 0 12120 0
Current children cumulated CPU time (s) 120.18
Current children cumulated vsize (KiB) 52780

[startup+121.201 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1338752/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=52896 CPUtime=120.58
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 14395 661 0 0 12048 10 0 0 25 0 1 0 59200785 54165504 12352 996147200 134512640 135215973 4294956304 18446744073709551615 4158960067 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 13224 12352 408 171 0 12149 0
Current children cumulated CPU time (s) 120.58
Current children cumulated vsize (KiB) 52896

[startup+121.401 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1338752/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=53132 CPUtime=120.78
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 14437 661 0 0 12068 10 0 0 25 0 1 0 59200785 54407168 12394 996147200 134512640 135215973 4294956304 18446744073709551615 134982814 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 13283 12396 408 171 0 12208 0
Current children cumulated CPU time (s) 120.78
Current children cumulated vsize (KiB) 53132

[startup+121.501 s]
/proc/loadavg: 1.99 1.98 1.99 3/82 14903
/proc/meminfo: memFree=1338752/2055920 swapFree=4192812/4192956
[pid=14898] ppid=14896 vsize=53264 CPUtime=120.88
/proc/14898/stat : 14898 (pcs.big) R 14896 14898 12146 0 -1 4194304 14471 661 0 0 12078 10 0 0 25 0 1 0 59200785 54542336 12428 996147200 134512640 135215973 4294956304 18446744073709551615 134642003 0 0 4096 0 0 0 0 17 0 0 0
/proc/14898/statm: 13316 12428 408 171 0 12241 0
Current children cumulated CPU time (s) 120.88
Current children cumulated vsize (KiB) 53264

Child status: 0
Real time (s): 121.588
CPU time (s): 120.977
CPU user time (s): 120.863
CPU system time (s): 0.113982
CPU usage (%): 99.4975
Max. virtual memory (cumulated for all children) (KiB): 53264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 120.863
system time used= 0.113982
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15135
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 1712

runsolver used 0.184971 second user time and 0.374943 second system time

The end

Launcher Data 

Begin job on node27 at 2009-07-16 07:15:45
IDJOB=2082539
IDBENCH=57598
IDSOLVER=734
FILE ID=node27/2082539-1247721345
PBS_JOBID= 9521329
Free space on /tmp= 66224 MiB

SOLVER NAME= pcs-restart 0.2.restart
BENCH NAME= CPAI08/csp/super-jobShop/super-jobShop-enddr2/normalized-super-jobShop-enddr2-3.xml
COMMAND LINE= HOME/pcssolve -s RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2082539-1247721345/watcher-2082539-1247721345 -o /tmp/evaluation-result-2082539-1247721345/solver-2082539-1247721345 -C 1800 -W 2000 -M 900  HOME/pcssolve -s 706592285 HOME/instance-2082539-1247721345.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= be1747164e3ac921fa9d6050fe7cf8ff
RANDOM SEED=706592285

node27.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 2800.239
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5521.40
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 2800.239
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1387360 kB
Buffers:         71664 kB
Cached:         279624 kB
SwapCached:          0 kB
Active:         301712 kB
Inactive:       294328 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1387360 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            1860 kB
Writeback:           0 kB
Mapped:         265064 kB
Slab:            57240 kB
Committed_AS:   951404 kB
PageTables:       2248 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264948 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66220 MiB
End job on node27 at 2009-07-16 07:17:47