Trace number 1725985

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
clasp 1.2.0-SAT09-32SAT 343.327 343.291

General information on the benchmark

Namecrafted/Medium/contest05/jarvisalo/
mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf
MD5SUM87d9c7ce297970bb210f40783f709fcc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.010997
Satisfiable
(Un)Satisfiability was proved
Number of variables230
Number of clauses920
Sum of the clauses size2760
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3920
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

343.23/343.29	c clasp version 1.2.0-SAT09 
343.23/343.29	c Reading from ...708225/instance-1725985-1240708225.cnf
343.23/343.29	c Reading      : Done(0.000s)
343.23/343.29	c Preprocessing: |-Done(0.000s)
343.23/343.29	c Solving...
343.23/343.29	c Model: 1
343.23/343.29	v -1 2 3 -4 5 6 -7 8 9 10
343.23/343.29	v 11 -12 13 14 -15 -16 -17 18 -19 20
343.23/343.29	v 21 -22 -23 24 -25 -26 27 28 29 30
343.23/343.29	v -31 -32 -33 34 -35 -36 -37 38 39 -40
343.23/343.29	v 41 42 -43 -44 45 46 47 48 49 50
343.23/343.29	v -51 -52 53 54 -55 -56 57 58 59 60
343.23/343.29	v -61 -62 63 -64 65 -66 -67 68 -69 -70
343.23/343.29	v 71 72 -73 -74 -75 -76 -77 -78 79 -80
343.23/343.29	v -81 82 -83 84 -85 86 -87 88 -89 90
343.23/343.29	v -91 92 -93 94 -95 -96 -97 -98 -99 100
343.23/343.29	v 101 -102 -103 104 105 106 107 108 -109 110
343.23/343.29	v 111 112 113 -114 -115 116 117 -118 119 120
343.23/343.29	v 121 -122 -123 -124 125 -126 127 -128 129 -130
343.23/343.29	v 131 132 133 134 135 -136 137 -138 139 -140
343.23/343.29	v 141 -142 143 144 145 -146 -147 -148 149 150
343.23/343.29	v -151 152 -153 154 155 156 -157 -158 -159 -160
343.23/343.29	v -161 -162 -163 -164 -165 -166 -167 168 169 170
343.23/343.29	v -171 172 -173 174 175 -176 -177 -178 179 180
343.23/343.29	v 181 -182 183 184 -185 186 187 188 -189 -190
343.23/343.29	v -191 192 -193 -194 -195 -196 197 -198 -199 -200
343.23/343.29	v 201 -202 203 -204 205 206 -207 -208 209 210
343.23/343.29	v 211 -212 -213 -214 -215 216 -217 -218 -219 220
343.23/343.29	v 221 -222 -223 224 225 -226 227 228 229 -230 0 
343.23/343.29	
343.23/343.29	c Models    : 1+    
343.23/343.29	c Time         : 343.370s (Solve: 343.370s)
343.23/343.29	s SATISFIABLE

Verifier Data 

OK

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1725985-1240708225/watcher-1725985-1240708225 -o /tmp/evaluation-result-1725985-1240708225/solver-1725985-1240708225 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/clasp --file=HOME/instance-1725985-1240708225.cnf --dimacs --number=1 --sat-p=20,25,150 --hParam=0,512 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.01 1.00 1.00 3/64 20549
/proc/meminfo: memFree=1887432/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=1696 CPUtime=0
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 239 0 0 0 0 0 0 0 18 0 1 0 98855852 1736704 222 1992294400 134512640 136057169 4294956144 18446744073709551615 134652072 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 424 222 179 377 0 44 0

[startup+0.0278241 s]
/proc/loadavg: 1.01 1.00 1.00 3/64 20549
/proc/meminfo: memFree=1887432/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=1828 CPUtime=0.02
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 242 0 0 0 2 0 0 0 18 0 1 0 98855852 1871872 225 1992294400 134512640 136057169 4294956144 18446744073709551615 134824457 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 457 225 180 377 0 77 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 1828

[startup+0.101803 s]
/proc/loadavg: 1.01 1.00 1.00 3/64 20549
/proc/meminfo: memFree=1887432/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=1828 CPUtime=0.1
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 253 0 0 0 10 0 0 0 18 0 1 0 98855852 1871872 236 1992294400 134512640 136057169 4294956144 18446744073709551615 134645288 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 457 236 180 377 0 77 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 1828

[startup+0.301746 s]
/proc/loadavg: 1.01 1.00 1.00 3/64 20549
/proc/meminfo: memFree=1887432/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=1828 CPUtime=0.3
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 270 0 0 0 30 0 0 0 19 0 1 0 98855852 1871872 253 1992294400 134512640 136057169 4294956144 18446744073709551615 134823322 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 457 253 180 377 0 77 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 1828

[startup+0.701632 s]
/proc/loadavg: 1.01 1.00 1.00 3/64 20549
/proc/meminfo: memFree=1887432/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=1960 CPUtime=0.7
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 292 0 0 0 70 0 0 0 22 0 1 0 98855852 2007040 275 1992294400 134512640 136057169 4294956144 18446744073709551615 134828253 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 490 275 180 377 0 110 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 1960

[startup+1.50141 s]
/proc/loadavg: 1.01 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1887040/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=2092 CPUtime=1.5
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 322 0 0 0 150 0 0 0 25 0 1 0 98855852 2142208 305 1992294400 134512640 136057169 4294956144 18446744073709551615 134612876 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 523 305 180 377 0 143 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 2092

[startup+3.10195 s]
/proc/loadavg: 1.01 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1886784/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=2224 CPUtime=3.1
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 355 0 0 0 310 0 0 0 25 0 1 0 98855852 2277376 338 1992294400 134512640 136057169 4294956144 18446744073709551615 134615835 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 556 338 180 377 0 176 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 2224

[startup+6.30105 s]
/proc/loadavg: 1.01 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1886528/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=2356 CPUtime=6.3
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 397 0 0 0 630 0 0 0 25 0 1 0 98855852 2412544 380 1992294400 134512640 136057169 4294956144 18446744073709551615 134823738 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 589 380 180 377 0 209 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 2356

[startup+12.7022 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1886216/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=2620 CPUtime=12.7
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 445 0 0 0 1270 0 0 0 25 0 1 0 98855852 2682880 428 1992294400 134512640 136057169 4294956144 18446744073709551615 134613092 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 655 428 180 377 0 275 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 2620

[startup+25.5016 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1885896/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=2888 CPUtime=25.5
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 514 0 0 0 2550 0 0 0 25 0 1 0 98855852 2957312 497 1992294400 134512640 136057169 4294956144 18446744073709551615 134824014 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 722 497 180 377 0 342 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 2888

[startup+51.1014 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1885576/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=3152 CPUtime=51.1
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 588 0 0 0 5110 0 0 0 25 0 1 0 98855852 3227648 571 1992294400 134512640 136057169 4294956144 18446744073709551615 134823846 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 788 571 180 377 0 408 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 3152

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1885000/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=3688 CPUtime=102.31
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 725 0 0 0 10231 0 0 0 25 0 1 0 98855852 3776512 708 1992294400 134512640 136057169 4294956144 18446744073709551615 134824014 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 922 708 180 377 0 542 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 3688

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1884424/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=4244 CPUtime=162.31
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 854 0 0 0 16231 0 0 0 25 0 1 0 98855852 4345856 837 1992294400 134512640 136057169 4294956144 18446744073709551615 134825006 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1061 837 180 377 0 681 0
Current children cumulated CPU time (s) 162.31
Current children cumulated vsize (KiB) 4244

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1883848/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=4792 CPUtime=222.31
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 987 0 0 0 22231 0 0 0 25 0 1 0 98855852 4907008 970 1992294400 134512640 136057169 4294956144 18446744073709551615 134824119 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1198 970 180 377 0 818 0
Current children cumulated CPU time (s) 222.31
Current children cumulated vsize (KiB) 4792

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1883464/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=5064 CPUtime=282.32
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 1064 0 0 0 28232 0 0 0 25 0 1 0 98855852 5185536 1047 1992294400 134512640 136057169 4294956144 18446744073709551615 134820174 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1266 1047 180 377 0 886 0
Current children cumulated CPU time (s) 282.32
Current children cumulated vsize (KiB) 5064

[startup+342.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1883144/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=5340 CPUtime=342.32
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 1142 0 0 0 34232 0 0 0 25 0 1 0 98855852 5468160 1125 1992294400 134512640 136057169 4294956144 18446744073709551615 134828289 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1335 1125 180 377 0 955 0
Current children cumulated CPU time (s) 342.32
Current children cumulated vsize (KiB) 5340

Solver just ended. Dumping a history of the last processes samples

[startup+342.702 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1883144/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=5340 CPUtime=342.72
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 1142 0 0 0 34272 0 0 0 25 0 1 0 98855852 5468160 1125 1992294400 134512640 136057169 4294956144 18446744073709551615 134756799 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1335 1125 180 377 0 955 0
Current children cumulated CPU time (s) 342.72
Current children cumulated vsize (KiB) 5340

[startup+343.102 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1883144/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=5340 CPUtime=343.13
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 1142 0 0 0 34313 0 0 0 25 0 1 0 98855852 5468160 1125 1992294400 134512640 136057169 4294956144 18446744073709551615 134824081 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1335 1125 180 377 0 955 0
Current children cumulated CPU time (s) 343.13
Current children cumulated vsize (KiB) 5340

[startup+343.206 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 20550
/proc/meminfo: memFree=1883144/2055920 swapFree=4181368/4192956
[pid=20549] ppid=20547 vsize=5340 CPUtime=343.23
/proc/20549/stat : 20549 (clasp) R 20547 20549 20309 0 -1 4194304 1142 0 0 0 34323 0 0 0 25 0 1 0 98855852 5468160 1125 1992294400 134512640 136057169 4294956144 18446744073709551615 135459153 0 0 4096 16386 0 0 0 17 1 0 0
/proc/20549/statm: 1335 1125 180 377 0 955 0
Current children cumulated CPU time (s) 343.23
Current children cumulated vsize (KiB) 5340

Child status: 10
Real time (s): 343.291
CPU time (s): 343.327
CPU user time (s): 343.317
CPU system time (s): 0.009998
CPU usage (%): 100.01
Max. virtual memory (cumulated for all children) (KiB): 5340

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 343.317
system time used= 0.009998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1148
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 678

runsolver used 0.354946 second user time and 0.594909 second system time

The end

Launcher Data 

Begin job on node16 at 2009-04-26 03:10:25
IDJOB=1725985
IDBENCH=24602
IDSOLVER=508
FILE ID=node16/1725985-1240708225
PBS_JOBID= 9186807
Free space on /tmp= 66320 MiB

SOLVER NAME= clasp 1.2.0-SAT09-32
BENCH NAME= SAT07/crafted/Medium/contest05/jarvisalo/mod2-rand3bip-sat-230-2.sat05-2189.reshuffled-07.cnf
COMMAND LINE= HOME/clasp --file=BENCHNAME --dimacs --number=1 --sat-p=20,25,150 --hParam=0,512
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1725985-1240708225/watcher-1725985-1240708225 -o /tmp/evaluation-result-1725985-1240708225/solver-1725985-1240708225 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/clasp --file=HOME/instance-1725985-1240708225.cnf --dimacs --number=1 --sat-p=20,25,150 --hParam=0,512

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 87d9c7ce297970bb210f40783f709fcc
RANDOM SEED=1201149328

node16.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1887912 kB
Buffers:         17276 kB
Cached:         102304 kB
SwapCached:       5404 kB
Active:          34764 kB
Inactive:        92692 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1887912 kB
SwapTotal:     4192956 kB
SwapFree:      4181368 kB
Dirty:            1920 kB
Writeback:           0 kB
Mapped:          13536 kB
Slab:            26536 kB
Committed_AS:   386744 kB
PageTables:       1436 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66316 MiB
End job on node16 at 2009-04-26 03:16:08