Trace number 1738044

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
clasp 1.2.0-SAT09-32SAT 22.4556 22.4578

General information on the benchmark

NameCRAFTED/sgi/
new-difficult-24-193-22-70.cnf
MD5SUM0a7df8011edd7a5f3da371261f9b3f8b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.2858
Satisfiable
(Un)Satisfiability was proved
Number of variables528
Number of clauses30728
Sum of the clauses size61940
Maximum clause length24
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 230706
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 522

Solver Data 

22.39/22.44	c clasp version 1.2.0-SAT09 
22.39/22.44	c Reading from ...835222/instance-1738044-1240835222.cnf
22.39/22.44	c Reading      : Done(0.010s)
22.39/22.44	c Preprocessing: |-\Done(0.130s)
22.39/22.44	c Solving...
22.39/22.44	c Model: 1
22.39/22.44	v 1 -2 -3 -4 -5 -6 -7 -8 -9 -10
22.39/22.44	v -11 -12 -13 -14 -15 -16 -17 -18 -19 -20
22.39/22.44	v -21 -22 -23 -24 -25 26 -27 -28 -29 -30
22.39/22.44	v -31 -32 -33 -34 -35 -36 -37 -38 -39 -40
22.39/22.44	v -41 -42 -43 -44 -45 -46 -47 -48 -49 -50
22.39/22.44	v 51 -52 -53 -54 -55 -56 -57 -58 -59 -60
22.39/22.44	v -61 -62 -63 -64 -65 -66 -67 -68 -69 -70
22.39/22.44	v -71 -72 -73 -74 -75 76 -77 -78 -79 -80
22.39/22.44	v -81 -82 -83 -84 -85 -86 -87 -88 -89 -90
22.39/22.44	v -91 -92 -93 -94 -95 -96 -97 -98 -99 -100
22.39/22.44	v -101 102 -103 -104 -105 -106 -107 -108 -109 -110
22.39/22.44	v -111 -112 -113 -114 -115 -116 -117 -118 -119 -120
22.39/22.44	v -121 -122 -123 -124 -125 -126 127 -128 -129 -130
22.39/22.44	v -131 -132 -133 -134 -135 -136 -137 -138 -139 -140
22.39/22.44	v -141 -142 -143 -144 -145 -146 -147 -148 -149 -150
22.39/22.44	v -151 152 -153 -154 -155 -156 -157 -158 -159 -160
22.39/22.44	v -161 -162 -163 -164 -165 -166 -167 -168 -169 -170
22.39/22.44	v -171 -172 -173 -174 -175 -176 177 -178 -179 -180
22.39/22.44	v -181 -182 -183 -184 -185 -186 -187 -188 -189 -190
22.39/22.44	v -191 -192 -193 -194 -195 -196 -197 -198 -199 -200
22.39/22.44	v -201 202 -203 -204 -205 -206 -207 -208 -209 -210
22.39/22.44	v -211 -212 -213 -214 -215 -216 -217 -218 -219 -220
22.39/22.44	v -221 -222 -223 -224 -225 -226 227 -228 -229 -230
22.39/22.44	v -231 -232 -233 -234 -235 -236 -237 -238 -239 -240
22.39/22.44	v -241 -242 -243 -244 -245 -246 -247 -248 -249 -250
22.39/22.44	v -251 252 -253 -254 -255 -256 -257 -258 -259 -260
22.39/22.44	v -261 -262 -263 -264 -265 -266 -267 -268 -269 -270
22.39/22.44	v -271 -272 -273 -274 -275 -276 277 -278 -279 -280
22.39/22.44	v -281 -282 -283 -284 -285 -286 -287 -288 -289 -290
22.39/22.44	v -291 -292 -293 -294 -295 -296 -297 -298 -299 -300
22.39/22.44	v -301 302 -303 -304 -305 -306 -307 -308 -309 -310
22.39/22.44	v -311 -312 -313 -314 -315 -316 -317 -318 -319 -320
22.39/22.44	v -321 -322 -323 -324 -325 -326 327 -328 -329 -330
22.39/22.44	v -331 -332 -333 -334 -335 -336 -337 -338 -339 -340
22.39/22.44	v -341 -342 -343 -344 -345 -346 -347 -348 -349 -350
22.39/22.44	v -351 352 -353 -354 -355 -356 -357 -358 -359 -360
22.39/22.44	v -361 -362 -363 -364 -365 -366 -367 -368 -369 -370
22.39/22.44	v -371 -372 -373 -374 -375 -376 377 -378 -379 -380
22.39/22.44	v -381 -382 -383 -384 -385 -386 -387 -388 -389 -390
22.39/22.45	v -391 -392 -393 -394 -395 -396 -397 -398 -399 -400
22.39/22.45	v -401 402 -403 -404 -405 -406 -407 -408 -409 -410
22.39/22.45	v -411 -412 -413 -414 -415 -416 -417 -418 -419 -420
22.39/22.45	v -421 -422 -423 -424 -425 -426 427 -428 -429 -430
22.39/22.45	v -431 -432 -433 -434 -435 -436 -437 -438 -439 -440
22.39/22.45	v -441 -442 -443 -444 -445 -446 -447 -448 -449 -450
22.39/22.45	v -451 452 -453 -454 -455 -456 -457 -458 -459 -460
22.39/22.45	v -461 -462 -463 -464 -465 -466 -467 -468 -469 -470
22.39/22.45	v -471 -472 -473 -474 -475 -476 477 -478 -479 -480
22.39/22.45	v -481 -482 -483 -484 -485 -486 -487 -488 -489 -490
22.39/22.45	v -491 -492 -493 -494 -495 -496 -497 -498 -499 -500
22.39/22.45	v -501 502 -503 -504 -505 -506 -507 -508 -509 -510
22.39/22.45	v -511 -512 -513 -514 -515 -516 -517 -518 -519 -520
22.39/22.45	v -521 -522 -523 -524 -525 -526 527 -528 0 
22.39/22.45	
22.39/22.45	c Models    : 1+    
22.39/22.45	c Time         : 22.440s (Solve: 22.300s)
22.39/22.45	s SATISFIABLE

Verifier Data 

OK

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1738044-1240835222/watcher-1738044-1240835222 -o /tmp/evaluation-result-1738044-1240835222/solver-1738044-1240835222 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/clasp --file=HOME/instance-1738044-1240835222.cnf --dimacs --number=1 --sat-p=20,25,150 --hParam=0,512 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 1472
/proc/meminfo: memFree=1652272/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=1836 CPUtime=0
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 238 0 0 0 0 0 0 0 18 0 1 0 111555586 1880064 222 1992294400 134512640 136057169 4294956160 18446744073709551615 135443142 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 492 223 144 377 0 112 0

[startup+0.0744301 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 1472
/proc/meminfo: memFree=1652272/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=3312 CPUtime=0.06
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 594 0 0 0 6 0 0 0 18 0 1 0 111555586 3391488 578 1992294400 134512640 136057169 4294956160 18446744073709551615 134774448 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 828 578 166 377 0 448 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 3312

[startup+0.101421 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 1472
/proc/meminfo: memFree=1652272/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=3312 CPUtime=0.09
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 606 0 0 0 9 0 0 0 18 0 1 0 111555586 3391488 590 1992294400 134512640 136057169 4294956160 18446744073709551615 135443142 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 828 590 168 377 0 448 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 3312

[startup+0.301364 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 1472
/proc/meminfo: memFree=1652272/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=3380 CPUtime=0.29
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 721 0 0 0 29 0 0 0 19 0 1 0 111555586 3461120 643 1992294400 134512640 136057169 4294956160 18446744073709551615 135443142 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 845 643 183 377 0 465 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 3380

[startup+0.70125 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 1472
/proc/meminfo: memFree=1652272/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=5496 CPUtime=0.69
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 1252 0 0 0 69 0 0 0 23 0 1 0 111555586 5627904 1174 1992294400 134512640 136057169 4294956160 18446744073709551615 134618241 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 1374 1174 183 377 0 994 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 5496

[startup+1.50102 s]
/proc/loadavg: 0.92 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1647080/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=6948 CPUtime=1.49
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 1592 0 0 0 148 1 0 0 25 0 1 0 111555586 7114752 1514 1992294400 134512640 136057169 4294956160 18446744073709551615 134618270 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 1737 1514 183 377 0 1357 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 6948

[startup+3.10157 s]
/proc/loadavg: 0.92 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1645872/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=8692 CPUtime=3.09
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 2033 0 0 0 308 1 0 0 25 0 1 0 111555586 8900608 1955 1992294400 134512640 136057169 4294956160 18446744073709551615 134823844 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 2173 1955 183 377 0 1793 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 8692

[startup+6.30266 s]
/proc/loadavg: 0.93 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1643888/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=10428 CPUtime=6.29
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 2465 0 0 0 628 1 0 0 25 0 1 0 111555586 10678272 2387 1992294400 134512640 136057169 4294956160 18446744073709551615 134618238 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 2607 2387 183 377 0 2227 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 10428

[startup+12.7018 s]
/proc/loadavg: 0.93 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1642160/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=11364 CPUtime=12.69
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 2706 0 0 0 1268 1 0 0 25 0 1 0 111555586 11636736 2628 1992294400 134512640 136057169 4294956160 18446744073709551615 134823938 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 2841 2628 183 377 0 2461 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 11364

Solver just ended. Dumping a history of the last processes samples

[startup+19.101 s]
/proc/loadavg: 0.94 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1639728/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=13912 CPUtime=19.09
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 3309 0 0 0 1907 2 0 0 25 0 1 0 111555586 14245888 3231 1992294400 134512640 136057169 4294956160 18446744073709551615 134823873 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 3478 3231 183 377 0 3098 0
Current children cumulated CPU time (s) 19.09
Current children cumulated vsize (KiB) 13912

[startup+20.7016 s]
/proc/loadavg: 0.94 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1639728/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=15100 CPUtime=20.69
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 3624 0 0 0 2067 2 0 0 25 0 1 0 111555586 15462400 3546 1992294400 134512640 136057169 4294956160 18446744073709551615 134823794 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 3775 3546 183 377 0 3395 0
Current children cumulated CPU time (s) 20.69
Current children cumulated vsize (KiB) 15100

[startup+21.5013 s]
/proc/loadavg: 0.94 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1638512/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=15100 CPUtime=21.49
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 3624 0 0 0 2147 2 0 0 25 0 1 0 111555586 15462400 3546 1992294400 134512640 136057169 4294956160 18446744073709551615 134618307 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 3775 3546 183 377 0 3395 0
Current children cumulated CPU time (s) 21.49
Current children cumulated vsize (KiB) 15100

[startup+21.9012 s]
/proc/loadavg: 0.94 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1638512/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=15100 CPUtime=21.89
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 3624 0 0 0 2187 2 0 0 25 0 1 0 111555586 15462400 3546 1992294400 134512640 136057169 4294956160 18446744073709551615 134618499 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 3775 3546 183 377 0 3395 0
Current children cumulated CPU time (s) 21.89
Current children cumulated vsize (KiB) 15100

[startup+22.3011 s]
/proc/loadavg: 0.94 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1638512/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=15100 CPUtime=22.29
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 3624 0 0 0 2227 2 0 0 25 0 1 0 111555586 15462400 3546 1992294400 134512640 136057169 4294956160 18446744073709551615 134823794 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 3775 3546 183 377 0 3395 0
Current children cumulated CPU time (s) 22.29
Current children cumulated vsize (KiB) 15100

[startup+22.4011 s]
/proc/loadavg: 0.94 0.98 0.99 2/65 1473
/proc/meminfo: memFree=1638512/2055920 swapFree=4181400/4192956
[pid=1472] ppid=1470 vsize=15244 CPUtime=22.39
/proc/1472/stat : 1472 (clasp) R 1470 1472 1314 0 -1 4194304 3632 0 0 0 2237 2 0 0 25 0 1 0 111555586 15609856 3554 1992294400 134512640 136057169 4294956160 18446744073709551615 134618250 0 0 4096 16386 0 0 0 17 1 0 0
/proc/1472/statm: 3811 3554 183 377 0 3431 0
Current children cumulated CPU time (s) 22.39
Current children cumulated vsize (KiB) 15244

Child status: 10
Real time (s): 22.4578
CPU time (s): 22.4556
CPU user time (s): 22.4296
CPU system time (s): 0.025996
CPU usage (%): 99.99
Max. virtual memory (cumulated for all children) (KiB): 15244

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 22.4296
system time used= 0.025996
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3636
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 49

runsolver used 0.022996 second user time and 0.050992 second system time

The end

Launcher Data 

Begin job on node16 at 2009-04-27 14:27:02
IDJOB=1738044
IDBENCH=71800
IDSOLVER=508
FILE ID=node16/1738044-1240835222
PBS_JOBID= 9187500
Free space on /tmp= 66404 MiB

SOLVER NAME= clasp 1.2.0-SAT09-32
BENCH NAME= SAT09/CRAFTED/sgi/new-difficult-24-193-22-70.cnf
COMMAND LINE= HOME/clasp --file=BENCHNAME --dimacs --number=1 --sat-p=20,25,150 --hParam=0,512
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1738044-1240835222/watcher-1738044-1240835222 -o /tmp/evaluation-result-1738044-1240835222/solver-1738044-1240835222 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/clasp --file=HOME/instance-1738044-1240835222.cnf --dimacs --number=1 --sat-p=20,25,150 --hParam=0,512

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 0a7df8011edd7a5f3da371261f9b3f8b
RANDOM SEED=1261194044

node16.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1652688 kB
Buffers:         54752 kB
Cached:         267364 kB
SwapCached:       5440 kB
Active:         101740 kB
Inactive:       228356 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1652688 kB
SwapTotal:     4192956 kB
SwapFree:      4181400 kB
Dirty:            2192 kB
Writeback:           0 kB
Mapped:          13636 kB
Slab:            59104 kB
Committed_AS:   442440 kB
PageTables:       1436 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66404 MiB
End job on node16 at 2009-04-27 14:27:24