Trace number 1773452

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
MiniSat 2.1 (Sat-race'08 Edition)UNSAT 285.838 285.944

General information on the benchmark

Namemanol-pipe-g10nid.cnf
MD5SUMd46e452956bc993f202d3b06fd3e858e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark91.7301
Satisfiable
(Un)Satisfiability was proved
Number of variables217725
Number of clauses646228
Sum of the clauses size1507864
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2430818
Number of clauses of size 3215409
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.79/0.88	c |  Number of variables:        217725                                         |
0.79/0.88	c |  Number of clauses:          646227                                         |
0.79/0.88	c |  Parse time:                   0.79 s                                       |
4.69/4.70	c |  Simplification time:          3.78 s                                       |
4.69/4.70	c |                                                                             |
4.69/4.70	c ============================[ Search Statistics ]==============================
4.69/4.70	c | Conflicts |          ORIGINAL         |          LEARNT          | Progress |
4.69/4.70	c |           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
4.69/4.70	c ===============================================================================
4.79/4.80	c |       100 |   46305   288713  1248342 |   105861       93     15 |  0.155 % |
4.89/4.90	c |       250 |   45979   288713  1248342 |   116447      242     11 |  0.305 % |
4.99/5.07	c |       475 |   45979   288713  1248342 |   128092      467     13 |  0.305 % |
5.19/5.29	c |       812 |   45951   288713  1248342 |   140901      803     14 |  0.318 % |
5.49/5.60	c |      1318 |   45935   288713  1248342 |   154991     1305     16 |  0.325 % |
6.19/6.21	c |      2077 |   45935   282494  1225985 |   170490     2033     16 |  0.325 % |
6.69/6.74	c |      3216 |   45595   279193  1213050 |   187539     3111     18 |  0.481 % |
7.29/7.35	c |      4924 |   45304   275911  1197848 |   206293     4352     19 |  0.615 % |
7.99/8.02	c |      7486 |   44996   273901  1189111 |   226923     6876     22 |  0.756 % |
8.99/9.07	c |     11330 |   44948   272388  1183401 |   249615    10677     23 |  0.779 % |
10.89/10.96	c |     17096 |   44667   271608  1180810 |   274577    16428     25 |  0.908 % |
13.39/13.43	c |     25745 |   44273   267033  1159546 |   302035    24959     27 |  1.089 % |
16.89/16.97	c |     38719 |   43723   261453  1132633 |   332238    37598     30 |  1.341 % |
21.69/21.78	c |     58180 |   43486   259220  1121479 |   365462    56755     29 |  1.450 % |
29.28/29.39	c |     87372 |   43126   256239  1107342 |   402008    85754     31 |  1.615 % |
41.78/41.82	c |    131161 |   42854   253778  1098417 |   442209   129341     35 |  1.740 % |
62.47/62.56	c |    196845 |   42735   252910  1095128 |   486430   194978     37 |  1.795 % |
92.65/92.71	c |    295371 |   42698   252523  1093772 |   535073   293477     41 |  1.812 % |
150.44/150.58	c |    443160 |   42465   250863  1087164 |   588580   441069     42 |  1.919 % |
229.51/229.61	c |    664843 |   42284   248965  1080281 |   647438   104025     36 |  2.002 % |
285.79/285.91	c ===============================================================================
285.79/285.91	c restarts              : 1978
285.79/285.91	c conflicts             : 906443         (3178 /sec)
285.79/285.91	c decisions             : 3837291        (13455 /sec)
285.79/285.91	c propagations          : 260651991      (913973 /sec)
285.79/285.91	c conflict literals     : 35171162       (25.54 % deleted)
285.79/285.91	c Memory used           : 179.25 MB
285.79/285.91	c CPU time              : 285.186 s
285.79/285.91	c 
285.79/285.91	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1773452-1241211417/watcher-1773452-1241211417 -o /tmp/evaluation-result-1773452-1241211417/solver-1773452-1241211417 -C 10000 -W 12000 -M 1800 HOME/minisat HOME/instance-1773452-1241211417.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 12000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 30167
/proc/meminfo: memFree=1146168/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=7608 CPUtime=0
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 422 0 0 0 0 0 0 0 18 0 1 0 149175767 7790592 406 1992294400 4194304 5092341 548682068848 18446744073709551615 4244968 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 1902 407 63 219 0 1680 0

[startup+0.0123581 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 30167
/proc/meminfo: memFree=1146168/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=8236 CPUtime=0
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 606 0 0 0 0 0 0 0 18 0 1 0 149175767 8433664 590 1992294400 4194304 5092341 548682068848 18446744073709551615 4244968 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 2059 590 63 219 0 1837 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8236

[startup+0.101373 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 30167
/proc/meminfo: memFree=1146168/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=15336 CPUtime=0.09
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 2635 0 0 0 8 1 0 0 18 0 1 0 149175767 15704064 2510 1992294400 4194304 5092341 548682068848 18446744073709551615 4270144 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 3834 2510 63 219 0 3612 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15336

[startup+0.301408 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 30167
/proc/meminfo: memFree=1146168/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=29172 CPUtime=0.29
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 6963 0 0 0 26 3 0 0 19 0 1 0 149175767 29872128 6376 1992294400 4194304 5092341 548682068848 18446744073709551615 4270144 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 7293 6377 63 219 0 7071 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 29172

[startup+0.701478 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 30167
/proc/meminfo: memFree=1146168/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=62068 CPUtime=0.69
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 14869 0 0 0 62 7 0 0 23 0 1 0 149175767 63557632 13449 1992294400 4194304 5092341 548682068848 18446744073709551615 4494759 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 15517 13451 63 219 0 15295 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 62068

[startup+1.50162 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1078384/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=85140 CPUtime=1.49
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 20085 0 0 0 140 9 0 0 25 0 1 0 149175767 87183360 18598 1992294400 4194304 5092341 548682068848 18446744073709551615 4270144 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 21285 18598 87 219 0 21063 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 85140

[startup+3.1019 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1062256/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=105176 CPUtime=3.09
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 24519 0 0 0 298 11 0 0 25 0 1 0 149175767 107700224 23032 1992294400 4194304 5092341 548682068848 18446744073709551615 4270144 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 26294 23032 87 219 0 26072 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 105176

[startup+6.30146 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1075120/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=79992 CPUtime=6.29
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 27775 0 0 0 616 13 0 0 25 0 1 0 149175767 81911808 17768 1992294400 4194304 5092341 548682068848 18446744073709551615 4240558 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 19998 17768 102 219 0 19776 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 79992

[startup+12.7016 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1073008/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=83884 CPUtime=12.69
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 28363 0 0 0 1255 14 0 0 25 0 1 0 149175767 85897216 18356 1992294400 4194304 5092341 548682068848 18446744073709551615 4240558 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 20971 18356 103 219 0 20749 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 83884

[startup+25.5018 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1066928/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=89724 CPUtime=25.48
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 29899 0 0 0 2532 16 0 0 25 0 1 0 149175767 91877376 19892 1992294400 4194304 5092341 548682068848 18446744073709551615 4248707 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 22431 19892 103 219 0 22209 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 89724

[startup+51.1013 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1052016/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=111620 CPUtime=51.07
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 33628 0 0 0 5087 20 0 0 25 0 1 0 149175767 114298880 23621 1992294400 4194304 5092341 548682068848 18446744073709551615 4241418 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 27905 23621 103 219 0 27683 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 111620

[startup+102.305 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1014704/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=167636 CPUtime=102.26
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 42915 0 0 0 10195 31 0 0 25 0 1 0 149175767 171659264 32908 1992294400 4194304 5092341 548682068848 18446744073709551615 4241418 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 41909 32908 103 219 0 41687 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 167636

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=969776/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=221780 CPUtime=162.23
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 54431 0 0 0 16181 42 0 0 25 0 1 0 149175767 227102720 44424 1992294400 4194304 5092341 548682068848 18446744073709551615 4241098 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 55445 44424 103 219 0 55223 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 221780

[startup+222.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30168
/proc/meminfo: memFree=1043248/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=124420 CPUtime=222.22
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 63907 0 0 0 22170 52 0 0 25 0 1 0 149175767 127406080 25727 1992294400 4194304 5092341 548682068848 18446744073709551615 4241376 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 31105 25727 103 219 0 30883 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 124420

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30174
/proc/meminfo: memFree=987048/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=183544 CPUtime=282.18
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 78019 0 0 0 28157 61 0 0 25 0 1 0 149175767 187949056 39839 1992294400 4194304 5092341 548682068848 18446744073709551615 4240654 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 45886 39839 103 219 0 45664 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 183544

Solver just ended. Dumping a history of the last processes samples

[startup+283.102 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30174
/proc/meminfo: memFree=986344/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=183544 CPUtime=282.99
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 78148 0 0 0 28237 62 0 0 25 0 1 0 149175767 187949056 39968 1992294400 4194304 5092341 548682068848 18446744073709551615 4240640 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 45886 39968 103 219 0 45664 0
Current children cumulated CPU time (s) 282.99
Current children cumulated vsize (KiB) 183544

[startup+284.701 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30174
/proc/meminfo: memFree=985640/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=183544 CPUtime=284.59
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 78393 0 0 0 28397 62 0 0 25 0 1 0 149175767 187949056 40213 1992294400 4194304 5092341 548682068848 18446744073709551615 4240640 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 45886 40213 103 219 0 45664 0
Current children cumulated CPU time (s) 284.59
Current children cumulated vsize (KiB) 183544

[startup+285.501 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30174
/proc/meminfo: memFree=985000/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=183544 CPUtime=285.39
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 78504 0 0 0 28477 62 0 0 25 0 1 0 149175767 187949056 40324 1992294400 4194304 5092341 548682068848 18446744073709551615 4244137 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 45886 40324 103 219 0 45664 0
Current children cumulated CPU time (s) 285.39
Current children cumulated vsize (KiB) 183544

[startup+285.901 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 30174
/proc/meminfo: memFree=984424/2055920 swapFree=4180136/4192956
[pid=30167] ppid=30165 vsize=183544 CPUtime=285.79
/proc/30167/stat : 30167 (minisat) R 30165 30167 30022 0 -1 4194304 78551 0 0 0 28517 62 0 0 25 0 1 0 149175767 187949056 40371 1992294400 4194304 5092341 548682068848 18446744073709551615 4240648 0 0 4096 3 0 0 0 17 1 0 0
/proc/30167/statm: 45886 40371 103 219 0 45664 0
Current children cumulated CPU time (s) 285.79
Current children cumulated vsize (KiB) 183544

Child status: 20
Real time (s): 285.944
CPU time (s): 285.838
CPU user time (s): 285.186
CPU system time (s): 0.6519
CPU usage (%): 99.9626
Max. virtual memory (cumulated for all children) (KiB): 241228

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 285.186
system time used= 0.6519
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 78562
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 558

runsolver used 0.241963 second user time and 0.571913 second system time

The end

Launcher Data 

Begin job on node4 at 2009-05-01 22:56:58
IDJOB=1773452
IDBENCH=69595
IDSOLVER=608
FILE ID=node4/1773452-1241211417
PBS_JOBID= 9224723
Free space on /tmp= 66376 MiB

SOLVER NAME= MiniSat 2.1 (Sat-race'08 Edition)
BENCH NAME= SAT_RACE08/cnf/manol-pipe-g10nid.cnf
COMMAND LINE= HOME/minisat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1773452-1241211417/watcher-1773452-1241211417 -o /tmp/evaluation-result-1773452-1241211417/solver-1773452-1241211417 -C 10000 -W 12000 -M 1800  HOME/minisat HOME/instance-1773452-1241211417.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= d46e452956bc993f202d3b06fd3e858e
RANDOM SEED=790456401

node4.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1146648 kB
Buffers:         73300 kB
Cached:         760616 kB
SwapCached:       7244 kB
Active:         252204 kB
Inactive:       590924 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1146648 kB
SwapTotal:     4192956 kB
SwapFree:      4180136 kB
Dirty:           12532 kB
Writeback:           0 kB
Mapped:          13572 kB
Slab:            52028 kB
Committed_AS:   852020 kB
PageTables:       1492 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66376 MiB
End job on node4 at 2009-05-01 23:01:44