Trace number 329871

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat SAT 2007 (with assertions)UNSAT 100.848 100.874

General information on the benchmark

Nameindustrial/IBM_FV_2002_31_1_rule_1/
SAT_dat.k25.cnf
MD5SUMd10c82c196802e1e81b346181f7034df
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark77.3352
Satisfiable
(Un)Satisfiability was proved
Number of variables36005
Number of clauses160448
Sum of the clauses size412614
Maximum clause length20
Minimum clause length1
Number of clauses of size 1303
Number of clauses of size 2124826
Number of clauses of size 317687
Number of clauses of size 47200
Number of clauses of size 53144
Number of clauses of size over 57288

Solver Data (download as text)

0.00/0.00	c This is MiniSat 2.0 (Feb 1 2007, SAT-Competition version)
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Number of variables:  36005                                                |
0.00/0.00	c |  Number of clauses:    160448                                               |
0.19/0.23	c |  Parsing time:         0.22         s                                       |
0.89/0.93	c ============================[ Search Statistics ]==============================
0.89/0.93	c | Conflicts |          ORIGINAL         |          LEARNT          | Progress |
0.89/0.93	c |           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
0.89/0.93	c ===============================================================================
0.89/0.93	c |         0 |    9221    62274   208075 |    20758        0    nan |  0.000 % |
0.89/0.96	c |       100 |    9221    62274   208075 |    22833      100      6 | 22.530 % |
0.89/0.99	c |       251 |    9220    62274   208075 |    25117      250      6 | 22.541 % |
0.99/1.03	c |       476 |    9217    62274   208075 |    27628      473      7 | 22.550 % |
0.99/1.07	c |       813 |    9216    62274   208075 |    30391      809      7 | 22.552 % |
1.10/1.15	c |      1320 |    9203    62274   208075 |    33430     1313      8 | 22.608 % |
1.20/1.28	c |      2079 |    9191    61928   207072 |    36774     2068      8 | 22.636 % |
1.39/1.49	c |      3219 |    9175    61846   206838 |    40451     3203     10 | 22.669 % |
1.79/1.86	c |      4927 |    9164    61724   206504 |    44496     4904     14 | 22.694 % |
2.39/2.49	c |      7489 |    9161    61687   206390 |    48946     7465     21 | 22.697 % |
3.59/3.65	c |     11333 |    9045    60620   203030 |    53840    11288     24 | 23.019 % |
5.89/5.98	c |     17100 |    8960    60048   201400 |    59224    17045     34 | 23.441 % |
11.19/11.28	c |     25749 |    8887    59470   199533 |    65147    25679     43 | 23.466 % |
19.59/19.68	c |     38725 |    8879    59391   199319 |    71662    38649     51 | 23.536 % |
36.39/36.42	c |     58187 |    8846    59113   198468 |    78828    58096     55 | 23.580 % |
72.18/72.24	c |     87379 |    8841    59052   198292 |    86711    87213     58 | 23.586 % |
100.66/100.79	c ===============================================================================
100.66/100.79	c restarts              : 16
100.66/100.79	c conflicts             : 110810         (1101 /sec)
100.66/100.79	c decisions             : 206850         (1.17 % random) (2054 /sec)
100.66/100.79	c propagations          : 56122780       (557389 /sec)
100.66/100.79	c conflict literals     : 6314848        (49.94 % deleted)
100.66/100.79	c Memory used           : 39.13 MB
100.66/100.79	c CPU time              : 100.689 s
100.66/100.79	c 
100.76/100.87	s UNSATISFIABLE

Verifier Data (download as text)

No possible verification on an UNSAT instance

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node4/watcher-329871-1173151556 -o ROOT/results/node4/solver-329871-1173151556 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/329871-1173151556/minisat /tmp/evaluation/329871-1173151556/instance-329871-1173151556.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 20354
/proc/meminfo: memFree=1816160/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=1756 CPUtime=0
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 335 0 0 0 0 0 0 0 18 0 1 0 335110472 1798144 319 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134520578 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 439 319 50 138 0 298 0

[startup+0.104053 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 20354
/proc/meminfo: memFree=1816160/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=7824 CPUtime=0.09
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 1784 0 0 0 9 0 0 0 18 0 1 0 335110472 8011776 1769 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134707275 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 1956 1769 58 138 0 1815 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7824

[startup+0.201061 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 20354
/proc/meminfo: memFree=1816160/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=13816 CPUtime=0.19
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 3130 0 0 0 18 1 0 0 18 0 1 0 335110472 14147584 3114 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134707275 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 3454 3115 58 138 0 3313 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 13816

[startup+0.30107 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 20354
/proc/meminfo: memFree=1816160/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=15536 CPUtime=0.29
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 3592 0 0 0 28 1 0 0 19 0 1 0 335110472 15908864 3576 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134527247 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 3884 3576 72 138 0 3743 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 15536

[startup+0.701108 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 20354
/proc/meminfo: memFree=1816160/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=22192 CPUtime=0.69
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 5175 0 0 0 67 2 0 0 23 0 1 0 335110472 22724608 5159 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134521250 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 5548 5160 72 138 0 5407 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 22192

[startup+1.50118 s]
/proc/loadavg: 0.92 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1796952/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=20316 CPUtime=1.49
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 5426 0 0 0 147 2 0 0 25 0 1 0 335110472 20803584 4814 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550285 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 5079 4814 74 138 0 4938 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 20316

[startup+3.10134 s]
/proc/loadavg: 0.92 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1796824/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=20316 CPUtime=3.09
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 5426 0 0 0 307 2 0 0 25 0 1 0 335110472 20803584 4814 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550582 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 5079 4814 74 138 0 4938 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 20316

[startup+6.30265 s]
/proc/loadavg: 0.93 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1796632/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=20460 CPUtime=6.29
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 5430 0 0 0 627 2 0 0 25 0 1 0 335110472 20951040 4818 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550642 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 5115 4818 74 138 0 4974 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 20460

[startup+12.7013 s]
/proc/loadavg: 0.93 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1795480/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=21944 CPUtime=12.69
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 5806 0 0 0 1267 2 0 0 25 0 1 0 335110472 22470656 5194 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550573 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 5486 5194 74 138 0 5345 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 21944

[startup+25.5015 s]
/proc/loadavg: 0.95 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1790680/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=26776 CPUtime=25.49
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 6994 0 0 0 2545 4 0 0 25 0 1 0 335110472 27418624 6382 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550582 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 6694 6382 74 138 0 6553 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 26776

[startup+51.1019 s]
/proc/loadavg: 0.96 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1784152/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=33244 CPUtime=51.08
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 8634 0 0 0 5103 5 0 0 25 0 1 0 335110472 34041856 8022 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550573 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 8311 8022 74 138 0 8170 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 33244

Solver just ended. Dumping a history of the last processes samples

[startup+51.2019 s]
/proc/loadavg: 0.96 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1784152/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=33376 CPUtime=51.18
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 8640 0 0 0 5113 5 0 0 25 0 1 0 335110472 34177024 8028 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550582 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 8344 8028 74 138 0 8203 0
Current children cumulated CPU time (s) 51.18
Current children cumulated vsize (KiB) 33376

[startup+76.8014 s]
/proc/loadavg: 0.97 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1778968/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=38436 CPUtime=76.78
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 9947 0 0 0 7671 7 0 0 25 0 1 0 335110472 39358464 9335 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550551 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 9609 9335 74 138 0 9468 0
Current children cumulated CPU time (s) 76.78
Current children cumulated vsize (KiB) 38436

[startup+89.6016 s]
/proc/loadavg: 0.98 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1777496/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=40068 CPUtime=89.57
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 10290 0 0 0 8950 7 0 0 25 0 1 0 335110472 41029632 9678 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134551901 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 10017 9678 74 138 0 9876 0
Current children cumulated CPU time (s) 89.57
Current children cumulated vsize (KiB) 40068

[startup+96.0012 s]
/proc/loadavg: 0.98 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1777496/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=40068 CPUtime=95.96
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 10290 0 0 0 9589 7 0 0 25 0 1 0 335110472 41029632 9678 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134551929 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 10017 9678 74 138 0 9876 0
Current children cumulated CPU time (s) 95.96
Current children cumulated vsize (KiB) 40068

[startup+99.2015 s]
/proc/loadavg: 0.98 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1777496/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=40068 CPUtime=99.16
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 10290 0 0 0 9909 7 0 0 25 0 1 0 335110472 41029632 9678 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550582 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 10017 9678 74 138 0 9876 0
Current children cumulated CPU time (s) 99.16
Current children cumulated vsize (KiB) 40068

[startup+100.003 s]
/proc/loadavg: 0.98 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1777496/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=40068 CPUtime=99.96
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 10290 0 0 0 9989 7 0 0 25 0 1 0 335110472 41029632 9678 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134551872 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 10017 9678 74 138 0 9876 0
Current children cumulated CPU time (s) 99.96
Current children cumulated vsize (KiB) 40068

[startup+100.402 s]
/proc/loadavg: 0.98 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1777496/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=40068 CPUtime=100.36
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 10290 0 0 0 10029 7 0 0 25 0 1 0 335110472 41029632 9678 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134550521 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 10017 9678 74 138 0 9876 0
Current children cumulated CPU time (s) 100.36
Current children cumulated vsize (KiB) 40068

[startup+100.802 s]
/proc/loadavg: 0.98 0.98 0.99 2/78 20355
/proc/meminfo: memFree=1777496/2055920 swapFree=4153444/4192956
[pid=20354] ppid=20352 vsize=40068 CPUtime=100.76
/proc/20354/stat : 20354 (minisat) R 20352 20354 19462 0 -1 4194304 10296 0 0 0 10069 7 0 0 25 0 1 0 335110472 41029632 9683 18446744073709551615 134512640 135078472 4294956704 18446744073709551615 134703540 0 0 4096 3 0 0 0 17 1 0 0
/proc/20354/statm: 10017 9683 79 138 0 9876 0
Current children cumulated CPU time (s) 100.76
Current children cumulated vsize (KiB) 40068

Child status: 0
Real time (s): 100.874
CPU time (s): 100.848
CPU user time (s): 100.762
CPU system time (s): 0.085986
CPU usage (%): 99.9741
Max. virtual memory (cumulated for all children) (KiB): 40068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 100.762
system time used= 0.085986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10296
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 159

runsolver used 0.097985 second user time and 0.277957 second system time

The end

Launcher Data (download as text)

Begin job on node4 on Tue Mar  6 03:25:56 UTC 2007

IDJOB= 329871
IDBENCH= 20550
IDSOLVER= 109
FILE ID= node4/329871-1173151556

PBS_JOBID= 4014997

Free space on /tmp= 66513 MiB

SOLVER NAME= minisat SAT 2007
BENCH NAME= HOME/pub/bench/SAT07/industrial/IBM_FV_2002_31_1_rule_1/SAT_dat.k25.cnf
COMMAND LINE= /tmp/evaluation/329871-1173151556/minisat /tmp/evaluation/329871-1173151556/instance-329871-1173151556.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node4/watcher-329871-1173151556 -o ROOT/results/node4/solver-329871-1173151556 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/329871-1173151556/minisat /tmp/evaluation/329871-1173151556/instance-329871-1173151556.cnf            

META MD5SUM SOLVER= 120abd248b069e44985635f055606c5a
MD5SUM BENCH=  d10c82c196802e1e81b346181f7034df

RANDOM SEED= 578407031

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node4.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1816632 kB
Buffers:         33228 kB
Cached:         128500 kB
SwapCached:       2152 kB
Active:          58108 kB
Inactive:       126488 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1816632 kB
SwapTotal:     4192956 kB
SwapFree:      4153444 kB
Dirty:            4496 kB
Writeback:           0 kB
Mapped:          30716 kB
Slab:            40264 kB
Committed_AS:  1238056 kB
PageTables:       1768 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66513 MiB

End job on node4 on Tue Mar  6 03:27:37 UTC 2007