Trace number 1773017

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
MXC 2009-03-10UNSAT 117.747 117.804

General information on the benchmark

Nameindustrial/palacios/medium/
blocks-4-ipc5-h22-unknown.cnf
MD5SUM8c6ad18be635cee0d986377c4d06ab11
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark33.034
Satisfiable
(Un)Satisfiability was proved
Number of variables146874
Number of clauses937242
Sum of the clauses size2519136
Maximum clause length417
Minimum clause length1
Number of clauses of size 1125
Number of clauses of size 2791651
Number of clauses of size 3139269
Number of clauses of size 41522
Number of clauses of size 583
Number of clauses of size over 54592

Solver Data 

117.64/117.78	c starting MXC with:
117.64/117.78	c cnf_path = HOME/instance-1773017-1241298325.cnf
117.64/117.78	c restart_strategy = auto
117.64/117.78	c sign_strategy = cached
117.64/117.78	c use_preprocessing = -1
117.64/117.78	c output_implicant = 1
117.64/117.78	c timeout_seconds = 0
117.64/117.78	c running SatELite... done
117.64/117.78	c 105717 vars eliminated
117.64/117.78	c received 125 units and 724823 clauses from SatELite
117.64/117.78	c 105841 assignments made, starting to guess now
117.64/117.78	c ===================================[MXC]=====================================
117.64/117.78	c | Conflicts |                Clause Statistics                   |   Vars   |
117.64/117.78	c |           |    CARD     BIN      O3+      L3+   L3+Lim  Lit/CL |          |
117.64/117.78	c =============================================================================
117.64/117.78	c |         0 |       0  558402   166421        0        0     nan |   148153 |
117.64/117.78	c |       100 |       0  558404   166421       98     1050     9.7 |    42312 |
117.64/117.78	c |       210 |       0  558406   166421      206     1105    12.4 |    42312 |
117.64/117.78	c |       441 |       0  558409   166421      434     1220    76.0 |    42312 |
117.64/117.78	c |       805 |       0  558411   166421      796     1402    51.2 |    42312 |
117.64/117.78	c |      1315 |       0  558414   166421     1303     1657    44.2 |    42312 |
117.64/117.78	c |      1986 |       0  558438   166421     1950     1993    39.3 |    42312 |
117.64/117.78	c |      2834 |       0  558453   166421     1765     2417    23.0 |    42312 |
117.64/117.78	c |      3876 |       0  558470   166421     2790     2938    27.1 |    42312 |
117.64/117.78	c |      5132 |       0  558488   166421     2484     3566    30.7 |    42312 |
117.64/117.78	c |      6623 |       0  558515   166421     3948     4311    30.2 |    42312 |
117.64/117.78	c |      8373 |       0  558555   166421     3313     5186    25.5 |    42312 |
117.64/117.78	c |     10408 |       0  558583   166421     5320     6204    25.0 |    42312 |
117.64/117.78	c |     12756 |       0  558612   166421     4084     7378    22.4 |    42312 |
117.64/117.78	c |     15449 |       0  558630   166421     6759     8724    21.4 |    42312 |
117.64/117.78	c |     18521 |       0  558671   166421     9790    10260    22.2 |    42312 |
117.64/117.78	c |     22010 |       0  558689   166421     7890    12005    19.0 |    42312 |
117.64/117.78	c |     25958 |       0  558695   166421    11832    13979    18.6 |    42312 |
117.64/117.78	c |     30411 |       0  558713   166421     8197    16205    13.7 |    42312 |
117.64/117.78	c |     35419 |       0  558725   166421    13193    18709    14.9 |    42312 |
117.64/117.78	c |     41038 |       0  558748   166421    18789    21519    15.2 |    42312 |
117.64/117.78	c |     42395 |       0  558764   166421    20122    22197    15.2 |    39032 |
117.64/117.78	c ----- stats for thread 0 -----
117.64/117.78	c restarts: 199
117.64/117.78	c decisions: 87225
117.64/117.78	c propagations: 189840100
117.64/117.78	c conflicts: 42395
117.64/117.78	c 117.756s elapsed
117.64/117.78	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1773017-1241298325/watcher-1773017-1241298325 -o /tmp/evaluation-result-1773017-1241298325/solver-1773017-1241298325 -C 10000 -W 12000 -M 1800 HOME/mxc-sat09 -i HOME/instance-1773017-1241298325.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 12000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.38 3.84 3.87 3/64 1855
/proc/meminfo: memFree=1084972/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=18008 CPUtime=0
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 829 0 0 0 0 0 0 0 18 0 1 0 157865124 18440192 815 1992294400 134512640 135192793 4294956224 18446744073709551615 134779278 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 4502 821 46 166 0 4333 0

[startup+0.0332409 s]
/proc/loadavg: 3.38 3.84 3.87 3/64 1855
/proc/meminfo: memFree=1084972/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=34932 CPUtime=0.02
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 5397 0 0 0 0 2 0 0 18 0 1 0 157865124 35770368 5384 1992294400 134512640 135192793 4294956224 18446744073709551615 134527814 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 8733 5391 50 166 0 8564 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 34932

[startup+0.102246 s]
/proc/loadavg: 3.38 3.84 3.87 3/64 1855
/proc/meminfo: memFree=1084972/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=60472 CPUtime=0.09
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 11095 0 0 0 4 5 0 0 18 0 1 0 157865124 61923328 11010 1992294400 134512640 135192793 4294956224 18446744073709551615 134750438 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 15118 11010 55 166 0 14949 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 60472

[startup+0.301268 s]
/proc/loadavg: 3.38 3.84 3.87 3/64 1855
/proc/meminfo: memFree=1084972/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=74832 CPUtime=0.29
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 14588 0 0 0 23 6 0 0 19 0 1 0 157865124 76627968 14503 1992294400 134512640 135192793 4294956224 18446744073709551615 134750438 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 18708 14503 55 166 0 18539 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 74832

[startup+0.701313 s]
/proc/loadavg: 3.38 3.84 3.87 3/64 1855
/proc/meminfo: memFree=1084972/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=104828 CPUtime=0.69
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 21529 0 0 0 60 9 0 0 23 0 1 0 157865124 107343872 21444 1992294400 134512640 135192793 4294956224 18446744073709551615 134766703 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 26207 21444 55 166 0 26038 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 104828

[startup+1.5024 s]
/proc/loadavg: 3.38 3.84 3.87 2/65 1856
/proc/meminfo: memFree=1004260/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=97748 CPUtime=1.49
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 24495 0 0 0 139 10 0 0 25 0 1 0 157865124 100093952 20119 1992294400 134512640 135192793 4294956224 18446744073709551615 134567904 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 24437 20119 55 166 0 24268 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 97748

[startup+3.10158 s]
/proc/loadavg: 3.38 3.84 3.87 2/65 1856
/proc/meminfo: memFree=1004132/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=106740 CPUtime=3.09
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 26809 0 0 0 298 11 0 0 25 0 1 0 157865124 109301760 22433 1992294400 134512640 135192793 4294956224 18446744073709551615 134750438 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 26685 22435 56 166 0 26516 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 106740

[startup+6.30194 s]
/proc/loadavg: 3.19 3.79 3.86 2/65 1856
/proc/meminfo: memFree=948964/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=157852 CPUtime=6.29
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 39131 0 0 0 612 17 0 0 25 0 1 0 157865124 161640448 34755 1992294400 134512640 135192793 4294956224 18446744073709551615 134573789 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39463 34755 56 166 0 39294 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 157852

[startup+12.7016 s]
/proc/loadavg: 3.01 3.75 3.84 2/65 1856
/proc/meminfo: memFree=942500/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=160928 CPUtime=12.69
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 39991 0 0 0 1252 17 0 0 25 0 1 0 157865124 164790272 35615 1992294400 134512640 135192793 4294956224 18446744073709551615 134567659 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 40232 35615 56 166 0 40063 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 160928

[startup+25.5011 s]
/proc/loadavg: 2.57 3.61 3.79 2/65 1856
/proc/meminfo: memFree=934948/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=168168 CPUtime=25.48
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 42093 0 0 0 2530 18 0 0 25 0 1 0 157865124 172204032 37529 1992294400 134512640 135192793 4294956224 18446744073709551615 134740969 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 42042 37529 56 166 0 41873 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 168168

[startup+51.1019 s]
/proc/loadavg: 2.03 3.40 3.72 2/65 1856
/proc/meminfo: memFree=945188/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=155912 CPUtime=51.07
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 43857 0 0 0 5087 20 0 0 25 0 1 0 157865124 159653888 34943 1992294400 134512640 135192793 4294956224 18446744073709551615 134552317 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 38978 34943 73 166 0 38809 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 155912

[startup+102.307 s]
/proc/loadavg: 1.45 3.03 3.57 2/65 1856
/proc/meminfo: memFree=942820/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=158456 CPUtime=102.25
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44473 0 0 0 10204 21 0 0 25 0 1 0 157865124 162258944 35559 1992294400 134512640 135192793 4294956224 18446744073709551615 134532620 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39614 35559 73 166 0 39445 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 158456

Solver just ended. Dumping a history of the last processes samples

[startup+108.701 s]
/proc/loadavg: 1.41 2.99 3.56 2/65 1856
/proc/meminfo: memFree=942756/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=158456 CPUtime=108.64
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44498 0 0 0 10843 21 0 0 25 0 1 0 157865124 162258944 35584 1992294400 134512640 135192793 4294956224 18446744073709551615 134532620 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39614 35584 73 166 0 39445 0
Current children cumulated CPU time (s) 108.64
Current children cumulated vsize (KiB) 158456

[startup+111.902 s]
/proc/loadavg: 1.38 2.96 3.55 2/65 1856
/proc/meminfo: memFree=942628/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=158768 CPUtime=111.84
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44529 0 0 0 11163 21 0 0 25 0 1 0 157865124 162578432 35615 1992294400 134512640 135192793 4294956224 18446744073709551615 134533834 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39692 35615 73 166 0 39523 0
Current children cumulated CPU time (s) 111.84
Current children cumulated vsize (KiB) 158768

[startup+115.102 s]
/proc/loadavg: 1.35 2.93 3.53 2/65 1856
/proc/meminfo: memFree=942564/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=158900 CPUtime=115.03
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44570 0 0 0 11482 21 0 0 25 0 1 0 157865124 162713600 35656 1992294400 134512640 135192793 4294956224 18446744073709551615 134534215 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39725 35656 73 166 0 39556 0
Current children cumulated CPU time (s) 115.03
Current children cumulated vsize (KiB) 158900

[startup+116.701 s]
/proc/loadavg: 1.35 2.93 3.53 2/65 1856
/proc/meminfo: memFree=942372/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=159036 CPUtime=116.63
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44610 0 0 0 11642 21 0 0 25 0 1 0 157865124 162852864 35696 1992294400 134512640 135192793 4294956224 18446744073709551615 134533186 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39759 35696 73 166 0 39590 0
Current children cumulated CPU time (s) 116.63
Current children cumulated vsize (KiB) 159036

[startup+117.501 s]
/proc/loadavg: 1.35 2.93 3.53 2/65 1856
/proc/meminfo: memFree=942372/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=159036 CPUtime=117.43
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44626 0 0 0 11722 21 0 0 25 0 1 0 157865124 162852864 35712 1992294400 134512640 135192793 4294956224 18446744073709551615 134533227 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39759 35712 73 166 0 39590 0
Current children cumulated CPU time (s) 117.43
Current children cumulated vsize (KiB) 159036

[startup+117.705 s]
/proc/loadavg: 1.35 2.93 3.53 2/65 1856
/proc/meminfo: memFree=942244/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=159228 CPUtime=117.64
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194304 44644 0 0 0 11743 21 0 0 25 0 1 0 157865124 163049472 35730 1992294400 134512640 135192793 4294956224 18446744073709551615 134532659 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 39807 35730 73 166 0 39638 0
Current children cumulated CPU time (s) 117.64
Current children cumulated vsize (KiB) 159228

[startup+117.801 s]
/proc/loadavg: 1.35 2.93 3.53 2/65 1856
/proc/meminfo: memFree=942244/2055920 swapFree=4181296/4192956
[pid=1855] ppid=1853 vsize=0 CPUtime=117.73
/proc/1855/stat : 1855 (mxc-sat09) R 1853 1855 1814 0 -1 4194308 44649 0 0 0 11750 23 0 0 25 0 1 0 157865124 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 0 0 0
/proc/1855/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 117.73
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 117.804
CPU time (s): 117.747
CPU user time (s): 117.507
CPU system time (s): 0.239963
CPU usage (%): 99.9514
Max. virtual memory (cumulated for all children) (KiB): 169184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 117.507
system time used= 0.239963
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 44649
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 273

runsolver used 0.104984 second user time and 0.331949 second system time

The end

Launcher Data 

Begin job on node35 at 2009-05-02 23:05:26
IDJOB=1773017
IDBENCH=20430
IDSOLVER=613
FILE ID=node35/1773017-1241298325
PBS_JOBID= 9225181
Free space on /tmp= 66540 MiB

SOLVER NAME= MXC 2009-03-10
BENCH NAME= SAT07/industrial/palacios/medium/blocks-4-ipc5-h22-unknown.cnf
COMMAND LINE= HOME/mxc-sat09 -i BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1773017-1241298325/watcher-1773017-1241298325 -o /tmp/evaluation-result-1773017-1241298325/solver-1773017-1241298325 -C 10000 -W 12000 -M 1800  HOME/mxc-sat09 -i HOME/instance-1773017-1241298325.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 8c6ad18be635cee0d986377c4d06ab11
RANDOM SEED=1719179670

node35.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1085452 kB
Buffers:         94020 kB
Cached:         766732 kB
SwapCached:       5500 kB
Active:          96460 kB
Inactive:       772104 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1085452 kB
SwapTotal:     4192956 kB
SwapFree:      4181296 kB
Dirty:           18020 kB
Writeback:           0 kB
Mapped:          13488 kB
Slab:            87960 kB
Committed_AS:   756500 kB
PageTables:       1396 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66540 MiB
End job on node35 at 2009-05-02 23:07:24