Trace number 1720626

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
tts tts-5-0? (MO) 364.995 365.173

General information on the benchmark

Namecmu-bmc-longmult15.cnf
MD5SUM21b49b73035bb6e7a1dd17830907ac9d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3.67244
Satisfiable
(Un)Satisfiability was proved
Number of variables7807
Number of clauses24351
Sum of the clauses size58557
Maximum clause length18
Minimum clause length1
Number of clauses of size 153
Number of clauses of size 216386
Number of clauses of size 36700
Number of clauses of size 4908
Number of clauses of size 516
Number of clauses of size over 5288

Solver Data

0.09/0.13	c Command: HOME/tts-5-0 HOME/instance-1720626-1240658468.cnf 
0.09/0.13	c Using SATTIMEOUT of 1200
0.09/0.13	c Using SATRAM of 1800
0.09/0.13	c Size of subset node = 16
0.09/0.13	c Variables = 7807
0.09/0.13	c Clauses = 24351
0.09/0.13	c Literals = 58557
0.09/0.13	c Reduced size:
0.09/0.13	c Variables = 7807
0.09/0.13	c Clauses = 22375
0.09/0.13	c Literals = 53147
0.09/0.13	c a2
0.09/0.17	c a1
0.89/0.94	c Independent sub-problems = 1
0.89/0.94	c Sub-problem with 7447 variables and 22375 clauses
0.89/0.94	c using permutation method 4
0.89/0.94	c count = 1
0.89/0.94	c Ordering finished 0.920 seconds
0.89/0.94	c mapped 0.940 seconds
0.89/0.94	c permuted 0.940 seconds
0.89/0.94	c about to sort
0.89/0.95	c sorted
0.99/1.09	c clauses now 22375
0.99/1.09	c init finished 0.970 seconds
0.99/1.09	c tree built 1.080 seconds
0.99/1.09	c 
0.99/1.09	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
0.99/1.09	c ---------------------------------|----------------------------------|------------------------------------------------------
0.99/1.09	c ................................ | ..........                       |                        1.1           0.0             
0.99/1.09	c ................................ | ..........                     1 |                        1.1           0.9             
0.99/1.09	c ................................ | ..........                     2 |                        1.1           1.9             
0.99/1.09	c ................................ | ..........                     3 |                        1.1           2.8             
0.99/1.09	c ................................ | ..........                     4 |                        1.1           3.7             
0.99/1.09	c ................................ | ..........                     5 |                        1.1           4.6             
0.99/1.09	c ****............................ | ..........                    21 |                        1.1          19.4            8
0.99/1.09	c ****............................ | ..........                    22 |                        1.1          20.4            8
0.99/1.09	c ****............................ | ..........                    23 |                        1.1          21.3            8
0.99/1.09	c ****............................ | ..........                  1000 | 1                      1.1         925.9           67
23.98/24.02	c ****............................ | ..........               1427000 | 73753                 24.0       59433.6      9813828
47.98/48.04	c ****............................ | ..........               2180000 | 113755                48.0       45388.3     18456066
71.97/72.03	c ****............................ | ..........               2737000 | 153265                72.0       38003.3     27727857
95.96/96.08	c ****............................ | ..........               3328000 | 208147                96.1       34641.4     39367140
119.96/120.03	c ****............................ | *.........               3862000 | 257391               120.0       32180.7     51101368
143.95/144.04	c ****............................ | *.........               4393000 | 305942               144.0       30504.8     62961437
168.04/168.12	c ****............................ | *.........               5033000 | 353480               168.1       29942.3     71948463
192.24/192.39	c ****............................ | *.........               5308000 | 393804               192.4       27594.1     76914127
215.93/216.06	c ****............................ | *.........               5466000 | 409699               216.0       25302.0     79656356
240.02/240.12	c ****............................ | **........               5701000 | 436696               240.1       23746.3     84152224
263.92/264.09	c ****............................ | **........               5966000 | 466167               264.1       22594.2     89117468
287.91/288.07	c ****............................ | **........               6269000 | 498890               288.0       21765.1     95097969
311.91/312.07	c ****............................ | **........               6539000 | 529400               312.0       20956.3    100406345
336.00/336.12	c ****............................ | **........               6882000 | 567377               336.1       20477.9    107161270
359.92/360.16	c ****............................ | ***.......               7192000 | 601431               360.0       19975.6    113552914

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1720626-1240658468/watcher-1720626-1240658468 -o /tmp/evaluation-result-1720626-1240658468/solver-1720626-1240658468 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/tts-5-0 HOME/instance-1720626-1240658468.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.60 2.16 3/64 11346
/proc/meminfo: memFree=1813084/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=1008 CPUtime=0
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 136 0 0 0 0 0 0 0 18 0 1 0 93875898 1032192 120 1992294400 134512640 135191068 4294956224 18446744073709551615 134694054 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 252 121 68 165 0 85 0

[startup+0.103353 s]
/proc/loadavg: 2.02 2.60 2.16 3/64 11346
/proc/meminfo: memFree=1813084/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=2648 CPUtime=0.09
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 521 0 0 0 9 0 0 0 18 0 1 0 93875898 2711552 505 1992294400 134512640 135191068 4294956224 18446744073709551615 134533904 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 662 505 68 165 0 495 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 2648

[startup+0.201363 s]
/proc/loadavg: 2.02 2.60 2.16 3/64 11346
/proc/meminfo: memFree=1813084/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=4660 CPUtime=0.19
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 1056 0 0 0 19 0 0 0 18 0 1 0 93875898 4771840 1039 1992294400 134512640 135191068 4294956224 18446744073709551615 134694054 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 1165 1040 71 165 0 998 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 4660

[startup+0.301372 s]
/proc/loadavg: 2.02 2.60 2.16 3/64 11346
/proc/meminfo: memFree=1813084/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=5188 CPUtime=0.29
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 1182 0 0 0 29 0 0 0 19 0 1 0 93875898 5312512 1165 1992294400 134512640 135191068 4294956224 18446744073709551615 134600620 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 1297 1165 71 165 0 1130 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 5188

[startup+0.701414 s]
/proc/loadavg: 2.02 2.60 2.16 3/64 11346
/proc/meminfo: memFree=1813084/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=5500 CPUtime=0.69
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 1232 0 0 0 69 0 0 0 23 0 1 0 93875898 5632000 1215 1992294400 134512640 135191068 4294956224 18446744073709551615 134555288 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 1375 1215 71 165 0 1208 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 5500

[startup+1.5015 s]
/proc/loadavg: 2.02 2.60 2.16 2/65 11347
/proc/meminfo: memFree=1797588/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=17316 CPUtime=1.49
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 4226 0 0 0 148 1 0 0 25 0 1 0 93875898 17731584 4209 1992294400 134512640 135191068 4294956224 18446744073709551615 134591980 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 4329 4209 89 165 0 4162 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 17316

[startup+3.10567 s]
/proc/loadavg: 2.02 2.60 2.16 2/65 11347
/proc/meminfo: memFree=1793300/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=27736 CPUtime=3.1
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 6792 0 0 0 307 3 0 0 25 0 1 0 93875898 28401664 6775 1992294400 134512640 135191068 4294956224 18446744073709551615 134561493 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 6934 6775 89 165 0 6767 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 27736

[startup+6.30199 s]
/proc/loadavg: 1.94 2.57 2.16 2/65 11347
/proc/meminfo: memFree=1769236/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=52264 CPUtime=6.29
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 12949 0 0 0 624 5 0 0 25 0 1 0 93875898 53518336 12932 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 13066 12932 89 165 0 12899 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 52264

[startup+12.7017 s]
/proc/loadavg: 1.87 2.55 2.15 2/65 11347
/proc/meminfo: memFree=1710748/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=107264 CPUtime=12.69
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 26703 0 0 0 1259 10 0 0 25 0 1 0 93875898 109838336 26686 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 26816 26686 89 165 0 26649 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 107264

[startup+25.502 s]
/proc/loadavg: 1.67 2.47 2.13 2/65 11347
/proc/meminfo: memFree=1629532/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=184732 CPUtime=25.49
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 46081 0 0 0 2530 19 0 0 25 0 1 0 93875898 189165568 46064 1992294400 134512640 135191068 4294956224 18446744073709551615 134710791 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 46183 46064 89 165 0 46016 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 184732

[startup+51.1016 s]
/proc/loadavg: 1.44 2.35 2.10 2/65 11347
/proc/meminfo: memFree=1484764/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=330492 CPUtime=51.07
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 82487 0 0 0 5073 34 0 0 25 0 1 0 93875898 338423808 82470 1992294400 134512640 135191068 4294956224 18446744073709551615 134519773 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 82623 82470 89 165 0 82456 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 330492

[startup+102.302 s]
/proc/loadavg: 1.19 2.14 2.04 2/65 11347
/proc/meminfo: memFree=1117276/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=695104 CPUtime=102.27
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 173659 0 0 0 10155 72 0 0 25 0 1 0 93875898 711786496 173642 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 173776 173642 89 165 0 173609 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 695104

[startup+162.301 s]
/proc/loadavg: 1.07 1.93 1.97 2/65 11347
/proc/meminfo: memFree=654044/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=1158296 CPUtime=162.25
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 289455 0 0 0 16105 120 0 0 25 0 1 0 93875898 1186095104 289438 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 289574 289438 89 165 0 289407 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 1158296

[startup+222.305 s]
/proc/loadavg: 1.02 1.76 1.91 2/65 11347
/proc/meminfo: memFree=501212/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=1310296 CPUtime=222.23
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 327484 0 0 0 22088 135 0 0 25 0 1 0 93875898 1341743104 327467 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 327574 327467 89 165 0 327407 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 1310296

[startup+282.301 s]
/proc/loadavg: 1.01 1.62 1.85 2/65 11347
/proc/meminfo: memFree=290652/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=1522456 CPUtime=282.21
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 380520 0 0 0 28064 157 0 0 25 0 1 0 93875898 1558994944 380503 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 380614 380503 89 165 0 380447 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 1522456

[startup+342.302 s]
/proc/loadavg: 1.00 1.50 1.79 2/65 11347
/proc/meminfo: memFree=48988/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=1762472 CPUtime=342.2
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 440479 0 0 0 34039 181 0 0 25 0 1 0 93875898 1804771328 440462 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 440618 440462 89 165 0 440451 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 1762472



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+364.902 s]
/proc/loadavg: 1.00 1.46 1.77 2/65 11347
/proc/meminfo: memFree=15388/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=1843432 CPUtime=364.72
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4194304 460703 0 0 0 36282 190 0 0 25 0 1 0 93875898 1887674368 460686 1992294400 134512640 135191068 4294956224 18446744073709551615 134562394 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 460858 460686 89 165 0 460691 0
Current children cumulated CPU time (s) 364.72
Current children cumulated vsize (KiB) 1843432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+365.102 s]
/proc/loadavg: 1.00 1.46 1.77 2/65 11347
/proc/meminfo: memFree=15388/2055920 swapFree=4192952/4192956
[pid=11346] ppid=11344 vsize=0 CPUtime=364.91
/proc/11346/stat : 11346 (tts-5-0) R 11344 11346 11003 0 -1 4195332 460703 0 0 0 36282 209 0 0 25 0 1 0 93875898 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/11346/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 364.91
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 365.173
CPU time (s): 364.995
CPU user time (s): 362.827
CPU system time (s): 2.16767
CPU usage (%): 99.9512
Max. virtual memory (cumulated for all children) (KiB): 1843432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 362.827
system time used= 2.16767
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 460703
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 481

runsolver used 0.263959 second user time and 0.809876 second system time

The end

Launcher Data

Begin job on node90 at 2009-04-25 13:21:08
IDJOB=1720626
IDBENCH=69621
IDSOLVER=505
FILE ID=node90/1720626-1240658468
PBS_JOBID= 9186521
Free space on /tmp= 66524 MiB

SOLVER NAME= tts tts-5-0
BENCH NAME= SAT_RACE08/cnf/cmu-bmc-longmult15.cnf
COMMAND LINE= HOME/tts-5-0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1720626-1240658468/watcher-1720626-1240658468 -o /tmp/evaluation-result-1720626-1240658468/solver-1720626-1240658468 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/tts-5-0 HOME/instance-1720626-1240658468.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 21b49b73035bb6e7a1dd17830907ac9d
RANDOM SEED=667731770

node90.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1813500 kB
Buffers:         11128 kB
Cached:         144180 kB
SwapCached:          4 kB
Active:          34688 kB
Inactive:       137936 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1813500 kB
SwapTotal:     4192956 kB
SwapFree:      4192952 kB
Dirty:            1280 kB
Writeback:           0 kB
Mapped:          24036 kB
Slab:            55736 kB
Committed_AS:   220968 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66524 MiB
End job on node90 at 2009-04-25 13:27:15