Trace number 3322021

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (TO) 40000.4 5017.66

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S2124915970-046.UNKNOWN.cnf
MD5SUMe6a3a97a5be52c43f493d905174d1bee
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3322021-1304370853.cnf
0.31/0.47	c INFO: computing task features
0.31/0.48	c INFO: computed variable-clause graph statistics
0.31/0.48	c INFO: computed clause balance statistics
0.40/0.57	c INFO: computed variable balance statistics
0.50/0.61	c INFO: computed small-clause counts
0.50/0.61	c INFO: computed Horn-clause counts
0.50/0.62	c INFO: computed variable graph statistics
0.50/0.62	c INFO: collected features for HOME/instance-3322021-1304370853.cnf in 0.15 s
0.50/0.65	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.63)
0.50/0.69	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.08)
0.60/0.73	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.35)
0.60/0.77	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.31)
0.70/0.81	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.23)
0.70/0.85	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.20)
0.70/0.89	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.15)
0.80/0.93	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.03)
800.48/100.92	c INFO: running kcnfs-2006@0 for 582 with 39899 remaining (b = 0.18)
800.48/100.96	c INFO: running march_hi@0 for 388 with 39899 remaining (b = 0.12)
802.91/101.21	c INFO: running march_hi@0 for 388 with 39899 remaining (b = 0.10)
3110.98/390.47	c INFO: running adaptg2wsat2009++@0 for 97 with 39610 remaining (b = 0.03)
3897.81/489.02	c INFO: running march_hi@0 for 291 with 39511 remaining (b = 0.08)
3908.95/490.43	c INFO: running march_hi@0 for 97 with 39510 remaining (b = 0.03)
3911.31/490.74	c INFO: running march_hi@99 for 97 with 39509 remaining (b = 0.04)
3920.09/491.89	c INFO: running march_hi@389 for 97 with 39508 remaining (b = 0.04)
3967.20/497.78	c INFO: running march_hi@0 for 291 with 39502 remaining (b = 0.11)
4685.46/587.75	c INFO: running march_hi@99 for 97 with 39412 remaining (b = 0.04)
4696.63/589.19	c INFO: running march_hi@487 for 194 with 39411 remaining (b = 0.07)
4710.14/590.89	c INFO: running march_hi@877 for 1261 with 39409 remaining (b = 0.39)
5436.41/681.84	c INFO: running march_hi@0 for 291 with 39318 remaining (b = 0.11)
5438.07/682.04	c INFO: running march_hi@0 for 291 with 39318 remaining (b = 0.12)
5484.30/687.89	c INFO: running march_hi@197 for 194 with 39312 remaining (b = 0.09)
5486.68/688.17	c INFO: running kcnfs-2006@100 for 97 with 39312 remaining (b = 0.03)
6226.49/780.83	c INFO: running march_hi@388 for 97 with 39219 remaining (b = 0.06)
6247.20/783.41	c INFO: running kcnfs-2006@391 for 194 with 39217 remaining (b = 0.12)
6288.81/788.71	c INFO: running march_hi@584 for 97 with 39211 remaining (b = 0.06)
6302.25/790.31	c INFO: running march_hi@97 for 97 with 39210 remaining (b = 0.04)
7019.70/880.28	c INFO: running march_hi@0 for 388 with 39120 remaining (b = 0.12)
7020.49/880.37	c INFO: running march_hi@482 for 97 with 39120 remaining (b = 0.05)
7086.72/888.60	c INFO: running march_hi@876 for 97 with 39111 remaining (b = 0.03)
7094.70/889.62	c INFO: running march_hi@286 for 194 with 39110 remaining (b = 0.08)
7777.01/975.13	c INFO: running march_hi@783 for 1358 with 39025 remaining (b = 0.37)
7777.01/975.18	c INFO: running march_hi@99 for 291 with 39025 remaining (b = 0.10)
7812.07/979.55	c INFO: running march_hi@580 for 97 with 39020 remaining (b = 0.03)
7822.45/980.87	c INFO: running kcnfs-2006@589 for 194 with 39019 remaining (b = 0.06)
7832.03/982.08	c INFO: running march_hi@974 for 1164 with 39018 remaining (b = 0.31)
8571.87/1074.73	c INFO: running kcnfs-2006@0 for 582 with 38925 remaining (b = 0.16)
8657.99/1085.52	c INFO: running march_hi@579 for 194 with 38914 remaining (b = 0.05)
9350.68/1172.33	c INFO: running kcnfs-2006@682 for 97 with 38828 remaining (b = 0.03)
10088.90/1264.80	c INFO: running march_hi@196 for 97 with 38735 remaining (b = 0.04)
10136.76/1270.83	c INFO: running march_hi@99 for 291 with 38729 remaining (b = 0.10)
10159.09/1273.61	c INFO: running kcnfs-2006@971 for 388 with 38726 remaining (b = 0.10)
10225.34/1281.91	c INFO: running march_hi@0 for 388 with 38718 remaining (b = 0.11)
10890.11/1365.26	c INFO: running march_hi@586 for 97 with 38635 remaining (b = 0.02)
11640.23/1459.21	c INFO: running kcnfs-2006@0 for 582 with 38541 remaining (b = 0.13)
12454.96/1561.39	c INFO: running march_hi@199 for 97 with 38439 remaining (b = 0.03)
13253.76/1661.47	c INFO: running march_hi@298 for 97 with 38339 remaining (b = 0.04)
13270.52/1663.51	c INFO: running kcnfs-2006@1167 for 194 with 38337 remaining (b = 0.06)
13339.16/1672.12	c INFO: running kcnfs-2006@193 for 485 with 38328 remaining (b = 0.11)
13340.74/1672.35	c INFO: running march_hi@100 for 291 with 38328 remaining (b = 0.07)
14038.92/1759.91	c INFO: running march_hi@777 for 1358 with 38240 remaining (b = 0.29)
14797.78/1854.99	c INFO: running kcnfs-2006@1752 for 194 with 38145 remaining (b = 0.09)
14826.51/1858.58	c INFO: running march_hi@1556 for 582 with 38141 remaining (b = 0.22)
15664.44/1963.60	c INFO: running march_hi@198 for 97 with 38036 remaining (b = 0.04)
16311.51/2044.61	c INFO: running kcnfs-2006@289 for 388 with 37955 remaining (b = 0.12)
16373.80/2052.49	c INFO: running kcnfs-2006@3019 for 97 with 37948 remaining (b = 0.07)
16457.55/2062.91	c INFO: running kcnfs-2006@0 for 582 with 37937 remaining (b = 0.13)
17133.49/2147.76	c INFO: running adaptg2wsat2009++@0 for 97 with 37852 remaining (b = 0.02)
17193.22/2155.30	c INFO: running kcnfs-2006@3117 for 2425 with 37845 remaining (b = 0.43)
17214.75/2157.95	c INFO: running march_hi@1069 for 291 with 37842 remaining (b = 0.09)
17932.89/2248.08	c INFO: running kcnfs-2006@0 for 582 with 37752 remaining (b = 0.12)
18669.41/2340.48	c INFO: running march_hi@1076 for 1067 with 37660 remaining (b = 0.27)
19419.47/2434.55	c INFO: running kcnfs-2006@487 for 97 with 37565 remaining (b = 0.06)
19479.33/2442.02	c INFO: running march_hi@1847 for 97 with 37558 remaining (b = 0.10)
19562.91/2452.58	c INFO: running march_hi@1169 for 970 with 37547 remaining (b = 0.27)
20171.11/2528.84	c INFO: running kcnfs-2006@1069 for 291 with 37471 remaining (b = 0.07)
20261.95/2540.21	c INFO: running march_hi@2140 for 97 with 37460 remaining (b = 0.05)
21019.96/2635.33	c INFO: running march_hi@782 for 1358 with 37365 remaining (b = 0.27)
21186.55/2656.28	c INFO: running kcnfs-2006@582 for 194 with 37344 remaining (b = 0.05)
22559.90/2828.56	c INFO: running kcnfs-2006@95 for 485 with 37171 remaining (b = 0.12)
22646.76/2839.50	c INFO: running kcnfs-2006@1166 for 194 with 37161 remaining (b = 0.06)
22769.48/2854.82	c INFO: running kcnfs-2006@876 for 97 with 37145 remaining (b = 0.03)
23528.34/2950.10	c INFO: running kcnfs-2006@0 for 582 with 37050 remaining (b = 0.13)
24189.11/3033.01	c INFO: running kcnfs-2006@1360 for 582 with 36967 remaining (b = 0.12)
24917.62/3124.47	c INFO: running kcnfs-2006@0 for 582 with 36876 remaining (b = 0.12)
26442.43/3315.72	c INFO: running kcnfs-2006@682 for 97 with 36684 remaining (b = 0.02)
27181.30/3408.49	c INFO: running march_hi@1466 for 679 with 36592 remaining (b = 0.19)
27249.87/3417.03	c INFO: running kcnfs-2006@1749 for 194 with 36583 remaining (b = 0.05)
27506.53/3449.29	c INFO: running march_hi@1263 for 97 with 36551 remaining (b = 0.04)
28194.37/3535.51	c INFO: running kcnfs-2006@193 for 485 with 36465 remaining (b = 0.10)
28297.23/3548.48	c INFO: running march_hi@1848 for 97 with 36452 remaining (b = 0.08)
28824.12/3614.53	c INFO: running kcnfs-2006@2720 for 388 with 36386 remaining (b = 0.11)
28846.36/3617.36	c INFO: running march_hi@0 for 388 with 36383 remaining (b = 0.08)
29046.41/3642.43	c INFO: running march_hi@2040 for 97 with 36358 remaining (b = 0.12)
29599.54/3711.84	c INFO: running kcnfs-2006@487 for 97 with 36288 remaining (b = 0.06)
29848.22/3743.04	c INFO: running kcnfs-2006@2720 for 97 with 36257 remaining (b = 0.02)
30359.19/3807.13	c INFO: running gnovelty+2@0 for 97 with 36193 remaining (b = 0.02)
30623.69/3840.35	c INFO: running march_hi@966 for 1261 with 36160 remaining (b = 0.22)
31158.45/3907.45	c INFO: running kcnfs-2006@0 for 582 with 36093 remaining (b = 0.10)
31858.30/3995.24	c INFO: running march_hi@1365 for 776 with 36005 remaining (b = 0.20)
31932.31/4004.51	c INFO: running march_hi@680 for 1455 with 35996 remaining (b = 0.23)
32043.08/4018.45	c INFO: running march_hi@92 for 194 with 35982 remaining (b = 0.05)
32100.44/4025.68	c INFO: running kcnfs-2006@291 for 291 with 35974 remaining (b = 0.08)
32612.18/4089.85	c INFO: running march_hi@0 for 291 with 35910 remaining (b = 0.07)
33637.75/4218.51	c INFO: running march_hi@1566 for 582 with 35782 remaining (b = 0.14)
34425.85/4317.49	c INFO: running kcnfs-2006@3301 for 1940 with 35683 remaining (b = 0.29)
34958.81/4384.36	c INFO: running march_hi@199 for 97 with 35616 remaining (b = 0.04)
35753.99/4484.18	c INFO: running kcnfs-2006@2815 for 291 with 35516 remaining (b = 0.07)
35839.25/4494.87	c INFO: running FH@0 for 97 with 35505 remaining (b = 0.01)
36638.50/4595.22	c INFO: running march_hi@2625 for 2134 with 35405 remaining (b = 0.27)
36746.77/4608.85	c INFO: running kcnfs-2006@4281 for 1552 with 35391 remaining (b = 0.32)
38053.95/4773.06	c INFO: running march_hi@1754 for 388 with 35227 remaining (b = 0.15)
38061.20/4773.96	c INFO: running kcnfs-2006@586 for 194 with 35226 remaining (b = 0.03)
38275.25/4800.86	c INFO: running march_hi@1856 for 97 with 35199 remaining (b = 0.05)
39076.99/4901.52	c INFO: running march_hi@1955 for 194 with 35099 remaining (b = 0.13)
39602.37/4967.52	c INFO: running kcnfs-2006@0 for 582 with 35033 remaining (b = 0.09)

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

Sorry, but this trace is too large and cannot be obtained.

Launcher Data

Begin job on node103 at 2011-05-02 23:14:13
IDJOB=3322021
IDBENCH=82799
IDSOLVER=1712
FILE ID=node103/3322021-1304370853
RUNJOBID= node103-1304366469-12781
PBS_JOBID= 13181767
Free space on /tmp= 73456 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S2124915970-046.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322021-1304370853/watcher-3322021-1304370853 -o /tmp/evaluation-result-3322021-1304370853/solver-3322021-1304370853 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322021-1304370853.cnf -seed 1811743000 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e6a3a97a5be52c43f493d905174d1bee
RANDOM SEED=1811743000

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10079684 kB
Buffers:       2138716 kB
Cached:        8336796 kB
SwapCached:          4 kB
Active:       13566820 kB
Inactive:      8672000 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10079684 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           32860 kB
Writeback:           0 kB
AnonPages:    11763104 kB
Mapped:          27968 kB
Slab:           522228 kB
PageTables:      42020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 62049036 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73420 MiB
End job on node103 at 2011-05-03 00:37:53