Trace number 3308848

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver:precosat 236? (TO) 1300.06 1300.04

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
MD5SUM7886cd26d6e0801ea382a1ffd6224023
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables192503
Number of clauses564953
Sum of the clauses size1318221
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2376634
Number of clauses of size 3188317
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data

0.00/0.00	c PicoSATLight Version 236 3e7a3f8825c0b9e241f38a63fee5517540b2feca
0.00/0.00	c Copyright (C) 2009, Armin Biere, JKU, Linz, Austria.  All rights reserved.
0.00/0.00	c Released on Sun Mar 22 10:16:26 CET 2009
0.00/0.00	c Compiled on Tue Mar 24 21:24:39 CET 2009
0.00/0.00	c g++ (GCC) 4.3.2 20081105 (Red Hat 4.3.2-7)
0.00/0.00	c -O3 -m32 -static -Wall -Wextra -DNDEBUG -DNLOGPRECO -DNSTATSPRECO
0.00/0.00	c -finline-limit=10000000 -fomit-frame-pointer -fno-exceptions
0.00/0.00	c Linux baghera 2.6.27.19-170.2.35.fc10.i686.PAE i686
0.00/0.00	c
0.00/0.00	c reading HOME/instance-3308848-1303984539.cnf
0.00/0.00	c found header 'p cnf 192503 564953'
0.39/0.46	c finished parsing
0.39/0.46	c
0.39/0.46	c --check=0 --verbose=0 --order=3 --simprd=40 --merge=1 --hash=1
0.39/0.46	c --dominate=1 --restart=1 --restartint=100 --rebias=1 --rebiasint=1000
0.39/0.46	c --probe=1 --probeint=100000 --probeprd=10 --decompose=1 --minimize=3
0.39/0.46	c --maxdepth=1000 --strength=10 --elim=1 --elimint=300000 --elimprd=20
0.39/0.46	c --subst=1 --ands=1 --xors=1 --ites=1 --minlimit=1000 --maxlimit=10000000
0.39/0.46	c --random=1 --spread=2000 --seed=0 --skip=25
0.39/0.46	c
0.39/0.46	c sizeof     vars[0] = 16   alignment = 0       3 MB
0.39/0.46	c sizeof     orgs[0] =  8   alignment = 0       1 MB
0.39/0.46	c sizeof     occs[0] =  8   alignment = 0       1 MB
0.39/0.46	c sizeof iirfs[0..1] =  8   alignment = 0       1 MB
0.39/0.46	c
0.39/0.46	c starting search after 0.5 seconds
0.39/0.46	c no decision limit
0.39/0.48	c
0.39/0.48	c       original/binary      fixed     eliminated      learned       agility
0.39/0.48	c   seconds        variables     equivalent    conflicts       height       MB
0.39/0.48	c
0.39/0.48	c *    0.5   564951  192501      2     0      0       0      0    0.0   0   49
7.59/7.65	c s    7.7   250896   48476   2077  2817 139133       0      0    0.0   0   36
7.59/7.65	c l    7.7   250896   48476   2077  2817 139133       0 229347    0.0   0   36
7.70/7.74	c R    7.7   250896   48476   2077  2817 139133     102    102 1518.0  14   38
7.89/7.91	c R    7.9   250896   48476   2077  2817 139133     204    204 2908.9  17   38
8.19/8.22	c N    8.2   250924   48476   2077  2817 139133     807    807 2552.7  35   40
8.29/8.30	c B    8.3   250924   48476   2077  2817 139133    1000   1000 2557.5  41   40
8.69/8.72	c B    8.7   250975   48475   2078  2817 139133    2000   1997 2278.3  28   42
9.29/9.38	c R    9.4   252126   48473   2079  2818 139133    5098   5094 2226.0  14   47
10.30/10.30	c B   10.3   252179   48472   2080  2818 139133    8004   7991 2072.3  28   52
11.69/11.77	c N   11.8   252268   48461   2084  2825 139133   18784  18747 1956.2  38   57
12.29/12.30	c B   12.3   252532   48440   2094  2836 139133   24011  23921 1766.0   1   58
17.60/17.62	c s   17.6   251775   48342   2105  2860 139196   38777  37376 1776.8   1   69
20.79/20.85	c B   20.9   251966   48311   2117  2879 139196   64021  62527 1706.6  36   80
27.50/27.53	c s   27.5   251522   48192   2143  2924 139244   94885  91850 1698.8  10   86
35.49/35.52	c N   35.5   252033   48142   2167  2950 139244  136865 133719 1678.6  33  104
41.19/41.24	c B   41.2   252167   48131   2173  2955 139244  160043 156862 1666.3  37  130
46.30/46.37	c s   46.4   251492   48120   2173  2955 139255  167797 163516 1684.9  38  146
52.90/52.98	c N   53.0   251511   48117   2173  2958 139255  188259 183970 1691.9  38  197
76.19/76.23	c
76.19/76.23	c       original/binary      fixed     eliminated      learned       agility
76.19/76.23	c   seconds        variables     equivalent    conflicts       height       MB
76.19/76.23	c
76.19/76.23	c +   76.2   251511   48117   2173  2958 139255  229347 252281 1725.9  38  313
80.30/80.32	c N   80.3   251511   48117   2173  2958 139255  239535 235246 1733.7  39  315
111.40/111.42	c s  111.4   251506   48117   2173  2958 139255  282665 274447 1766.7  40  407
113.70/113.75	c +  113.8   251512   48115   2173  2960 139255  286680 277509 1762.2  38  400
142.09/142.19	c +  142.2   252230   48049   2209  2990 139255  358350 305259 1692.6  33  417
151.49/151.57	c B  151.6   252512   48033   2215  3000 139255  384096 303387 1700.1  30  427
161.29/161.38	c s  161.4   249158   47652   2216  3001 139634  392123 303179 1695.9  32  411
188.80/188.85	c +  188.9   249161   47651   2216  3002 139634  447935 335784 1716.6  41  607
278.20/278.25	c s  278.3   247881   47399   2228  3028 139848  539754 336032 1710.3  40  756
287.60/287.68	c +  287.7   247927   47389   2230  3036 139848  559915 369362 1729.6  28  751
338.39/338.41	c +  338.4   247958   47378   2230  3047 139848  699890 406298 1650.8  30  658
360.50/360.57	c s  360.6   247889   47377   2230  3047 139849  730138 420284 1635.2  37  646
397.40/397.40	c +  397.4   248029   47345   2237  3072 139849  874861 446927 1565.0  39  248
401.60/401.67	c B  401.7   248029   47345   2237  3072 139849  896181 427823 1555.2  35  251
416.10/416.13	c s  416.1   247917   47343   2237  3074 139849  956280 472953 1527.3  36  223
438.40/438.45	c +  438.5   248076   47308   2239  3107 139849 1093576 491619 1611.9  40  144
465.20/465.26	c N  465.3   248076   47308   2239  3107 139849 1163371 491883 1585.6  40  153
471.90/471.93	c s  471.9   247374   47217   2239  3107 139940 1179416 491408 1578.9  35  128
531.90/531.91	c +  531.9   247414   47204   2241  3118 139940 1366972 540780 1577.2  39  192
540.30/540.33	c
540.30/540.33	c       original/binary      fixed     eliminated      learned       agility
540.30/540.33	c   seconds        variables     equivalent    conflicts       height       MB
540.30/540.33	c
540.30/540.33	c s  540.3   246616   47071   2242  3118 140072 1411050 536057 1573.4  41  172
632.70/632.77	c s  632.8   246610   47046   2250  3133 140074 1656764 550220 1550.4  36  290
655.10/655.11	c +  655.1   246616   47044   2250  3135 140074 1708716 594858 1535.3  29  298
723.81/723.84	c s  723.9   246725   47010   2252  3167 140074 1909964 595125 1531.7  29  435
753.90/753.94	c B  754.0   246754   47003   2253  3173 140074 2048356 596034 1540.1  37  381
808.70/808.73	c +  808.7   246754   47003   2253  3173 140074 2135896 654343 1565.4  44  689
829.70/829.72	c s  829.7   246443   46967   2253  3173 140110 2154182 624995 1570.2  48  732
892.80/892.87	c N  892.9   246540   46950   2253  3190 140110 2379940 654389 1595.3  37  791
940.31/940.34	c s  940.4   246288   46913   2253  3190 140147 2461465 652282 1571.9  36  682
1032.31/1032.37	c + 1032.4   246530   46893   2256  3207 140147 2669872 719777 1556.5  40  602
1075.11/1075.16	c s 1075.2   246468   46893   2256  3207 140147 2773791 719866 1532.0  33  448
1172.71/1172.74	c s 1172.8   246522   46850   2261  3245 140147 3063172 719458 1541.3  36  358
1273.51/1273.53	c + 1273.5   246558   46843   2262  3251 140147 3337340 791754 1529.7   3  369
1285.41/1285.49	c s 1285.5   246218   46801   2262  3255 140185 3353694 731750 1532.5   0  331
1300.02/1300.00	c
1300.02/1300.00	c *** CAUGHT SIGNAL 15 ***
1300.02/1300.00	c
1300.02/1300.00	c 3392551 conflicts, 8949379 decisions, 1716 random
1300.02/1300.00	c 151 iterations, 620 restarts, 8358 skipped
1300.02/1300.00	c 13 enlarged, 8064 shrunken, 33145 rescored, 796 rebiased
1300.02/1300.00	c 18 simplifications, 0 reductions
1300.02/1300.00	c
1300.02/1300.00	c vars: 2262 fixed, 3257 equiv, 140185 elim, 3307 merged
1300.02/1300.00	c elim: 7260240 resolutions, 18 phases, 5 rounds
1300.02/1300.00	c sbst: 88% substituted, 1.0% nots, 92.2% ands, 6.6% xors, 0.2% ites
1300.02/1300.00	c arty: 2.02 and 2.02 xor average arity
1300.02/1300.00	c prbe: 8200191 probed, 167 phases, 85 rounds
1300.02/1300.00	c prbe: 23 failed, 1902 lifted, 674 merged
1300.02/1300.00	c sccs: 4 non trivial, 0 fixed, 52 merged
1300.02/1300.00	c hash: 162 units, 2581 merged
1300.02/1300.00	c mins: 632647082 learned, 8% deleted, 766 strong, 69 depth
1300.02/1300.00	c subs: 21338 forward, 10565 backward, 2340 doms
1300.02/1300.00	c strs: 9848 forward, 446 backward
1300.02/1300.00	c doms: 4058 dominators, 1921 high, 4 low
1300.02/1300.00	c prps: 456475964 propagations, 0.35 megaprops
1300.02/1300.00	c
1300.02/1300.00	c 1300.0 seconds, 823 MB max, 2220 MB recycled
1300.02/1300.00	c
1300.02/1300.00	c *** CAUGHT SIGNAL 15 ***
1300.02/1300.00	c

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3308848-1303984539/watcher-3308848-1303984539 -o /tmp/evaluation-result-3308848-1303984539/solver-3308848-1303984539 -C 2400 -W 1300 -M 7680 HOME/precosat HOME/instance-3308848-1303984539.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.80 3.92 3.00 4/189 16514
/proc/meminfo: memFree=13766044/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=9416 CPUtime=0.01 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 2188 0 0 0 1 0 0 0 22 0 1 0 510054897 9641984 2145 33554432000 134512640 135151029 4287802784 18446744073709551615 134534376 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16514/statm: 2354 2146 60 156 0 2197 0

[startup+0.114869 s]
/proc/loadavg: 3.80 3.92 3.00 4/189 16514
/proc/meminfo: memFree=13766044/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=27052 CPUtime=0.1 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 6829 0 0 0 10 0 0 0 23 0 1 0 510054897 27701248 6559 33554432000 134512640 135151029 4287802784 18446744073709551615 134682502 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 6763 6560 64 156 0 6606 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 27052

[startup+0.200854 s]
/proc/loadavg: 3.80 3.92 3.00 4/189 16514
/proc/meminfo: memFree=13766044/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=34940 CPUtime=0.19 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 9051 0 0 0 18 1 0 0 23 0 1 0 510054897 35778560 8524 33554432000 134512640 135151029 4287802784 18446744073709551615 134682502 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 8735 8525 64 156 0 8578 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 34940

[startup+0.300836 s]
/proc/loadavg: 3.80 3.92 3.00 4/189 16514
/proc/meminfo: memFree=13766044/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=43784 CPUtime=0.29 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 11264 0 0 0 28 1 0 0 23 0 1 0 510054897 44834816 10738 33554432000 134512640 135151029 4287802784 18446744073709551615 134682502 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 10946 10739 64 156 0 10789 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 43784

[startup+0.700775 s]
/proc/loadavg: 3.80 3.92 3.00 4/189 16514
/proc/meminfo: memFree=13766044/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=62504 CPUtime=0.69 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 16420 0 0 0 67 2 0 0 25 0 1 0 510054897 64004096 15379 33554432000 134512640 135151029 4287802784 18446744073709551615 134555060 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 15626 15379 80 156 0 15469 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 62504

[startup+1.50062 s]
/proc/loadavg: 3.80 3.92 3.00 5/190 16515
/proc/meminfo: memFree=13702680/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=73056 CPUtime=1.49 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 23764 0 0 0 146 3 0 0 25 0 1 0 510054897 74809344 18028 33554432000 134512640 135151029 4287802784 18446744073709551615 134578831 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 18264 18028 80 156 0 18107 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 73056

[startup+3.10035 s]
/proc/loadavg: 3.80 3.92 3.00 5/190 16515
/proc/meminfo: memFree=13682964/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=88712 CPUtime=3.09 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 27511 0 0 0 304 5 0 0 25 0 1 0 510054897 90841088 21775 33554432000 134512640 135151029 4287802784 18446744073709551615 134547994 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 22178 21775 80 156 0 22021 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 88712

[startup+6.30077 s]
/proc/loadavg: 3.82 3.92 3.01 5/190 16516
/proc/meminfo: memFree=13654844/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=91424 CPUtime=6.29 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 27986 0 0 0 624 5 0 0 25 0 1 0 510054897 93618176 22250 33554432000 134512640 135151029 4287802784 18446744073709551615 134548037 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 22856 22250 80 156 0 22699 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 91424

[startup+12.7006 s]
/proc/loadavg: 3.83 3.92 3.01 5/190 16516
/proc/meminfo: memFree=13644188/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=97064 CPUtime=12.69 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 32676 0 0 0 1263 6 0 0 25 0 1 0 510054897 99393536 23659 33554432000 134512640 135151029 4287802784 18446744073709551615 134553822 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 24266 23659 80 156 0 24109 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 97064

[startup+25.5004 s]
/proc/loadavg: 3.87 3.92 3.03 5/190 16516
/proc/meminfo: memFree=13565188/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=117580 CPUtime=25.49 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 40772 0 0 0 2541 8 0 0 25 0 1 0 510054897 120401920 28747 33554432000 134512640 135151029 4287802784 18446744073709551615 134555315 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 29395 28747 80 156 0 29238 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 117580

[startup+51.1008 s]
/proc/loadavg: 3.97 3.94 3.06 5/190 16517
/proc/meminfo: memFree=13434320/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=202616 CPUtime=51.09 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 68060 0 0 0 5097 12 0 0 25 0 1 0 510054897 207478784 50019 33554432000 134512640 135151029 4287802784 18446744073709551615 134578057 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 50654 50019 80 156 0 50497 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 202616

[startup+102.301 s]
/proc/loadavg: 3.98 3.95 3.10 5/190 16518
/proc/meminfo: memFree=13145356/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=413524 CPUtime=102.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 120446 0 0 0 10207 23 0 0 25 0 1 0 510054897 423448576 102405 33554432000 134512640 135151029 4287802784 18446744073709551615 134520400 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 103381 102405 80 156 0 103224 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 413524

[startup+162.301 s]
/proc/loadavg: 3.99 3.95 3.16 5/190 16520
/proc/meminfo: memFree=13066980/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=450176 CPUtime=162.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 135993 0 0 0 16204 26 0 0 25 0 1 0 510054897 460980224 111777 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 112544 111777 80 156 0 112387 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 450176

[startup+222.306 s]
/proc/loadavg: 4.03 3.97 3.21 5/190 16521
/proc/meminfo: memFree=12713696/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=788496 CPUtime=222.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 220081 0 0 0 22185 45 0 0 25 0 1 0 510054897 807419904 195865 33554432000 134512640 135151029 4287802784 18446744073709551615 134520459 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 197124 195865 80 156 0 196967 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 788496

[startup+282.301 s]
/proc/loadavg: 4.01 3.97 3.26 5/190 16523
/proc/meminfo: memFree=12614112/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=282.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 230887 0 0 0 28182 48 0 0 25 0 1 0 510054897 840155136 204177 33554432000 134512640 135151029 4287802784 18446744073709551615 134520405 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204177 80 156 0 204959 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 820464

[startup+342.3 s]
/proc/loadavg: 4.00 3.97 3.30 5/190 16534
/proc/meminfo: memFree=12573608/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=342.29 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 230933 0 0 0 34181 48 0 0 25 0 1 0 510054897 840155136 204223 33554432000 134512640 135151029 4287802784 18446744073709551615 134555084 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204223 80 156 0 204959 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 820464

[startup+402.301 s]
/proc/loadavg: 3.92 3.95 3.34 4/184 16606
/proc/meminfo: memFree=12656924/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=402.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 230998 0 0 0 40182 48 0 0 25 0 1 0 510054897 840155136 204288 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204288 80 156 0 204959 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 820464

[startup+462.301 s]
/proc/loadavg: 3.34 3.78 3.31 4/184 16608
/proc/meminfo: memFree=12657064/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=462.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231025 0 0 0 46182 48 0 0 25 0 1 0 510054897 840155136 204315 33554432000 134512640 135151029 4287802784 18446744073709551615 134574578 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204315 80 156 0 204959 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 820464

[startup+522.3 s]
/proc/loadavg: 3.30 3.68 3.31 4/184 16612
/proc/meminfo: memFree=12647048/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=522.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231026 0 0 0 52182 48 0 0 25 0 1 0 510054897 840155136 204316 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204316 80 156 0 204959 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 820464

[startup+582.301 s]
/proc/loadavg: 3.11 3.55 3.28 4/184 16614
/proc/meminfo: memFree=12635056/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=582.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231062 0 0 0 58182 48 0 0 25 0 1 0 510054897 840155136 204352 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204352 80 156 0 204959 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 820464

[startup+642.301 s]
/proc/loadavg: 3.07 3.46 3.27 4/184 16616
/proc/meminfo: memFree=12605152/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=642.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231062 0 0 0 64182 48 0 0 25 0 1 0 510054897 840155136 204352 33554432000 134512640 135151029 4287802784 18446744073709551615 134555150 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204352 80 156 0 204959 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 820464

[startup+702.3 s]
/proc/loadavg: 3.02 3.38 3.25 4/184 16617
/proc/meminfo: memFree=12605096/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=702.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231063 0 0 0 70182 48 0 0 25 0 1 0 510054897 840155136 204353 33554432000 134512640 135151029 4287802784 18446744073709551615 134520448 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204353 80 156 0 204959 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 820464

[startup+762.301 s]
/proc/loadavg: 3.01 3.31 3.23 4/184 16619
/proc/meminfo: memFree=12605184/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=762.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231126 0 0 0 76183 48 0 0 25 0 1 0 510054897 840155136 204416 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204416 80 156 0 204959 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 820464

[startup+822.301 s]
/proc/loadavg: 3.00 3.25 3.21 4/184 16620
/proc/meminfo: memFree=12605040/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=820464 CPUtime=822.3 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 231221 0 0 0 82182 48 0 0 25 0 1 0 510054897 840155136 204511 33554432000 134512640 135151029 4287802784 18446744073709551615 134521885 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 205116 204511 80 156 0 204959 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 820464

[startup+882.307 s]
/proc/loadavg: 3.00 3.20 3.20 4/184 16622
/proc/meminfo: memFree=12560092/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=855396 CPUtime=882.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 240415 0 0 0 88182 49 0 0 25 0 1 0 510054897 875925504 212577 33554432000 134512640 135151029 4287802784 18446744073709551615 134520459 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213849 212577 80 156 0 213692 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 855396

[startup+942.301 s]
/proc/loadavg: 3.00 3.16 3.18 4/184 16624
/proc/meminfo: memFree=12548524/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=942.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 243826 0 0 0 94181 50 0 0 25 0 1 0 510054897 873959424 212284 33554432000 134512640 135151029 4287802784 18446744073709551615 134542738 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212284 80 156 0 213212 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 853476

[startup+1002.3 s]
/proc/loadavg: 3.00 3.13 3.17 4/184 16625
/proc/meminfo: memFree=12542564/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1002.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 243839 0 0 0 100181 50 0 0 25 0 1 0 510054897 873959424 212297 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212297 80 156 0 213212 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 853476

[startup+1062.3 s]
/proc/loadavg: 3.06 3.12 3.16 4/184 16627
/proc/meminfo: memFree=12534464/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1062.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 243843 0 0 0 106181 50 0 0 25 0 1 0 510054897 873959424 212301 33554432000 134512640 135151029 4287802784 18446744073709551615 134520453 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212301 80 156 0 213212 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 853476

[startup+1122.3 s]
/proc/loadavg: 3.02 3.09 3.15 4/184 16628
/proc/meminfo: memFree=12520168/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1122.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 246109 0 0 0 112181 50 0 0 25 0 1 0 510054897 873959424 212311 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212311 80 156 0 213212 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 853476

[startup+1182.3 s]
/proc/loadavg: 2.71 3.01 3.12 3/178 16647
/proc/meminfo: memFree=12824788/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1182.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 246160 0 0 0 118181 50 0 0 25 0 1 0 510054897 873959424 212362 33554432000 134512640 135151029 4287802784 18446744073709551615 134554766 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212362 80 156 0 213212 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 853476

[startup+1242.3 s]
/proc/loadavg: 2.26 2.82 3.04 3/178 16649
/proc/meminfo: memFree=12824376/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1242.31 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 246160 0 0 0 124181 50 0 0 25 0 1 0 510054897 873959424 212362 33554432000 134512640 135151029 4287802784 18446744073709551615 134554814 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212362 80 156 0 213212 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 853476



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.87 2.62 2.96 2/172 16668
/proc/meminfo: memFree=13098672/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1300.02 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 246172 0 0 0 129952 50 0 0 25 0 1 0 510054897 873959424 212374 33554432000 134512640 135151029 4287802784 18446744073709551615 134520459 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212374 80 156 0 213212 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 853476

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 1.87 2.62 2.96 2/172 16668
/proc/meminfo: memFree=13098672/32951124 swapFree=67111528/67111528
[pid=16514] ppid=16512 vsize=853476 CPUtime=1300.02 cores=5,7
/proc/16514/stat : 16514 (precosat) R 16512 16514 16199 0 -1 4202496 246172 0 0 0 129952 50 0 0 25 0 1 0 510054897 873959424 212374 33554432000 134512640 135151029 4287802784 18446744073709551615 134520459 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/16514/statm: 213369 212374 80 156 0 213212 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 853476

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.04
CPU time (s): 1300.06
CPU user time (s): 1299.52
CPU system time (s): 0.543917
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 862500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.52
system time used= 0.543917
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 246173
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 17340

runsolver used 2.07069 second user time and 4.95025 second system time

The end

Launcher Data

Begin job on node108 at 2011-04-28 11:55:40
IDJOB=3308848
IDBENCH=82493
IDSOLVER=1690
FILE ID=node108/3308848-1303984539
RUNJOBID= node108-1303983222-16220
PBS_JOBID= 13168718
Free space on /tmp= 72096 MiB

SOLVER NAME= SAT09 reference solver:precosat 236
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
COMMAND LINE= HOME/precosat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3308848-1303984539/watcher-3308848-1303984539 -o /tmp/evaluation-result-3308848-1303984539/solver-3308848-1303984539 -C 2400 -W 1300 -M 7680  HOME/precosat HOME/instance-3308848-1303984539.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 7886cd26d6e0801ea382a1ffd6224023
RANDOM SEED=313877495

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13766200 kB
Buffers:       2290728 kB
Cached:       16081144 kB
SwapCached:          0 kB
Active:       10375276 kB
Inactive:      8227572 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13766200 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           27532 kB
Writeback:           0 kB
AnonPages:      230152 kB
Mapped:          15996 kB
Slab:           518964 kB
PageTables:       5244 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   414724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72112 MiB
End job on node108 at 2011-04-28 12:17:22