Trace number 3499036

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 5000.03 4999.91

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom15.cnf
MD5SUM1f0914c6141fdba914b73575a12b918a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark16550.6
Satisfiable
(Un)Satisfiability was proved
Number of variables25972
Number of clauses86411
Sum of the clauses size219707
Maximum clause length879
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 245193
Number of clauses of size 340753
Number of clauses of size 4119
Number of clauses of size 513
Number of clauses of size over 5332

Solver Data 

0.00/0.00	c Parsing...
0.00/0.03	c ==============================================================================
0.00/0.03	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.03	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.03	c ==============================================================================
0.00/0.03	c |         0 |   81213   207435 |   24363       0        0     nan |  0.000 % |
0.00/0.27	c |         0 |   55718   204634 |      --       0       --      -- |     --   | -25495/-2801
0.00/0.27	c ==============================================================================
0.00/0.27	c Result  :   #vars: 10123   #clauses: 55718   #literals: 204634
0.00/0.27	c CPU time:   0.26296 s
0.00/0.27	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3499036-1308153555/watcher-3499036-1308153555 -o /tmp/evaluation-result-3499036-1308153555/solver-3499036-1308153555 -C 5000 -W 5100 -M 15500 ./esg_static.sh HOME/instance-3499036-1308153555.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 1.95 2/178 6163
/proc/meminfo: memFree=29544472/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 330 0 0 0 0 0 0 0 25 0 1 0 926956005 8908800 250 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/6163/statm: 2175 250 209 178 0 68 0

[startup+0.0143289 s]
/proc/loadavg: 2.00 2.00 1.95 2/178 6163
/proc/meminfo: memFree=29544472/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 330 0 0 0 0 0 0 0 25 0 1 0 926956005 8908800 250 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/6163/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100317 s]
/proc/loadavg: 2.00 2.00 1.95 2/178 6163
/proc/meminfo: memFree=29544472/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 330 0 0 0 0 0 0 0 25 0 1 0 926956005 8908800 250 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/6163/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300277 s]
/proc/loadavg: 2.00 2.00 1.95 2/178 6163
/proc/meminfo: memFree=29544472/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 330 0 0 0 0 0 0 0 25 0 1 0 926956005 8908800 250 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/6163/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700169 s]
/proc/loadavg: 2.00 2.00 1.95 2/178 6163
/proc/meminfo: memFree=29544472/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 8700

[startup+1.50106 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6166
/proc/meminfo: memFree=29534596/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=13832 CPUtime=1.18 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 1925 0 0 0 118 0 0 0 25 0 1 0 926956036 14163968 1835 33554432000 4194304 4218580 140737188193824 18446744073709551615 4209133 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/6166/statm: 3458 1835 131 6 0 1928 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 22532

[startup+3.10077 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6166
/proc/meminfo: memFree=29533604/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=15168 CPUtime=2.78 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 2266 0 0 0 278 0 0 0 25 0 1 0 926956036 15532032 2176 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208422 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/6166/statm: 3792 2176 131 6 0 2262 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 23868

[startup+6.30018 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6167
/proc/meminfo: memFree=29531460/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=16664 CPUtime=5.98 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 2616 0 0 0 598 0 0 0 25 0 1 0 926956036 17063936 2526 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208164 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/6166/statm: 4166 2526 131 6 0 2636 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 25364

[startup+12.701 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6167
/proc/meminfo: memFree=29529156/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=18788 CPUtime=12.38 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 3154 0 0 0 1238 0 0 0 25 0 1 0 926956036 19238912 3063 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/6166/statm: 4697 3063 131 6 0 3167 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 27488

[startup+25.5007 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6167
/proc/meminfo: memFree=29527176/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=20732 CPUtime=25.18 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 3642 0 0 0 2518 0 0 0 25 0 1 0 926956036 21229568 3550 33554432000 4194304 4218580 140737188193824 18446744073709551615 230808826565 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/6166/statm: 5183 3550 131 6 0 3653 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 29432

[startup+51.101 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6168
/proc/meminfo: memFree=29524284/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=23364 CPUtime=50.78 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 4385 0 0 0 5078 0 0 0 25 0 1 0 926956036 23924736 4232 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/6166/statm: 5841 4232 131 6 0 4311 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 32064

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6169
/proc/meminfo: memFree=29518420/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=29064 CPUtime=101.99 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 5950 0 0 0 10198 1 0 0 25 0 1 0 926956036 29761536 5633 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208186 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/6166/statm: 7266 5633 131 6 0 5736 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 37764

[startup+162.301 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6180
/proc/meminfo: memFree=29516068/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=31056 CPUtime=161.98 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 6717 0 0 0 16197 1 0 0 25 0 1 0 926956036 31801344 6133 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/6166/statm: 7764 6133 131 6 0 6234 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 39756

[startup+222.301 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6181
/proc/meminfo: memFree=29511432/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=35568 CPUtime=221.99 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 8121 0 0 0 22197 2 0 0 25 0 1 0 926956036 36421632 7253 33554432000 4194304 4218580 140737188193824 18446744073709551615 4211718 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/6166/statm: 8892 7253 131 6 0 7362 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 44268

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6185
/proc/meminfo: memFree=29500728/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=36424 CPUtime=281.99 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 8649 0 0 0 28197 2 0 0 25 0 1 0 926956036 37298176 7484 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/6166/statm: 9106 7484 131 6 0 7576 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 45124

[startup+342.301 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6188
/proc/meminfo: memFree=29497236/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=39868 CPUtime=341.99 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 9802 0 0 0 34197 2 0 0 25 0 1 0 926956036 40824832 8331 33554432000 4194304 4218580 140737188193824 18446744073709551615 4213514 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/6166/statm: 9967 8331 131 6 0 8437 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 48568

[startup+402.301 s]
/proc/loadavg: 2.00 2.00 1.95 3/180 6189
/proc/meminfo: memFree=29496320/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7

################
# More data... #
################

/proc/6166/statm: 36236 34592 131 6 0 34706 0
Current children cumulated CPU time (s) 4362.4
Current children cumulated vsize (KiB) 153644

[startup+4422.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 6349
/proc/meminfo: memFree=29325264/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=146196 CPUtime=4422.11 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 57509 0 0 0 442186 25 0 0 25 0 1 0 926956036 149704704 34935 33554432000 4194304 4218580 140737188193824 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 36549 34935 131 6 0 35019 0
Current children cumulated CPU time (s) 4422.41
Current children cumulated vsize (KiB) 154896

[startup+4482.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/180 6351
/proc/meminfo: memFree=29324848/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=146864 CPUtime=4482.11 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 57720 0 0 0 448186 25 0 0 25 0 1 0 926956036 150388736 35072 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 36716 35072 131 6 0 35186 0
Current children cumulated CPU time (s) 4482.41
Current children cumulated vsize (KiB) 155564

[startup+4542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6353
/proc/meminfo: memFree=29324052/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=147664 CPUtime=4542.11 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 57993 0 0 0 454186 25 0 0 25 0 1 0 926956036 151207936 35274 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 36916 35274 131 6 0 35386 0
Current children cumulated CPU time (s) 4542.41
Current children cumulated vsize (KiB) 156364

[startup+4602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6354
/proc/meminfo: memFree=29321904/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=149988 CPUtime=4602.13 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 58665 0 0 0 460187 26 0 0 25 0 1 0 926956036 153587712 35868 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 37497 35868 131 6 0 35967 0
Current children cumulated CPU time (s) 4602.43
Current children cumulated vsize (KiB) 158688

[startup+4662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6356
/proc/meminfo: memFree=29317644/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=154304 CPUtime=4662.12 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 59798 0 0 0 466186 26 0 0 25 0 1 0 926956036 158007296 36931 33554432000 4194304 4218580 140737188193824 18446744073709551615 4211905 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 38576 36931 131 6 0 37046 0
Current children cumulated CPU time (s) 4662.42
Current children cumulated vsize (KiB) 163004

[startup+4722.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6357
/proc/meminfo: memFree=29315252/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=156624 CPUtime=4722.13 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 60469 0 0 0 472187 26 0 0 25 0 1 0 926956036 160382976 37515 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 39156 37515 131 6 0 37626 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 165324

[startup+4782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6359
/proc/meminfo: memFree=29314588/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=157052 CPUtime=4782.12 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 60750 0 0 0 478186 26 0 0 25 0 1 0 926956036 160821248 37626 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208532 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 39263 37626 131 6 0 37733 0
Current children cumulated CPU time (s) 4782.42
Current children cumulated vsize (KiB) 165752

[startup+4842.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6361
/proc/meminfo: memFree=29310328/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=157612 CPUtime=4842.12 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 61000 0 0 0 484186 26 0 0 25 0 1 0 926956036 161394688 37793 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 39403 37793 131 6 0 37873 0
Current children cumulated CPU time (s) 4842.42
Current children cumulated vsize (KiB) 166312

[startup+4902.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6362
/proc/meminfo: memFree=29308676/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=159268 CPUtime=4902.12 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 61480 0 0 0 490186 26 0 0 25 0 1 0 926956036 163090432 38192 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 39817 38192 131 6 0 38287 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 167968

[startup+4962.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6364
/proc/meminfo: memFree=29307012/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=161208 CPUtime=4962.13 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 62033 0 0 0 496186 27 0 0 25 0 1 0 926956036 165076992 38665 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 40302 38665 131 6 0 38772 0
Current children cumulated CPU time (s) 4962.43
Current children cumulated vsize (KiB) 169908



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6365
/proc/meminfo: memFree=29306124/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=161972 CPUtime=4999.73 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 62244 0 0 0 499946 27 0 0 25 0 1 0 926956036 165859328 38876 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208693 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 40493 38876 131 6 0 38963 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 170672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 6365
/proc/meminfo: memFree=29306124/32951124 swapFree=67053036/67111528
[pid=6163] ppid=6161 vsize=8700 CPUtime=0.3 cores=1,3,5,7
/proc/6163/stat : 6163 (esg_static.sh) S 6161 6163 5946 0 -1 4202496 356 3591 0 0 0 0 29 1 22 0 1 0 926956005 8908800 253 33554432000 4194304 4922060 140737305048752 18446744073709551615 230808984709 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/6163/statm: 2175 253 209 178 0 68 0
[pid=6166] ppid=6163 vsize=161972 CPUtime=4999.73 cores=1,3,5,7
/proc/6166/stat : 6166 (cdcl) R 6163 6163 5946 0 -1 4202496 62244 0 0 0 499946 27 0 0 25 0 1 0 926956036 165859328 38876 33554432000 4194304 4218580 140737188193824 18446744073709551615 4208693 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/6166/statm: 40493 38876 131 6 0 38963 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 170672

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6163 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=295955
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=11998
# CPU time returned by wait4() is 0.307953
# while last known CPU time is 5000.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4999.91
CPU time (s): 5000.03
CPU user time (s): 4999.75
CPU system time (s): 0.28
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 170672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.295955
system time used= 0.011998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3947
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 8

runsolver used 8.22175 second user time and 18.7062 second system time

The end

Launcher Data 

Begin job on node104 at 2011-06-15 17:59:16
IDJOB=3499036
IDBENCH=83108
IDSOLVER=1993
FILE ID=node104/3499036-1308153555
RUNJOBID= node104-1308150601-5965
PBS_JOBID= 13575607
Free space on /tmp= 73828 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom15.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3499036-1308153555/watcher-3499036-1308153555 -o /tmp/evaluation-result-3499036-1308153555/solver-3499036-1308153555 -C 5000 -W 5100 -M 15500  ./esg_static.sh HOME/instance-3499036-1308153555.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1f0914c6141fdba914b73575a12b918a
RANDOM SEED=1006394896

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29545156 kB
Buffers:        450036 kB
Cached:        2418564 kB
SwapCached:      12244 kB
Active:         979544 kB
Inactive:      2065804 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29545156 kB
SwapTotal:    67111528 kB
SwapFree:     67053036 kB
Dirty:            2360 kB
Writeback:           0 kB
AnonPages:      173660 kB
Mapped:           9280 kB
Slab:           297948 kB
PageTables:       4892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   366644 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73808 MiB
End job on node104 at 2011-06-15 19:22:38