Trace number 3498926

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 5000.1 5000.01

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_08_UNSAT.cnf
MD5SUM66aa2e18c32a02f55a810347a9702c7f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark977.211
Satisfiable
(Un)Satisfiability was proved
Number of variables1278
Number of clauses68055
Sum of the clauses size202155
Maximum clause length9
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22148
Number of clauses of size 365884
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.00/0.00	c Parsing...
0.00/0.02	c ==============================================================================
0.00/0.02	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.02	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.02	c ==============================================================================
0.00/0.02	c |         0 |   68055   202155 |   20416       0        0     nan |  0.000 % |
0.00/0.23	c |         0 |   67183   284754 |      --       0       --      -- |     --   | -872/82599
0.00/0.23	c ==============================================================================
0.00/0.23	c Result  :   #vars: 763   #clauses: 67183   #literals: 284754
0.00/0.23	c CPU time:   0.227965 s
0.00/0.23	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3498926-1308150602/watcher-3498926-1308150602 -o /tmp/evaluation-result-3498926-1308150602/solver-3498926-1308150602 -C 5000 -W 5100 -M 15500 ./esg_static.sh HOME/instance-3498926-1308150602.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.06 1.64 1.87 1/174 18047
/proc/meminfo: memFree=30754624/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 329 0 0 0 0 0 0 0 20 0 1 0 926658669 8908800 250 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/18047/statm: 2175 250 209 178 0 68 0

[startup+0.0106891 s]
/proc/loadavg: 1.06 1.64 1.87 1/174 18047
/proc/meminfo: memFree=30754624/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 329 0 0 0 0 0 0 0 20 0 1 0 926658669 8908800 250 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/18047/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100692 s]
/proc/loadavg: 1.06 1.64 1.87 1/174 18047
/proc/meminfo: memFree=30754624/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 329 0 0 0 0 0 0 0 20 0 1 0 926658669 8908800 250 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/18047/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300652 s]
/proc/loadavg: 1.06 1.64 1.87 1/174 18047
/proc/meminfo: memFree=30754624/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 8700

[startup+0.700558 s]
/proc/loadavg: 1.06 1.64 1.87 1/174 18047
/proc/meminfo: memFree=30754624/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 8700

[startup+1.50041 s]
/proc/loadavg: 1.06 1.64 1.87 3/181 18060
/proc/meminfo: memFree=30628692/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=13180 CPUtime=1.21 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 1777 0 0 0 121 0 0 0 22 0 1 0 926658697 13496320 1688 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 3295 1688 131 6 0 1765 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 21880

[startup+3.10115 s]
/proc/loadavg: 1.06 1.64 1.87 3/181 18060
/proc/meminfo: memFree=30617036/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=13848 CPUtime=2.81 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 1939 0 0 0 281 0 0 0 25 0 1 0 926658697 14180352 1850 33554432000 4194304 4218580 140736246809968 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 3462 1850 131 6 0 1932 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 22548

[startup+6.30056 s]
/proc/loadavg: 1.14 1.64 1.87 3/181 18061
/proc/meminfo: memFree=30691056/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=15640 CPUtime=6.01 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 2413 0 0 0 601 0 0 0 25 0 1 0 926658697 16015360 2321 33554432000 4194304 4218580 140736246809968 18446744073709551615 4213466 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 3910 2321 131 6 0 2380 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 24340

[startup+12.7005 s]
/proc/loadavg: 1.21 1.65 1.87 3/181 18108
/proc/meminfo: memFree=30626028/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=17244 CPUtime=12.41 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 2779 0 0 0 1240 1 0 0 25 0 1 0 926658697 17657856 2687 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 4311 2687 131 6 0 2781 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 25944

[startup+25.5012 s]
/proc/loadavg: 1.38 1.67 1.87 3/181 18110
/proc/meminfo: memFree=30681580/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=19580 CPUtime=25.21 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 3370 0 0 0 2520 1 0 0 25 0 1 0 926658697 20049920 3277 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 4895 3277 131 6 0 3365 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 28280

[startup+51.1006 s]
/proc/loadavg: 1.59 1.69 1.87 3/181 18158
/proc/meminfo: memFree=30621856/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=22836 CPUtime=50.81 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 4232 0 0 0 5079 2 0 0 25 0 1 0 926658697 23384064 4122 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208480 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 5709 4122 131 6 0 4179 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 31536

[startup+102.307 s]
/proc/loadavg: 1.82 1.74 1.88 3/181 18160
/proc/meminfo: memFree=30609716/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=29920 CPUtime=102.01 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 6154 0 0 0 10199 2 0 0 25 0 1 0 926658697 30638080 5888 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208530 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 7480 5888 131 6 0 5950 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 38620

[startup+162.301 s]
/proc/loadavg: 1.96 1.80 1.89 3/181 18161
/proc/meminfo: memFree=30602796/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=33696 CPUtime=162.01 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 7302 0 0 0 16199 2 0 0 25 0 1 0 926658697 34504704 6826 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208418 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 8424 6826 131 6 0 6894 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 42396

[startup+222.301 s]
/proc/loadavg: 1.98 1.83 1.90 3/181 18163
/proc/meminfo: memFree=30596048/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=37584 CPUtime=222.02 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 8527 0 0 0 22199 3 0 0 25 0 1 0 926658697 38486016 7811 33554432000 4194304 4218580 140736246809968 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 9396 7811 131 6 0 7866 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 46284

[startup+282.301 s]
/proc/loadavg: 1.99 1.86 1.90 3/181 18164
/proc/meminfo: memFree=30592908/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=39676 CPUtime=282.02 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 9335 0 0 0 28199 3 0 0 25 0 1 0 926658697 40628224 8325 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 9919 8325 131 6 0 8389 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 48376

[startup+342.301 s]
/proc/loadavg: 1.99 1.88 1.91 3/181 18166
/proc/meminfo: memFree=30583592/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=46716 CPUtime=342.02 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 11372 0 0 0 34199 3 0 0 25 0 1 0 926658697 47837184 10063 33554432000 4194304 4218580 140736246809968 18446744073709551615 4210155 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 11679 10063 131 6 0 10149 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 55416

[startup+402.301 s]
/proc/loadavg: 1.99 1.90 1.91 3/181 18168
/proc/meminfo: memFree=30578860/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6

################
# More data... #
################

/proc/18060/statm: 34104 32485 131 6 0 32574 0
Current children cumulated CPU time (s) 4302.37
Current children cumulated vsize (KiB) 145116

[startup+4362.3 s]
/proc/loadavg: 2.08 2.04 2.00 3/181 18335
/proc/meminfo: memFree=30571992/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=143328 CPUtime=4362.12 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 54672 0 0 0 436193 19 0 0 25 0 1 0 926658697 146767872 34240 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 35832 34240 131 6 0 34302 0
Current children cumulated CPU time (s) 4362.38
Current children cumulated vsize (KiB) 152028

[startup+4422.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/181 18337
/proc/meminfo: memFree=30564012/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=149220 CPUtime=4422.12 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 56154 0 0 0 442192 20 0 0 25 0 1 0 926658697 152801280 35682 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 37305 35682 131 6 0 35775 0
Current children cumulated CPU time (s) 4422.38
Current children cumulated vsize (KiB) 157920

[startup+4482.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/181 18338
/proc/meminfo: memFree=30559264/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=151764 CPUtime=4482.12 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 56789 0 0 0 448192 20 0 0 25 0 1 0 926658697 155406336 36317 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 37941 36317 131 6 0 36411 0
Current children cumulated CPU time (s) 4482.38
Current children cumulated vsize (KiB) 160464

[startup+4542.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/181 18340
/proc/meminfo: memFree=30552528/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=153660 CPUtime=4542.12 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 57321 0 0 0 454192 20 0 0 25 0 1 0 926658697 157347840 36810 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 38415 36810 131 6 0 36885 0
Current children cumulated CPU time (s) 4542.38
Current children cumulated vsize (KiB) 162360

[startup+4602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 18390
/proc/meminfo: memFree=30601400/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=157440 CPUtime=4602.13 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 58304 0 0 0 460193 20 0 0 25 0 1 0 926658697 161218560 37746 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 39360 37746 131 6 0 37830 0
Current children cumulated CPU time (s) 4602.39
Current children cumulated vsize (KiB) 166140

[startup+4662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 18391
/proc/meminfo: memFree=30592528/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=158756 CPUtime=4662.12 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 58628 0 0 0 466192 20 0 0 25 0 1 0 926658697 162566144 38070 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208542 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 39689 38070 131 6 0 38159 0
Current children cumulated CPU time (s) 4662.38
Current children cumulated vsize (KiB) 167456

[startup+4722.31 s]
/proc/loadavg: 2.04 2.02 2.00 3/181 18393
/proc/meminfo: memFree=30584432/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=161996 CPUtime=4722.14 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 59484 0 0 0 472193 21 0 0 25 0 1 0 926658697 165883904 38892 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 40499 38892 131 6 0 38969 0
Current children cumulated CPU time (s) 4722.4
Current children cumulated vsize (KiB) 170696

[startup+4782.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/181 18394
/proc/meminfo: memFree=30577212/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=166516 CPUtime=4782.13 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 60625 0 0 0 478192 21 0 0 25 0 1 0 926658697 170512384 40033 33554432000 4194304 4218580 140736246809968 18446744073709551615 4211709 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 41629 40033 131 6 0 40099 0
Current children cumulated CPU time (s) 4782.39
Current children cumulated vsize (KiB) 175216

[startup+4842.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 18396
/proc/meminfo: memFree=30576072/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=166656 CPUtime=4842.13 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 60703 0 0 0 484192 21 0 0 25 0 1 0 926658697 170655744 40069 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 41664 40069 131 6 0 40134 0
Current children cumulated CPU time (s) 4842.39
Current children cumulated vsize (KiB) 175356

[startup+4902.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/181 18398
/proc/meminfo: memFree=30571092/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=169620 CPUtime=4902.13 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 61437 0 0 0 490191 22 0 0 25 0 1 0 926658697 173690880 40803 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 42405 40803 131 6 0 40875 0
Current children cumulated CPU time (s) 4902.39
Current children cumulated vsize (KiB) 178320

[startup+4962.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/181 18399
/proc/meminfo: memFree=30568200/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=171156 CPUtime=4962.13 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 61831 0 0 0 496191 22 0 0 25 0 1 0 926658697 175263744 41165 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 42789 41165 131 6 0 41259 0
Current children cumulated CPU time (s) 4962.39
Current children cumulated vsize (KiB) 179856



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 18400
/proc/meminfo: memFree=30565204/32951124 swapFree=67063284/67111528
[pid=18047] ppid=18045 vsize=8700 CPUtime=0.26 cores=0,2,4,6
/proc/18047/stat : 18047 (esg_static.sh) S 18045 18047 18010 0 -1 4202496 355 1868 0 0 0 0 26 0 18 0 1 0 926658669 8908800 253 33554432000 4194304 4922060 140733267650208 18446744073709551615 232335711365 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/18047/statm: 2175 253 209 178 0 68 0
[pid=18060] ppid=18047 vsize=171592 CPUtime=4999.84 cores=0,2,4,6
/proc/18060/stat : 18060 (cdcl) R 18047 18047 18010 0 -1 4202496 61938 0 0 0 499962 22 0 0 25 0 1 0 926658697 175710208 41272 33554432000 4194304 4218580 140736246809968 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/18060/statm: 42898 41272 131 6 0 41368 0
Current children cumulated CPU time (s) 5000.1
Current children cumulated vsize (KiB) 180292

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18047 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=266959
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=9998
# CPU time returned by wait4() is 0.276957
# while last known CPU time is 5000.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.01
CPU time (s): 5000.1
CPU user time (s): 4999.88
CPU system time (s): 0.22
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 180292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.266959
system time used= 0.009998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2223
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 5

runsolver used 8.90165 second user time and 18.1492 second system time

The end

Launcher Data 

Begin job on node132 at 2011-06-15 17:10:04
IDJOB=3498926
IDBENCH=71078
IDSOLVER=1993
FILE ID=node132/3498926-1308150602
RUNJOBID= node132-1308150602-18028
PBS_JOBID= 13575612
Free space on /tmp= 73712 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_08_UNSAT.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3498926-1308150602/watcher-3498926-1308150602 -o /tmp/evaluation-result-3498926-1308150602/solver-3498926-1308150602 -C 5000 -W 5100 -M 15500  ./esg_static.sh HOME/instance-3498926-1308150602.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 66aa2e18c32a02f55a810347a9702c7f
RANDOM SEED=878875609

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30755524 kB
Buffers:        493756 kB
Cached:        1316932 kB
SwapCached:       9728 kB
Active:         730632 kB
Inactive:      1097324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30755524 kB
SwapTotal:    67111528 kB
SwapFree:     67063284 kB
Dirty:           26808 kB
Writeback:           0 kB
AnonPages:       15384 kB
Mapped:           8884 kB
Slab:           303400 kB
PageTables:       4304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   158384 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73720 MiB
End job on node132 at 2011-06-15 18:33:27