Trace number 3291327

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 1300.02 1300.01

General information on the benchmark

NameSAT03/industrial/goldberg/hard_eq_check/
c6288mul.miter.shuffled-as.sat03-346.cnf
MD5SUM9799c8db3562549113e4a12f98721530
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark42.8615
Satisfiable
(Un)Satisfiability was proved
Number of variables9540
Number of clauses61421
Sum of the clauses size207840
Maximum clause length64
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 214116
Number of clauses of size 328488
Number of clauses of size 40
Number of clauses of size 518816
Number of clauses of size over 51

Solver Data

0.00/0.00	c Parsing...
0.00/0.03	c ==============================================================================
0.00/0.03	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.03	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.03	c ==============================================================================
0.00/0.03	c |         0 |   61421   207840 |   18426       0        0     nan |  0.000 % |
0.00/0.05	c |         0 |   61414   208298 |      --       0       --      -- |     --   | -7/458
0.00/0.05	c ==============================================================================
0.00/0.05	c Result  :   #vars: 9533   #clauses: 61414   #literals: 208298
0.00/0.05	c CPU time:   0.054991 s
0.00/0.05	c ==============================================================================

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291327-1303779618/watcher-3291327-1303779618 -o /tmp/evaluation-result-3291327-1303779618/solver-3291327-1303779618 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3291327-1303779618.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.76 3.01 3.00 5/181 28000
/proc/meminfo: memFree=19758248/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) R 27998 28000 26050 0 -1 4202496 311 0 0 0 0 0 0 0 23 0 1 0 568192432 8908800 249 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284746133 0 65538 4100 65536 0 0 0 17 4 0 0 0
/proc/28000/statm: 2175 249 209 178 0 68 0

[startup+0.105061 s]
/proc/loadavg: 2.76 3.01 3.00 5/181 28000
/proc/meminfo: memFree=19758248/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 8700

[startup+0.201017 s]
/proc/loadavg: 2.76 3.01 3.00 5/181 28000
/proc/meminfo: memFree=19758248/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 8700

[startup+0.301002 s]
/proc/loadavg: 2.76 3.01 3.00 5/181 28000
/proc/meminfo: memFree=19758248/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 8700

[startup+0.700933 s]
/proc/loadavg: 2.76 3.01 3.00 5/181 28000
/proc/meminfo: memFree=19758248/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 8700

[startup+1.50086 s]
/proc/loadavg: 2.86 3.03 3.00 5/194 28021
/proc/meminfo: memFree=19727216/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=13892 CPUtime=1.39 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 1934 0 0 0 139 0 0 0 25 0 1 0 568192441 14225408 1845 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 3473 1845 131 6 0 1943 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 22592

[startup+3.1006 s]
/proc/loadavg: 2.86 3.03 3.00 5/194 28021
/proc/meminfo: memFree=19723616/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=15112 CPUtime=2.99 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 2247 0 0 0 299 0 0 0 25 0 1 0 568192441 15474688 2158 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208411 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 3778 2158 131 6 0 2248 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 23812

[startup+6.30106 s]
/proc/loadavg: 3.03 3.06 3.01 5/194 28021
/proc/meminfo: memFree=19714124/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=16892 CPUtime=6.19 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 2686 0 0 0 619 0 0 0 25 0 1 0 568192441 17297408 2597 33554432000 4194304 4218580 140735264020832 18446744073709551615 4211905 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 4223 2597 131 6 0 2693 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 25592

[startup+12.701 s]
/proc/loadavg: 3.11 3.08 3.02 5/194 28021
/proc/meminfo: memFree=19703728/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=18584 CPUtime=12.58 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 3105 0 0 0 1258 0 0 0 25 0 1 0 568192441 19030016 3016 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208411 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 4646 3016 131 6 0 3116 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 27284

[startup+25.5008 s]
/proc/loadavg: 3.30 3.12 3.03 5/194 28023
/proc/meminfo: memFree=19689580/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=21168 CPUtime=25.39 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 3760 0 0 0 2538 1 0 0 25 0 1 0 568192441 21676032 3671 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 5292 3671 131 6 0 3762 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 29868

[startup+51.1006 s]
/proc/loadavg: 3.54 3.19 3.06 5/194 28032
/proc/meminfo: memFree=19667764/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=25072 CPUtime=50.99 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 4736 0 0 0 5098 1 0 0 25 0 1 0 568192441 25673728 4644 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 6268 4644 131 6 0 4738 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 33772

[startup+102.301 s]
/proc/loadavg: 3.80 3.31 3.10 5/194 28034
/proc/meminfo: memFree=19649756/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=27336 CPUtime=102.19 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 5363 0 0 0 10218 1 0 0 25 0 1 0 568192441 27992064 5232 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208693 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 6834 5232 131 6 0 5304 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 36036

[startup+162.301 s]
/proc/loadavg: 3.98 3.45 3.16 5/194 28034
/proc/meminfo: memFree=19629996/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=32920 CPUtime=162.19 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 6859 0 0 0 16217 2 0 0 25 0 1 0 568192441 33710080 6600 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208438 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 8230 6600 131 6 0 6700 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 41620

[startup+222.307 s]
/proc/loadavg: 4.05 3.56 3.22 5/194 28036
/proc/meminfo: memFree=19613088/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=36340 CPUtime=222.19 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 7852 0 0 0 22217 2 0 0 25 0 1 0 568192441 37212160 7480 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 9085 7480 131 6 0 7555 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 45040

[startup+282.301 s]
/proc/loadavg: 4.02 3.64 3.26 5/194 28038
/proc/meminfo: memFree=19605344/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=37432 CPUtime=282.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 8249 0 0 0 28217 3 0 0 25 0 1 0 568192441 38330368 7746 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 9358 7746 131 6 0 7828 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 46132

[startup+342.301 s]
/proc/loadavg: 4.00 3.70 3.31 5/194 28040
/proc/meminfo: memFree=19593636/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=41312 CPUtime=342.19 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 9334 0 0 0 34216 3 0 0 25 0 1 0 568192441 42303488 8715 33554432000 4194304 4218580 140735264020832 18446744073709551615 4213904 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 10328 8715 131 6 0 8798 0
Current children cumulated CPU time (s) 342.27
Current children cumulated vsize (KiB) 50012

[startup+402.301 s]
/proc/loadavg: 4.00 3.75 3.35 5/194 28042
/proc/meminfo: memFree=19586636/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6

################
# More data... #
################

[pid=28019] ppid=28000 vsize=45080 CPUtime=582.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 10862 0 0 0 58216 4 0 0 25 0 1 0 568192441 46161920 9654 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 11270 9654 131 6 0 9740 0
Current children cumulated CPU time (s) 582.28
Current children cumulated vsize (KiB) 53780

[startup+642.301 s]
/proc/loadavg: 4.00 3.90 3.49 5/194 28048
/proc/meminfo: memFree=19561272/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=47960 CPUtime=642.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 11746 0 0 0 64215 5 0 0 25 0 1 0 568192441 49111040 10371 33554432000 4194304 4218580 140735264020832 18446744073709551615 4213904 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 11990 10371 131 6 0 10460 0
Current children cumulated CPU time (s) 642.28
Current children cumulated vsize (KiB) 56660

[startup+702.301 s]
/proc/loadavg: 4.00 3.91 3.52 5/194 28050
/proc/meminfo: memFree=19555156/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=48616 CPUtime=702.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 12050 0 0 0 70215 5 0 0 25 0 1 0 568192441 49782784 10524 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208693 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 12154 10524 131 6 0 10624 0
Current children cumulated CPU time (s) 702.28
Current children cumulated vsize (KiB) 57316

[startup+762.301 s]
/proc/loadavg: 4.07 3.94 3.56 5/194 28050
/proc/meminfo: memFree=19552744/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=48680 CPUtime=762.21 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 12232 0 0 0 76216 5 0 0 25 0 1 0 568192441 49848320 10566 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208438 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 12170 10566 131 6 0 10640 0
Current children cumulated CPU time (s) 762.29
Current children cumulated vsize (KiB) 57380

[startup+822.301 s]
/proc/loadavg: 4.10 3.96 3.59 5/194 28052
/proc/meminfo: memFree=19549232/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=48788 CPUtime=822.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 12406 0 0 0 82215 5 0 0 25 0 1 0 568192441 49958912 10566 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 12197 10566 131 6 0 10667 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 57488

[startup+882.307 s]
/proc/loadavg: 4.03 3.97 3.61 5/194 28054
/proc/meminfo: memFree=19540364/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=53136 CPUtime=882.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 13610 0 0 0 88215 5 0 0 25 0 1 0 568192441 54411264 11654 33554432000 4194304 4218580 140735264020832 18446744073709551615 4210077 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13284 11654 131 6 0 11754 0
Current children cumulated CPU time (s) 882.28
Current children cumulated vsize (KiB) 61836

[startup+942.301 s]
/proc/loadavg: 4.01 3.97 3.63 5/194 28056
/proc/meminfo: memFree=19536844/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=52752 CPUtime=942.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 13785 0 0 0 94215 5 0 0 25 0 1 0 568192441 54018048 11561 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208583 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13188 11561 131 6 0 11658 0
Current children cumulated CPU time (s) 942.28
Current children cumulated vsize (KiB) 61452

[startup+1002.3 s]
/proc/loadavg: 4.00 3.97 3.65 5/194 28058
/proc/meminfo: memFree=19533956/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=53624 CPUtime=1002.21 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 14184 0 0 0 100215 6 0 0 25 0 1 0 568192441 54910976 11785 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13406 11785 131 6 0 11876 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 62324

[startup+1062.3 s]
/proc/loadavg: 4.05 3.99 3.67 5/194 28058
/proc/meminfo: memFree=19526716/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=53720 CPUtime=1062.21 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 14373 0 0 0 106215 6 0 0 25 0 1 0 568192441 55009280 11815 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208532 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13430 11815 131 6 0 11900 0
Current children cumulated CPU time (s) 1062.29
Current children cumulated vsize (KiB) 62420

[startup+1122.3 s]
/proc/loadavg: 4.02 3.99 3.69 5/194 28060
/proc/meminfo: memFree=19524680/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=53948 CPUtime=1122.21 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 14580 0 0 0 112215 6 0 0 25 0 1 0 568192441 55242752 11858 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13487 11858 131 6 0 11957 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 62648

[startup+1182.3 s]
/proc/loadavg: 4.00 3.99 3.71 5/194 28062
/proc/meminfo: memFree=19523760/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=53948 CPUtime=1182.21 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 14772 0 0 0 118215 6 0 0 25 0 1 0 568192441 55242752 11861 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13487 11861 131 6 0 11957 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 62648

[startup+1242.3 s]
/proc/loadavg: 4.00 3.99 3.73 5/194 28064
/proc/meminfo: memFree=19520624/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=55496 CPUtime=1242.2 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 15331 0 0 0 124214 6 0 0 25 0 1 0 568192441 56827904 12257 33554432000 4194304 4218580 140735264020832 18446744073709551615 4213573 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 13874 12257 131 6 0 12344 0
Current children cumulated CPU time (s) 1242.28
Current children cumulated vsize (KiB) 64196



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 3.99 3.74 4/192 28067
/proc/meminfo: memFree=19582960/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=56508 CPUtime=1299.92 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 15771 0 0 0 129985 7 0 0 25 0 1 0 568192441 57864192 12499 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208693 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 14127 12499 131 6 0 12597 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 65208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.00 3.99 3.74 4/192 28067
/proc/meminfo: memFree=19582960/32951124 swapFree=67110396/67111528
[pid=28000] ppid=27998 vsize=8700 CPUtime=0.08 cores=4,6
/proc/28000/stat : 28000 (esg_static.sh) S 27998 28000 26050 0 -1 4202496 353 1580 0 0 0 0 8 0 23 0 1 0 568192432 8908800 252 33554432000 4194304 4922060 140733841042672 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28000/statm: 2175 252 209 178 0 68 0
[pid=28019] ppid=28000 vsize=56508 CPUtime=1299.92 cores=4,6
/proc/28019/stat : 28019 (cdcl) R 28000 28000 26050 0 -1 4202496 15771 0 0 0 129985 7 0 0 25 0 1 0 568192441 57864192 12499 33554432000 4194304 4218580 140735264020832 18446744073709551615 4208693 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28019/statm: 14127 12499 131 6 0 12597 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 65208

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.01
CPU time (s): 1300.02
CPU user time (s): 1299.94
CPU system time (s): 0.080987
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 65368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.94
system time used= 0.080987
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17716
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24
involuntary context switches= 14074

runsolver used 2.27165 second user time and 4.82627 second system time

The end

Launcher Data

Begin job on node118 at 2011-04-26 03:00:18
IDJOB=3291327
IDBENCH=84205
IDSOLVER=1609
FILE ID=node118/3291327-1303779618
RUNJOBID= node118-1303779618-27971
PBS_JOBID= 13157160
Free space on /tmp= 71672 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT03/industrial/goldberg/hard_eq_check/c6288mul.miter.shuffled-as.sat03-346.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291327-1303779618/watcher-3291327-1303779618 -o /tmp/evaluation-result-3291327-1303779618/solver-3291327-1303779618 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3291327-1303779618.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 9799c8db3562549113e4a12f98721530
RANDOM SEED=901503037

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19755304 kB
Buffers:       1874536 kB
Cached:       10719960 kB
SwapCached:        600 kB
Active:        8795684 kB
Inactive:      3875112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19755304 kB
SwapTotal:    67111528 kB
SwapFree:     67110396 kB
Dirty:            5192 kB
Writeback:          12 kB
AnonPages:       74720 kB
Mapped:          15424 kB
Slab:           461304 kB
PageTables:       4964 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   212896 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71664 MiB
End job on node118 at 2011-04-26 03:22:00