Trace number 3387285

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: minisat_psm 2011-04-01UNSAT 1758.94 1758.94

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
blocks-blocks-37-1.130-NOTKNOWN.cnf
MD5SUMc7a9573eb59580c8d4fc5a3ca880d541
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark381.959
Satisfiable
(Un)Satisfiability was proved
Number of variables559571
Number of clauses10223027
Sum of the clauses size22253097
Maximum clause length1408
Minimum clause length1
Number of clauses of size 11517
Number of clauses of size 29836450
Number of clauses of size 3365560
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 519500

Solver Data

0.00/0.00	c Parsing...
0.00/0.00	c num clauses = 10223027
0.00/0.00	c too many clauses .. no preprocessing
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
1758.79/1758.91	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3387285-1305599823/watcher-3387285-1305599823 -o /tmp/evaluation-result-3387285-1305599823/solver-3387285-1305599823 -C 5000 -W 5100 -M 15500 ./esg_static.sh HOME/instance-3387285-1305599823.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.44 3.10 3.04 4/561 421
/proc/meminfo: memFree=14646628/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0

[startup+0.106642 s]
/proc/loadavg: 3.44 3.10 3.04 4/561 421
/proc/meminfo: memFree=14646628/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.200625 s]
/proc/loadavg: 3.44 3.10 3.04 4/561 421
/proc/meminfo: memFree=14646628/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300608 s]
/proc/loadavg: 3.44 3.10 3.04 4/561 421
/proc/meminfo: memFree=14646628/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700544 s]
/proc/loadavg: 3.44 3.10 3.04 4/561 421
/proc/meminfo: memFree=14646628/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50041 s]
/proc/loadavg: 3.44 3.10 3.04 5/563 425
/proc/meminfo: memFree=14470344/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=441780 CPUtime=1.48 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 106054 0 0 0 135 13 0 0 25 0 1 0 750213570 452382720 85032 33554432000 4194304 4256717 140733512981024 18446744073709551615 224284586693 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 110445 85033 215 16 0 107087 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 450480

[startup+3.10114 s]
/proc/loadavg: 3.44 3.10 3.04 5/563 425
/proc/meminfo: memFree=14226312/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=489632 CPUtime=3.09 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 194675 0 0 0 286 23 0 0 25 0 1 0 750213570 501383168 99440 33554432000 4194304 4256717 140733512981024 18446744073709551615 4213445 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 122408 99440 236 16 0 119050 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 498332

[startup+6.30062 s]
/proc/loadavg: 3.81 3.19 3.07 5/563 425
/proc/meminfo: memFree=14303216/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=491748 CPUtime=6.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 196016 0 0 0 606 23 0 0 25 0 1 0 750213570 503549952 100770 33554432000 4194304 4256717 140733512981024 18446744073709551615 4213445 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 122937 100770 236 16 0 119579 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 500448

[startup+12.7005 s]
/proc/loadavg: 3.82 3.20 3.07 5/563 425
/proc/meminfo: memFree=14352200/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=410360 CPUtime=12.69 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 234220 0 0 0 1242 27 0 0 25 0 1 0 750213570 420208640 87812 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209135 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 102590 87812 237 16 0 99232 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 419060

[startup+25.5004 s]
/proc/loadavg: 3.86 3.24 3.09 5/563 425
/proc/meminfo: memFree=14336500/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=411328 CPUtime=25.49 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 237018 0 0 0 2521 28 0 0 25 0 1 0 750213570 421199872 90598 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209216 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 102832 90598 237 16 0 99474 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 420028

[startup+51.1011 s]
/proc/loadavg: 3.91 3.30 3.11 5/563 425
/proc/meminfo: memFree=14320768/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=411328 CPUtime=51.08 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 242426 0 0 0 5079 29 0 0 25 0 1 0 750213570 421199872 95990 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209102 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 102832 95990 237 16 0 99474 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 420028

[startup+102.301 s]
/proc/loadavg: 3.96 3.40 3.15 5/563 429
/proc/meminfo: memFree=14305804/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=413176 CPUtime=102.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 330383 0 0 0 10190 39 0 0 25 0 1 0 750213570 423092224 91390 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 103294 91390 237 16 0 99936 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 421876

[startup+162.301 s]
/proc/loadavg: 3.98 3.51 3.20 5/563 432
/proc/meminfo: memFree=14291696/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=414036 CPUtime=162.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 385025 0 0 0 16182 47 0 0 25 0 1 0 750213570 423972864 94064 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209093 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 103509 94064 237 16 0 100151 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 422736

[startup+222.322 s]
/proc/loadavg: 3.99 3.60 3.25 5/563 434
/proc/meminfo: memFree=14239576/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=495424 CPUtime=222.3 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 395594 0 0 0 22182 48 0 0 25 0 1 0 750213570 507314176 104622 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209058 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 123856 104622 237 16 0 120498 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 504124

[startup+282.301 s]
/proc/loadavg: 3.99 3.67 3.29 5/563 434
/proc/meminfo: memFree=14265460/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=496384 CPUtime=282.28 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 450706 0 0 0 28173 55 0 0 25 0 1 0 750213570 508297216 102547 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209140 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 124096 102547 237 16 0 120738 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 505084

[startup+342.301 s]
/proc/loadavg: 4.10 3.75 3.35 5/563 436
/proc/meminfo: memFree=14216448/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=496384 CPUtime=342.28 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 512839 0 0 0 34166 62 0 0 25 0 1 0 750213570 508297216 107064 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209204 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/423/statm: 124096 107064 237 16 0 120738 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 505084

[startup+402.301 s]
/proc/loadavg: 4.08 3.81 3.39 5/563 438
/proc/meminfo: memFree=14216924/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7

################
# More data... #
################


[startup+1422.3 s]
/proc/loadavg: 4.00 4.02 3.79 5/563 476
/proc/meminfo: memFree=14030336/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=633800 CPUtime=1422.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1430543 0 0 0 142045 184 0 0 25 0 1 0 750213570 649011200 127752 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209138 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158450 127752 237 16 0 155092 0
Current children cumulated CPU time (s) 1422.29
Current children cumulated vsize (KiB) 642500

[startup+1482.3 s]
/proc/loadavg: 4.00 4.01 3.81 5/563 485
/proc/meminfo: memFree=13953064/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=634812 CPUtime=1482.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1443863 0 0 0 148042 187 0 0 25 0 1 0 750213570 650047488 141056 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209379 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158703 141056 237 16 0 155345 0
Current children cumulated CPU time (s) 1482.29
Current children cumulated vsize (KiB) 643512

[startup+1542.32 s]
/proc/loadavg: 4.07 4.03 3.82 5/563 487
/proc/meminfo: memFree=14002388/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=634812 CPUtime=1542.31 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1521003 0 0 0 154034 197 0 0 25 0 1 0 750213570 650047488 127854 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209143 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158703 127854 237 16 0 155345 0
Current children cumulated CPU time (s) 1542.31
Current children cumulated vsize (KiB) 643512

[startup+1602.3 s]
/proc/loadavg: 4.14 4.06 3.84 5/563 489
/proc/meminfo: memFree=13973820/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=634812 CPUtime=1602.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1532775 0 0 0 160029 200 0 0 25 0 1 0 750213570 650047488 139614 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209138 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158703 139614 237 16 0 155345 0
Current children cumulated CPU time (s) 1602.29
Current children cumulated vsize (KiB) 643512

[startup+1662.3 s]
/proc/loadavg: 4.05 4.04 3.85 5/563 491
/proc/meminfo: memFree=14006632/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=634812 CPUtime=1662.3 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1616377 0 0 0 166017 213 0 0 25 0 1 0 750213570 650047488 132984 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209075 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158703 132984 237 16 0 155345 0
Current children cumulated CPU time (s) 1662.3
Current children cumulated vsize (KiB) 643512

[startup+1722.3 s]
/proc/loadavg: 4.02 4.03 3.85 5/563 493
/proc/meminfo: memFree=14062268/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1722.29 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1698017 0 0 0 172005 224 0 0 25 0 1 0 750213570 650977280 124093 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 124093 237 16 0 155572 0
Current children cumulated CPU time (s) 1722.29
Current children cumulated vsize (KiB) 644420

Solver just ended. Dumping a history of the last processes samples

[startup+1740.8 s]
/proc/loadavg: 4.17 4.06 3.86 5/563 493
/proc/meminfo: memFree=14086916/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1740.8 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1699250 0 0 0 173855 225 0 0 25 0 1 0 750213570 650977280 125322 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209075 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 125322 237 16 0 155572 0
Current children cumulated CPU time (s) 1740.8
Current children cumulated vsize (KiB) 644420

[startup+1747.2 s]
/proc/loadavg: 4.16 4.06 3.87 5/563 493
/proc/meminfo: memFree=14071036/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1747.2 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1699340 0 0 0 174495 225 0 0 25 0 1 0 750213570 650977280 125410 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209032 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 125410 237 16 0 155572 0
Current children cumulated CPU time (s) 1747.2
Current children cumulated vsize (KiB) 644420

[startup+1753.6 s]
/proc/loadavg: 4.14 4.06 3.87 5/563 493
/proc/meminfo: memFree=14049460/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1753.59 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1700659 0 0 0 175134 225 0 0 25 0 1 0 750213570 650977280 126727 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209058 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 126727 237 16 0 155572 0
Current children cumulated CPU time (s) 1753.59
Current children cumulated vsize (KiB) 644420

[startup+1756.82 s]
/proc/loadavg: 4.13 4.06 3.87 5/563 493
/proc/meminfo: memFree=14039396/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1756.81 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1701196 0 0 0 175456 225 0 0 25 0 1 0 750213570 650977280 127261 33554432000 4194304 4256717 140733512981024 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 127261 237 16 0 155572 0
Current children cumulated CPU time (s) 1756.81
Current children cumulated vsize (KiB) 644420

[startup+1757.6 s]
/proc/loadavg: 4.13 4.06 3.87 5/563 493
/proc/meminfo: memFree=14039396/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1757.59 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1701311 0 0 0 175534 225 0 0 25 0 1 0 750213570 650977280 127375 33554432000 4194304 4256717 140733512981024 18446744073709551615 4220201 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 127375 237 16 0 155572 0
Current children cumulated CPU time (s) 1757.59
Current children cumulated vsize (KiB) 644420

[startup+1758.4 s]
/proc/loadavg: 4.13 4.06 3.87 5/563 493
/proc/meminfo: memFree=14035304/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1758.39 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1701508 0 0 0 175614 225 0 0 25 0 1 0 750213570 650977280 127572 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209058 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 127572 237 16 0 155572 0
Current children cumulated CPU time (s) 1758.39
Current children cumulated vsize (KiB) 644420

[startup+1758.8 s]
/proc/loadavg: 4.13 4.06 3.87 5/563 493
/proc/meminfo: memFree=14035304/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1758.79 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1701566 0 0 0 175654 225 0 0 25 0 1 0 750213570 650977280 127630 33554432000 4194304 4256717 140733512981024 18446744073709551615 4209111 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 127630 237 16 0 155572 0
Current children cumulated CPU time (s) 1758.79
Current children cumulated vsize (KiB) 644420

[startup+1758.9 s]
/proc/loadavg: 4.13 4.06 3.87 5/563 493
/proc/meminfo: memFree=14031460/32951124 swapFree=45193380/67111528
[pid=421] ppid=419 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/421/stat : 421 (esg_static.sh) S 419 421 31236 0 -1 4202496 352 112 0 0 0 0 0 0 24 0 1 0 750213570 8908800 251 33554432000 4194304 4922060 140735926492960 18446744073709551615 224284744837 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/421/statm: 2175 251 209 178 0 68 0
[pid=423] ppid=421 vsize=635720 CPUtime=1758.89 cores=1,3,5,7
/proc/423/stat : 423 (minisat_static) R 421 421 31236 0 -1 4202496 1701580 0 0 0 175664 225 0 0 25 0 1 0 750213570 650977280 127644 33554432000 4194304 4256717 140733512981024 18446744073709551615 4219132 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/423/statm: 158930 127644 237 16 0 155572 0
Current children cumulated CPU time (s) 1758.89
Current children cumulated vsize (KiB) 644420

Child status: 20
Real time (s): 1758.94
CPU time (s): 1758.94
CPU user time (s): 1756.66
CPU system time (s): 2.28265
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 988296

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1756.66
system time used= 2.28265
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1702257
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 47
involuntary context switches= 3170

runsolver used 9.61654 second user time and 22.6566 second system time

The end

Launcher Data

Begin job on node118 at 2011-05-17 04:37:09
IDJOB=3387285
IDBENCH=82399
IDSOLVER=1874
FILE ID=node118/3387285-1305599823
RUNJOBID= node118-1305599823-401
PBS_JOBID= 13350360
Free space on /tmp= 72996 MiB

SOLVER NAME= minisat hack: minisat_psm 2011-04-01
BENCH NAME= SAT11/application/rintanen/SATPlanning/blocks-blocks-37-1.130-NOTKNOWN.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3387285-1305599823/watcher-3387285-1305599823 -o /tmp/evaluation-result-3387285-1305599823/solver-3387285-1305599823 -C 5000 -W 5100 -M 15500  ./esg_static.sh HOME/instance-3387285-1305599823.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c7a9573eb59580c8d4fc5a3ca880d541
RANDOM SEED=2062234523

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14646784 kB
Buffers:        326884 kB
Cached:        5136152 kB
SwapCached:      22068 kB
Active:       15211752 kB
Inactive:      2734092 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14646784 kB
SwapTotal:    67111528 kB
SwapFree:     45193380 kB
Dirty:          263156 kB
Writeback:           0 kB
AnonPages:    12473480 kB
Mapped:          33188 kB
Slab:           171632 kB
PageTables:     116276 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 184918700 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72988 MiB
End job on node118 at 2011-05-17 05:06:28