Trace number 3387123

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: minisat_psm 2011-04-01? (TO) 5000.04 4999.93

General information on the benchmark

NameAPPLICATIONS/bitverif/
minandmaxor/minandmaxor128.cnf
MD5SUM5b2e2178738883a628728bb1ec39f4a9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1971.87
Satisfiable
(Un)Satisfiability was proved
Number of variables249327
Number of clauses746444
Sum of the clauses size1741700
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2497628
Number of clauses of size 3248814
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.30	c ==============================================================================
0.00/0.30	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.30	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.30	c ==============================================================================
0.00/0.30	c |         0 |  746442  1741698 |  223932       0        0     nan |  0.000 % |
5.68/5.78	c |         0 |  397738  1362662 |      --       0       --      -- |     --   | -348682/-378983
5.68/5.79	c ==============================================================================
5.68/5.79	c Result  :   #vars: 76979   #clauses: 397738   #literals: 1362662
5.68/5.79	c CPU time:   5.65314 s
5.68/5.79	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3387123-1305591903/watcher-3387123-1305591903 -o /tmp/evaluation-result-3387123-1305591903/solver-3387123-1305591903 -C 5000 -W 5100 -M 15500 ./esg_static.sh HOME/instance-3387123-1305591903.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.07 3.06 3.01 4/552 18984
/proc/meminfo: memFree=16782048/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0

[startup+0.0799661 s]
/proc/loadavg: 3.07 3.06 3.01 4/552 18984
/proc/meminfo: memFree=16782048/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100962 s]
/proc/loadavg: 3.07 3.06 3.01 4/552 18984
/proc/meminfo: memFree=16782048/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300927 s]
/proc/loadavg: 3.07 3.06 3.01 4/552 18984
/proc/meminfo: memFree=16782048/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700852 s]
/proc/loadavg: 3.07 3.06 3.01 4/552 18984
/proc/meminfo: memFree=16782048/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50071 s]
/proc/loadavg: 3.07 3.06 3.01 4/554 18986
/proc/meminfo: memFree=16669192/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0
[pid=18985] ppid=18984 vsize=111728 CPUtime=1.49 cores=1,3,5,7
/proc/18985/stat : 18985 (SatELite_releas) R 18984 18984 18474 0 -1 4202496 28497 0 0 0 143 6 0 0 25 0 1 0 670790787 114409472 26385 33554432000 134512640 135144242 4287891584 18446744073709551615 134737844 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/18985/statm: 27932 26385 77 155 0 27775 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 120428

[startup+3.10043 s]
/proc/loadavg: 3.07 3.06 3.01 4/554 18986
/proc/meminfo: memFree=16652204/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 326 0 0 0 0 0 0 0 25 0 1 0 670790787 8908800 249 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/18984/statm: 2175 249 209 178 0 68 0
[pid=18985] ppid=18984 vsize=118544 CPUtime=3.09 cores=1,3,5,7
/proc/18985/stat : 18985 (SatELite_releas) R 18984 18984 18474 0 -1 4202496 30047 0 0 0 300 9 0 0 25 0 1 0 670790787 121389056 27935 33554432000 134512640 135144242 4287891584 18446744073709551615 134745630 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/18985/statm: 29636 27935 77 155 0 29479 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 127244

[startup+6.30081 s]
/proc/loadavg: 3.07 3.06 3.01 4/554 18986
/proc/meminfo: memFree=16616368/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 6.02
Current children cumulated vsize (KiB) 8700

[startup+12.7007 s]
/proc/loadavg: 3.06 3.06 3.01 4/554 18987
/proc/meminfo: memFree=16677452/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=58108 CPUtime=6.65 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 11375 0 0 0 664 1 0 0 25 0 1 0 670791391 59502592 9999 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 14527 9999 253 16 0 11169 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 66808

[startup+25.5004 s]
/proc/loadavg: 3.05 3.05 3.00 4/554 18988
/proc/meminfo: memFree=16640516/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=59060 CPUtime=19.45 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 21971 0 0 0 1942 3 0 0 25 0 1 0 670791391 60477440 10897 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213369 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 14765 10897 253 16 0 11407 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 67760

[startup+51.1007 s]
/proc/loadavg: 3.03 3.05 3.00 4/554 18988
/proc/meminfo: memFree=16618068/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=108288 CPUtime=45.05 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 37728 0 0 0 4500 5 0 0 25 0 1 0 670791391 110886912 23380 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213445 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 27072 23380 253 16 0 23714 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 116988

[startup+102.321 s]
/proc/loadavg: 3.05 3.05 3.00 4/554 18990
/proc/meminfo: memFree=16604800/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=108288 CPUtime=96.27 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 38005 0 0 0 9622 5 0 0 25 0 1 0 670791391 110886912 23647 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213994 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 27072 23647 253 16 0 23714 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 116988

[startup+162.3 s]
/proc/loadavg: 3.20 3.09 3.01 4/554 18991
/proc/meminfo: memFree=16569908/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=138928 CPUtime=156.25 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 84914 0 0 0 15612 13 0 0 25 0 1 0 670791391 142262272 30489 33554432000 4194304 4256717 140734845959328 18446744073709551615 4209105 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 34732 30489 253 16 0 31374 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 147628

[startup+222.301 s]
/proc/loadavg: 3.14 3.09 3.01 4/554 18993
/proc/meminfo: memFree=16564172/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=138928 CPUtime=216.26 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 102551 0 0 0 21610 16 0 0 25 0 1 0 670791391 142262272 31048 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213930 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 34732 31048 253 16 0 31374 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 147628

[startup+282.301 s]
/proc/loadavg: 3.05 3.07 3.01 4/554 18994
/proc/meminfo: memFree=16556544/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=138928 CPUtime=276.26 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 102815 0 0 0 27610 16 0 0 25 0 1 0 670791391 142262272 31308 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 34732 31308 253 16 0 31374 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 147628

[startup+342.301 s]
/proc/loadavg: 3.02 3.05 3.00 4/554 18996
/proc/meminfo: memFree=16604864/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=108584 CPUtime=336.26 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 176930 0 0 0 33599 27 0 0 25 0 1 0 670791391 111190016 21498 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213972 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 27146 21498 253 16 0 23788 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 117284

[startup+402.301 s]
/proc/loadavg: 3.00 3.04 3.00 4/554 18998
/proc/meminfo: memFree=16600384/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=139924 CPUtime=396.26 cores=1,3,5,7

################
# More data... #
################

/proc/18987/statm: 52335 46325 253 16 0 48977 0
Current children cumulated CPU time (s) 4362.4
Current children cumulated vsize (KiB) 218040

[startup+4422.3 s]
/proc/loadavg: 3.00 3.02 3.00 4/554 19147
/proc/meminfo: memFree=16853512/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=259616 CPUtime=4416.38 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3699971 0 0 0 441025 613 0 0 25 0 1 0 670791391 265846784 52403 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213475 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 64904 52403 253 16 0 61546 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 268316

[startup+4482.3 s]
/proc/loadavg: 3.11 3.04 3.01 4/554 19148
/proc/meminfo: memFree=16874072/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=209908 CPUtime=4476.38 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3749030 0 0 0 447019 619 0 0 25 0 1 0 670791391 214945792 46817 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 52477 46817 253 16 0 49119 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 218608

[startup+4542.3 s]
/proc/loadavg: 3.04 3.03 3.00 4/554 19150
/proc/meminfo: memFree=16847264/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=260532 CPUtime=4536.38 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3783141 0 0 0 453012 626 0 0 25 0 1 0 670791391 266784768 55730 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 65133 55730 253 16 0 61775 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 269232

[startup+4602.3 s]
/proc/loadavg: 3.01 3.02 3.00 4/554 19152
/proc/meminfo: memFree=16842400/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=260756 CPUtime=4596.4 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3838738 0 0 0 459005 635 0 0 25 0 1 0 670791391 267014144 49654 33554432000 4194304 4256717 140734845959328 18446744073709551615 4209038 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 65189 49654 253 16 0 61831 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 269456

[startup+4662.3 s]
/proc/loadavg: 3.08 3.05 3.01 4/554 19153
/proc/meminfo: memFree=16868904/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=211200 CPUtime=4656.39 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3887849 0 0 0 464996 643 0 0 25 0 1 0 670791391 216268800 47630 33554432000 4194304 4256717 140734845959328 18446744073709551615 4209111 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 52800 47630 253 16 0 49442 0
Current children cumulated CPU time (s) 4662.41
Current children cumulated vsize (KiB) 219900

[startup+4722.32 s]
/proc/loadavg: 3.06 3.05 3.01 4/554 19155
/proc/meminfo: memFree=16859700/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=211772 CPUtime=4716.41 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3937729 0 0 0 470991 650 0 0 25 0 1 0 670791391 216854528 46801 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213763 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 52943 46801 253 16 0 49585 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 220472

[startup+4782.3 s]
/proc/loadavg: 3.02 3.04 3.00 4/554 19156
/proc/meminfo: memFree=16854588/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=261860 CPUtime=4776.39 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 3971531 0 0 0 476983 656 0 0 25 0 1 0 670791391 268144640 51872 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213972 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 65465 51872 253 16 0 62107 0
Current children cumulated CPU time (s) 4782.41
Current children cumulated vsize (KiB) 270560

[startup+4842.3 s]
/proc/loadavg: 3.01 3.03 3.00 4/554 19158
/proc/meminfo: memFree=16857896/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=212720 CPUtime=4836.4 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 4019907 0 0 0 482975 665 0 0 25 0 1 0 670791391 217825280 48607 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 53180 48607 253 16 0 49822 0
Current children cumulated CPU time (s) 4842.42
Current children cumulated vsize (KiB) 221420

[startup+4902.3 s]
/proc/loadavg: 3.00 3.02 3.00 4/554 19160
/proc/meminfo: memFree=16781120/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=344196 CPUtime=4896.4 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 4033970 0 0 0 488971 669 0 0 25 0 1 0 670791391 352456704 62554 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213712 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 86049 62554 253 16 0 82691 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 352896

[startup+4962.3 s]
/proc/loadavg: 3.00 3.02 3.00 5/554 19161
/proc/meminfo: memFree=16864796/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=213304 CPUtime=4956.4 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 4087126 0 0 0 494964 676 0 0 25 0 1 0 670791391 218423296 46547 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213791 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 53326 46547 253 16 0 49968 0
Current children cumulated CPU time (s) 4962.42
Current children cumulated vsize (KiB) 222004



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 3.12 3.04 3.01 4/554 19162
/proc/meminfo: memFree=16859948/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=213588 CPUtime=4994.02 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 4113512 0 0 0 498721 681 0 0 25 0 1 0 670791391 218714112 47864 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213445 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 53397 47864 253 16 0 50039 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 222288

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 3.12 3.04 3.01 4/554 19162
/proc/meminfo: memFree=16859948/32951124 swapFree=56449236/67111528
[pid=18984] ppid=18982 vsize=8700 CPUtime=6.02 cores=1,3,5,7
/proc/18984/stat : 18984 (esg_static.sh) S 18982 18984 18474 0 -1 4202496 351 35502 0 0 0 0 588 14 18 0 1 0 670790787 8908800 251 33554432000 4194304 4922060 140735663440432 18446744073709551615 253640678533 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/18984/statm: 2175 251 209 178 0 68 0
[pid=18987] ppid=18984 vsize=213588 CPUtime=4994.02 cores=1,3,5,7
/proc/18987/stat : 18987 (minisat_static) R 18984 18984 18474 0 -1 4202496 4113512 0 0 0 498721 681 0 0 25 0 1 0 670791391 218714112 47864 33554432000 4194304 4256717 140734845959328 18446744073709551615 4213445 0 0 4096 8388610 0 0 0 17 3 0 0 0
/proc/18987/statm: 53397 47864 253 16 0 50039 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 222288

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18984 and gives
#  childrusage.ru_utime.tv_sec=5
#  childrusage.ru_utime.tv_usec=889104
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=148977
# CPU time returned by wait4() is 6.03808
# while last known CPU time is 5000.04
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4999.93
CPU time (s): 5000.04
CPU user time (s): 4993.09
CPU system time (s): 6.95
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 483124

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5.8891
system time used= 0.148977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35853
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 21

runsolver used 25.4821 second user time and 65.445 second system time

The end

Launcher Data 

Begin job on node106 at 2011-05-17 02:25:04
IDJOB=3387123
IDBENCH=70769
IDSOLVER=1874
FILE ID=node106/3387123-1305591903
RUNJOBID= node106-1305586739-18493
PBS_JOBID= 13350372
Free space on /tmp= 73288 MiB

SOLVER NAME= minisat hack: minisat_psm 2011-04-01
BENCH NAME= SAT09/APPLICATIONS/bitverif/minandmaxor/minandmaxor128.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3387123-1305591903/watcher-3387123-1305591903 -o /tmp/evaluation-result-3387123-1305591903/solver-3387123-1305591903 -C 5000 -W 5100 -M 15500  ./esg_static.sh HOME/instance-3387123-1305591903.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5b2e2178738883a628728bb1ec39f4a9
RANDOM SEED=1999135278

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16782072 kB
Buffers:        320996 kB
Cached:        7356304 kB
SwapCached:      27532 kB
Active:        6760544 kB
Inactive:      9112440 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16782072 kB
SwapTotal:    67111528 kB
SwapFree:     56449236 kB
Dirty:           14892 kB
Writeback:           0 kB
AnonPages:     8176524 kB
Mapped:          26288 kB
Slab:           144868 kB
PageTables:      78980 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 168272460 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73324 MiB
End job on node106 at 2011-05-17 03:48:26