Trace number 3394406

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.6 5009.38

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n120-s55656844-unsat.cnf
MD5SUM4877ca9f3fe317c84d3087c8296a2a0b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark716.736
Satisfiable
(Un)Satisfiability was proved
Number of variables121
Number of clauses252
Sum of the clauses size756
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3252
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394406-1306095241/watcher-3394406-1306095241 -o /tmp/evaluation-result-3394406-1306095241/solver-3394406-1306095241 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394406-1306095241.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.05 6.30 3.97 1/430 26641
/proc/meminfo: memFree=13831056/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=156632 CPUtime=0.02 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 415 1252 0 0 2 0 0 0 25 0 9 0 701939745 160391168 341 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 39158 341 177 55 0 37044 0
[pid=26641/tid=26647] ppid=26639 vsize=156804 CPUtime=0.01 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 45 1252 0 0 1 0 0 0 25 0 9 0 701939746 160567296 388 33554432000 4194304 4417452 140735859500608 18446744073709551615 4272502 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 5 1252 0 0 0 0 0 0 25 0 9 0 701939746 160567296 388 33554432000 4194304 4417452 140735859500608 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 1 1252 0 0 0 0 0 0 25 0 9 0 701939746 160567296 388 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338488814 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 38 1252 0 0 0 0 0 0 25 0 9 0 701939746 160567296 396 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338077647 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 7 1252 0 0 0 0 0 0 25 0 9 0 701939746 160567296 396 33554432000 4194304 4417452 140735859500608 18446744073709551615 4353572 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 5 1252 0 0 0 0 0 0 25 0 9 0 701939746 160567296 396 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338488814 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 17 1252 0 0 0 0 0 0 25 0 9 0 701939746 160567296 396 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338488814 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=156804 CPUtime=0 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 11 1252 0 0 0 0 0 0 18 0 9 0 701939746 160567296 396 33554432000 4194304 4417452 140735859500608 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0

[startup+0.038875 s]
/proc/loadavg: 8.05 6.30 3.97 1/430 26641
/proc/meminfo: memFree=13831056/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=158228 CPUtime=0.19 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 862 1252 0 0 19 0 0 0 25 0 9 0 701939745 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 39557 788 178 55 0 37443 0
[pid=26641/tid=26647] ppid=26639 vsize=158228 CPUtime=0.03 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 79 1252 0 0 3 0 0 0 25 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4236593 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=158228 CPUtime=0.02 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 54 1252 0 0 2 0 0 0 25 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4236063 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=158228 CPUtime=0.01 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 62 1252 0 0 1 0 0 0 18 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4337287 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=158228 CPUtime=0.02 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 99 1252 0 0 2 0 0 0 25 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=158228 CPUtime=0.02 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 56 1252 0 0 2 0 0 0 25 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4253035 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=158228 CPUtime=0 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 5 1252 0 0 0 0 0 0 25 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338488814 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=158228 CPUtime=0.02 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 89 1252 0 0 2 0 0 0 18 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=158228 CPUtime=0.02 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 77 1252 0 0 2 0 0 0 17 0 9 0 701939746 162025472 788 33554432000 4194304 4417452 140735859500608 18446744073709551615 4252379 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 158228

[startup+0.100863 s]
/proc/loadavg: 8.05 6.30 3.97 1/430 26641
/proc/meminfo: memFree=13831056/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=161184 CPUtime=0.62 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 1783 1252 0 0 62 0 0 0 25 0 9 0 701939745 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 40296 1519 179 55 0 38182 0
[pid=26641/tid=26647] ppid=26639 vsize=161184 CPUtime=0.09 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 242 1252 0 0 9 0 0 0 25 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=161184 CPUtime=0.08 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 217 1252 0 0 8 0 0 0 18 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=161184 CPUtime=0.07 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 214 1252 0 0 7 0 0 0 18 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=161184 CPUtime=0.08 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 222 1252 0 0 8 0 0 0 25 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4320992 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=161184 CPUtime=0.09 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 165 1252 0 0 9 0 0 0 25 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=161184 CPUtime=0 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 5 1252 0 0 0 0 0 0 25 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338488814 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=161184 CPUtime=0.08 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 175 1252 0 0 8 0 0 0 18 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4355827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=161184 CPUtime=0.09 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 202 1252 0 0 9 0 0 0 17 0 9 0 701939746 165052416 1519 33554432000 4194304 4417452 140735859500608 18446744073709551615 4353568 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 161184

[startup+0.300793 s]
/proc/loadavg: 8.05 6.30 3.97 1/430 26641
/proc/meminfo: memFree=13831056/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=167068 CPUtime=2.17 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 5873 1252 0 0 217 0 0 0 25 0 9 0 701939745 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 41767 3022 179 55 0 39653 0
[pid=26641/tid=26647] ppid=26639 vsize=167068 CPUtime=0.29 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 784 1252 0 0 29 0 0 0 25 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=167068 CPUtime=0.28 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 793 1252 0 0 28 0 0 0 18 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=167068 CPUtime=0.27 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 817 1252 0 0 27 0 0 0 18 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=167068 CPUtime=0.28 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 700 1252 0 0 28 0 0 0 25 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=167068 CPUtime=0.29 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 646 1252 0 0 29 0 0 0 25 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4358214 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=167068 CPUtime=0.16 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 332 1252 0 0 16 0 0 0 25 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=167068 CPUtime=0.28 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 741 1252 0 0 28 0 0 0 18 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4365036 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=167068 CPUtime=0.28 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 719 1252 0 0 28 0 0 0 18 0 9 0 701939746 171077632 3022 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.17
Current children cumulated vsize (KiB) 167068

[startup+0.700713 s]
/proc/loadavg: 8.05 6.30 3.97 1/430 26641
/proc/meminfo: memFree=13831056/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=171064 CPUtime=5.38 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 11141 1252 0 0 536 2 0 0 25 0 9 0 701939745 175169536 4021 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 42766 4021 179 55 0 40652 0
[pid=26641/tid=26647] ppid=26639 vsize=171064 CPUtime=0.69 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 1592 1252 0 0 69 0 0 0 25 0 9 0 701939746 175169536 4021 33554432000 4194304 4417452 140735859500608 18446744073709551615 4244349 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=171064 CPUtime=0.68 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 1420 1252 0 0 68 0 0 0 18 0 9 0 701939746 175169536 4021 33554432000 4194304 4417452 140735859500608 18446744073709551615 4354492 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=171064 CPUtime=0.67 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 1595 1252 0 0 67 0 0 0 18 0 9 0 701939746 175169536 4020 33554432000 4194304 4417452 140735859500608 18446744073709551615 270338441642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=170608 CPUtime=0.68 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 1290 1252 0 0 68 0 0 0 25 0 9 0 701939746 174702592 3907 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=170608 CPUtime=0.69 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 1403 1252 0 0 69 0 0 0 25 0 9 0 701939746 174702592 3907 33554432000 4194304 4417452 140735859500608 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=170608 CPUtime=0.56 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 941 1252 0 0 56 0 0 0 25 0 9 0 701939746 174702592 3907 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=170608 CPUtime=0.68 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 1353 1252 0 0 68 0 0 0 18 0 9 0 701939746 174702592 3907 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=170608 CPUtime=0.68 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 1206 1252 0 0 68 0 0 0 18 0 9 0 701939746 174702592 3907 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.38
Current children cumulated vsize (KiB) 171064

[startup+1.50056 s]
/proc/loadavg: 8.05 6.30 3.97 9/439 26655
/proc/meminfo: memFree=13811028/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=178936 CPUtime=11.75 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 22625 1252 0 0 1171 4 0 0 25 0 9 0 701939745 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 44734 5957 179 55 0 42620 0
[pid=26641/tid=26647] ppid=26639 vsize=178936 CPUtime=1.48 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 3134 1252 0 0 148 0 0 0 25 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364877 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=178936 CPUtime=1.48 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 2661 1252 0 0 148 0 0 0 20 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4366407 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=178936 CPUtime=1.47 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 3128 1252 0 0 147 0 0 0 19 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=178936 CPUtime=1.48 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 2901 1252 0 0 148 0 0 0 25 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=178936 CPUtime=1.48 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 2520 1252 0 0 148 0 0 0 25 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=178936 CPUtime=1.33 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 2624 1252 0 0 133 0 0 0 25 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=178936 CPUtime=1.47 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 2764 1252 0 0 147 0 0 0 20 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4264774 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=178936 CPUtime=1.48 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 2552 1252 0 0 148 0 0 0 19 0 9 0 701939746 183230464 5957 33554432000 4194304 4417452 140735859500608 18446744073709551615 4251131 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.75
Current children cumulated vsize (KiB) 178936

[startup+3.10124 s]
/proc/loadavg: 8.05 6.30 3.97 9/439 26655
/proc/meminfo: memFree=13806988/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=187960 CPUtime=24.55 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 39360 1252 0 0 2447 8 0 0 25 0 9 0 701939745 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 46990 8245 179 55 0 44876 0
[pid=26641/tid=26647] ppid=26639 vsize=187960 CPUtime=3.09 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 5605 1252 0 0 308 1 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=187960 CPUtime=3.08 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 4946 1252 0 0 308 0 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4321714 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=187960 CPUtime=3.06 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 5190 1252 0 0 306 0 0 0 24 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=187960 CPUtime=3.08 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 4497 1252 0 0 308 0 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=187960 CPUtime=3.08 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 4505 1252 0 0 308 0 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4358093 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=187960 CPUtime=2.92 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 4405 1252 0 0 291 1 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=187960 CPUtime=3.08 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 4866 1252 0 0 307 1 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4366082 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=187960 CPUtime=3.08 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 5005 1252 0 0 307 1 0 0 25 0 9 0 701939746 192471040 8245 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.55
Current children cumulated vsize (KiB) 187960

[startup+6.3006 s]
/proc/loadavg: 8.04 6.33 4.00 9/439 26656
/proc/meminfo: memFree=13794104/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=200156 CPUtime=50.1 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 67909 1252 0 0 4997 13 0 0 25 0 9 0 701939745 204959744 11264 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 50039 11264 179 55 0 47925 0

################
# More data... #
################

/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 861506 1252 0 0 472047 138 0 0 25 0 9 0 701939746 1468383232 319720 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1433968 CPUtime=4722.51 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 715749 1252 0 0 472118 133 0 0 25 0 9 0 701939746 1468383232 319720 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1433968 CPUtime=4653.77 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 776697 1252 0 0 465239 138 0 0 25 0 9 0 701939746 1468383232 319720 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1433968 CPUtime=4722.49 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 752446 1252 0 0 472104 145 0 0 25 0 9 0 701939746 1468383232 319720 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1433968 CPUtime=4722.51 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 472116 135 0 0 25 0 9 0 701939746 1468383232 319720 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37708.5
Current children cumulated vsize (KiB) 1433968

[startup+4782.3 s]
/proc/loadavg: 8.00 8.05 8.00 9/439 26798
/proc/meminfo: memFree=12530376/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=1438480 CPUtime=38187.6 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 6525217 1252 0 0 3817628 1127 0 0 25 0 9 0 701939745 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 359620 320848 179 55 0 357506 0
[pid=26641/tid=26647] ppid=26639 vsize=1438480 CPUtime=4780.31 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 918925 1252 0 0 477882 149 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=1438480 CPUtime=4782.5 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 898469 1252 0 0 478101 149 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=1438480 CPUtime=4782.46 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 847612 1252 0 0 478110 136 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=1438480 CPUtime=4781.84 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 868792 1252 0 0 478045 139 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1438480 CPUtime=4782.5 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 715749 1252 0 0 478117 133 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1438480 CPUtime=4712.89 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 776697 1252 0 0 471151 138 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1438480 CPUtime=4782.48 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 752446 1252 0 0 478103 145 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1438480 CPUtime=4782.5 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 478115 135 0 0 25 0 9 0 701939746 1473003520 320848 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38187.6
Current children cumulated vsize (KiB) 1438480

[startup+4842.3 s]
/proc/loadavg: 8.00 8.04 8.00 9/439 26800
/proc/meminfo: memFree=12503820/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=1481276 CPUtime=38666.7 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 6558640 1252 0 0 3865535 1132 0 0 25 0 9 0 701939745 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 370319 331547 179 55 0 368205 0
[pid=26641/tid=26647] ppid=26639 vsize=1481276 CPUtime=4840.3 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 928899 1252 0 0 483880 150 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=1481276 CPUtime=4842.5 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 907477 1252 0 0 484100 150 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=1481276 CPUtime=4842.47 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 858867 1252 0 0 484108 139 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=1481276 CPUtime=4841.84 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 871978 1252 0 0 484045 139 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1481276 CPUtime=4842.5 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 715749 1252 0 0 484117 133 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1481276 CPUtime=4772.02 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 776697 1252 0 0 477064 138 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1481276 CPUtime=4842.48 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 752446 1252 0 0 484103 145 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1481276 CPUtime=4842.5 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 484115 135 0 0 25 0 9 0 701939746 1516826624 331547 33554432000 4194304 4417452 140735859500608 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38666.7
Current children cumulated vsize (KiB) 1481276

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 8.00 10/439 26801
/proc/meminfo: memFree=12540888/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=1444356 CPUtime=39145.8 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 6619421 1252 0 0 3913443 1139 0 0 25 0 9 0 701939745 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 361089 322317 179 55 0 358975 0
[pid=26641/tid=26647] ppid=26639 vsize=1444356 CPUtime=4900.3 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 937291 1252 0 0 489879 151 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=1444356 CPUtime=4902.49 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 910897 1252 0 0 490099 150 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=1444356 CPUtime=4902.47 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 858867 1252 0 0 490108 139 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=1444356 CPUtime=4901.84 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 880346 1252 0 0 490044 140 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1444356 CPUtime=4902.5 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 734468 1252 0 0 490114 136 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1444356 CPUtime=4831.15 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 798579 1252 0 0 482975 140 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1444356 CPUtime=4902.48 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 752446 1252 0 0 490103 145 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1444356 CPUtime=4902.5 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 490115 135 0 0 25 0 9 0 701939746 1479020544 322317 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39145.8
Current children cumulated vsize (KiB) 1444356

[startup+4962.3 s]
/proc/loadavg: 8.11 8.05 8.01 9/439 26803
/proc/meminfo: memFree=12662276/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=1323936 CPUtime=39624.9 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 6650646 1252 0 0 3961350 1144 0 0 25 0 9 0 701939745 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 330984 292212 179 55 0 328870 0
[pid=26641/tid=26647] ppid=26639 vsize=1323936 CPUtime=4960.27 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 940011 1252 0 0 495876 151 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=1323936 CPUtime=4962.5 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 910897 1252 0 0 496100 150 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=1323936 CPUtime=4962.47 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 865705 1252 0 0 496107 140 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=1323936 CPUtime=4961.84 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 890858 1252 0 0 496043 141 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1323936 CPUtime=4962.51 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 736379 1252 0 0 496115 136 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1323936 CPUtime=4890.27 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 798579 1252 0 0 488887 140 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1323936 CPUtime=4962.49 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 761690 1252 0 0 496102 147 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1323936 CPUtime=4962.51 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 496116 135 0 0 25 0 9 0 701939746 1355710464 292212 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39624.9
Current children cumulated vsize (KiB) 1323936



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.3 s]
/proc/loadavg: 8.05 8.04 8.00 10/439 26804
/proc/meminfo: memFree=12707896/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=1278000 CPUtime=40000.5 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 6678610 1252 0 0 3998900 1148 0 0 25 0 9 0 701939745 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 319500 280728 179 55 0 317386 0
[pid=26641/tid=26647] ppid=26639 vsize=1278000 CPUtime=5007.3 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 954300 1252 0 0 500577 153 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=1278000 CPUtime=5009.54 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 917475 1252 0 0 500802 152 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=1278000 CPUtime=5009.51 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 866576 1252 0 0 500811 140 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=1278000 CPUtime=5008.88 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 897084 1252 0 0 500746 142 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1278000 CPUtime=5009.54 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 736379 1252 0 0 500818 136 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1278000 CPUtime=4936.6 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 798579 1252 0 0 493520 140 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1278000 CPUtime=5009.53 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 761690 1252 0 0 500806 147 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1278000 CPUtime=5009.54 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 500819 135 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 1278000

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.3 s]
/proc/loadavg: 8.05 8.04 8.00 10/439 26804
/proc/meminfo: memFree=12707896/32951124 swapFree=57171228/67111528
[pid=26641] ppid=26639 vsize=1278000 CPUtime=40000.5 cores=0-7
/proc/26641/stat : 26641 (plingeling) S 26639 26641 26571 0 -1 4202496 6678610 1252 0 0 3998900 1148 0 0 25 0 9 0 701939745 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26641/statm: 319500 280728 179 55 0 317386 0
[pid=26641/tid=26647] ppid=26639 vsize=1278000 CPUtime=5007.3 cores=0-7
/proc/26641/task/26647/stat : 26647 (plingeling) R 26639 26641 26571 0 -1 4202560 954300 1252 0 0 500577 153 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26641/tid=26648] ppid=26639 vsize=1278000 CPUtime=5009.54 cores=0-7
/proc/26641/task/26648/stat : 26648 (plingeling) R 26639 26641 26571 0 -1 4202560 917475 1252 0 0 500802 152 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26641/tid=26649] ppid=26639 vsize=1278000 CPUtime=5009.51 cores=0-7
/proc/26641/task/26649/stat : 26649 (plingeling) R 26639 26641 26571 0 -1 4202560 866576 1252 0 0 500811 140 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=26641/tid=26650] ppid=26639 vsize=1278000 CPUtime=5008.88 cores=0-7
/proc/26641/task/26650/stat : 26650 (plingeling) R 26639 26641 26571 0 -1 4202560 897084 1252 0 0 500746 142 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26641/tid=26651] ppid=26639 vsize=1278000 CPUtime=5009.54 cores=0-7
/proc/26641/task/26651/stat : 26651 (plingeling) R 26639 26641 26571 0 -1 4202560 736379 1252 0 0 500818 136 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=26641/tid=26652] ppid=26639 vsize=1278000 CPUtime=4936.6 cores=0-7
/proc/26641/task/26652/stat : 26652 (plingeling) R 26639 26641 26571 0 -1 4202560 798579 1252 0 0 493520 140 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26641/tid=26653] ppid=26639 vsize=1278000 CPUtime=5009.53 cores=0-7
/proc/26641/task/26653/stat : 26653 (plingeling) R 26639 26641 26571 0 -1 4202560 761690 1252 0 0 500806 147 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26641/tid=26654] ppid=26639 vsize=1278000 CPUtime=5009.54 cores=0-7
/proc/26641/task/26654/stat : 26654 (plingeling) R 26639 26641 26571 0 -1 4202560 746186 1252 0 0 500819 135 0 0 25 0 9 0 701939746 1308672000 280728 33554432000 4194304 4417452 140735859500608 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 1278000

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.38
CPU time (s): 40000.6
CPU user time (s): 39989.1
CPU system time (s): 11.5302
CPU usage (%): 798.513
Max. virtual memory (cumulated for all children) (KiB): 1556088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39989.1
system time used= 11.5302
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6679862
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 351
involuntary context switches= 191601

runsolver used 20.6929 second user time and 52.1281 second system time

The end

Launcher Data

Begin job on node143 at 2011-05-22 22:14:01
IDJOB=3394406
IDBENCH=83147
IDSOLVER=1851
FILE ID=node143/3394406-1306095241
RUNJOBID= node143-1306094868-26585
PBS_JOBID= 13387965
Free space on /tmp= 73368 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n120-s55656844-unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394406-1306095241/watcher-3394406-1306095241 -o /tmp/evaluation-result-3394406-1306095241/solver-3394406-1306095241 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394406-1306095241.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4877ca9f3fe317c84d3087c8296a2a0b
RANDOM SEED=1932603272

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13831196 kB
Buffers:        293228 kB
Cached:        5038668 kB
SwapCached:      39952 kB
Active:        9429728 kB
Inactive:      9389176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13831196 kB
SwapTotal:    67111528 kB
SwapFree:     57171228 kB
Dirty:              96 kB
Writeback:           0 kB
AnonPages:    13446932 kB
Mapped:          30432 kB
Slab:           150372 kB
PageTables:      80332 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 115656376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73368 MiB
End job on node143 at 2011-05-22 23:37:33