Trace number 3394826

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.9 5009.47

General information on the benchmark

NameSAT05/crafted/jarvisalo05/mod2-rand3bip-sat/
mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
MD5SUM51d9aefd9da7f94abc32dd024090dc46
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.005998
Satisfiable
(Un)Satisfiability was proved
Number of variables270
Number of clauses1080
Sum of the clauses size3240
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31080
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394826-1306107950/watcher-3394826-1306107950 -o /tmp/evaluation-result-3394826-1306107950/solver-3394826-1306107950 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394826-1306107950.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.53 8.03 8.05 2/429 15545
/proc/meminfo: memFree=7962456/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=157276 CPUtime=0.03 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 611 1250 0 0 3 0 0 0 25 0 9 0 722392882 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 39319 535 176 55 0 37205 0
[pid=15545/tid=15551] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 3 1250 0 0 0 0 0 0 25 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 255377406446 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 1 1250 0 0 0 0 0 0 25 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 6 1250 0 0 0 0 0 0 18 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 26 1250 0 0 0 0 0 0 18 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4352515 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 21 1250 0 0 0 0 0 0 18 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4253110 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 20 1250 0 0 0 0 0 0 18 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4257666 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 1 1250 0 0 0 0 0 0 25 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4321415 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=157276 CPUtime=0 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 7 1250 0 0 0 0 0 0 18 0 9 0 722392883 161050624 535 33554432000 4194304 4417452 140733792306128 18446744073709551615 4333736 0 0 4096 17442 0 0 0 -1 0 0 0 0

[startup+0.142599 s]
/proc/loadavg: 7.53 8.03 8.05 2/429 15545
/proc/meminfo: memFree=7962456/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=161256 CPUtime=1.05 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 2242 1250 0 0 105 0 0 0 25 0 9 0 722392882 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 40314 1547 179 55 0 38200 0
[pid=15545/tid=15551] ppid=15543 vsize=161256 CPUtime=0.11 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 160 1250 0 0 11 0 0 0 25 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250548 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=161256 CPUtime=0.12 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 178 1250 0 0 12 0 0 0 25 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=161256 CPUtime=0.13 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 259 1250 0 0 13 0 0 0 18 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365549 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=161256 CPUtime=0.13 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 248 1250 0 0 13 0 0 0 18 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=161256 CPUtime=0.13 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 209 1250 0 0 13 0 0 0 18 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=161256 CPUtime=0.13 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 185 1250 0 0 13 0 0 0 18 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4366014 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=161256 CPUtime=0.13 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 225 1250 0 0 13 0 0 0 25 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4251010 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=161256 CPUtime=0.13 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 252 1250 0 0 13 0 0 0 18 0 9 0 722392883 165126144 1547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4353504 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.05
Current children cumulated vsize (KiB) 161256

[startup+0.200588 s]
/proc/loadavg: 7.53 8.03 8.05 2/429 15545
/proc/meminfo: memFree=7962456/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=161832 CPUtime=1.51 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 2788 1250 0 0 151 0 0 0 25 0 9 0 722392882 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 40458 1691 179 55 0 38344 0
[pid=15545/tid=15551] ppid=15543 vsize=161832 CPUtime=0.17 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 184 1250 0 0 17 0 0 0 25 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=161832 CPUtime=0.18 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 288 1250 0 0 18 0 0 0 25 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250873 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=161832 CPUtime=0.19 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 309 1250 0 0 19 0 0 0 18 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=161832 CPUtime=0.19 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 320 1250 0 0 19 0 0 0 18 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=161832 CPUtime=0.19 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 307 1250 0 0 19 0 0 0 18 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=161832 CPUtime=0.19 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 280 1250 0 0 19 0 0 0 18 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=161832 CPUtime=0.19 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 288 1250 0 0 19 0 0 0 25 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=161832 CPUtime=0.19 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 286 1250 0 0 19 0 0 0 18 0 9 0 722392883 165715968 1691 33554432000 4194304 4417452 140733792306128 18446744073709551615 4236895 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.51
Current children cumulated vsize (KiB) 161832

[startup+0.300569 s]
/proc/loadavg: 7.53 8.03 8.05 2/429 15545
/proc/meminfo: memFree=7962456/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=162688 CPUtime=2.31 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 3888 1250 0 0 230 1 0 0 25 0 9 0 722392882 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 40672 1878 179 55 0 38558 0
[pid=15545/tid=15551] ppid=15543 vsize=162688 CPUtime=0.27 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 308 1250 0 0 27 0 0 0 25 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365949 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=162688 CPUtime=0.28 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 403 1250 0 0 28 0 0 0 25 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=162688 CPUtime=0.29 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 401 1250 0 0 29 0 0 0 18 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=162688 CPUtime=0.29 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 414 1250 0 0 29 0 0 0 18 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=162688 CPUtime=0.29 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 412 1250 0 0 29 0 0 0 18 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250882 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=162688 CPUtime=0.29 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 396 1250 0 0 29 0 0 0 18 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250807 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=162688 CPUtime=0.28 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 473 1250 0 0 28 0 0 0 25 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250678 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=162688 CPUtime=0.29 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 555 1250 0 0 29 0 0 0 18 0 9 0 722392883 166592512 1878 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.31
Current children cumulated vsize (KiB) 162688

[startup+0.700495 s]
/proc/loadavg: 7.53 8.03 8.05 2/429 15545
/proc/meminfo: memFree=7962456/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=167492 CPUtime=5.51 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 8411 1250 0 0 549 2 0 0 25 0 9 0 722392882 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 41873 3111 179 55 0 39759 0
[pid=15545/tid=15551] ppid=15543 vsize=167492 CPUtime=0.67 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 1049 1250 0 0 67 0 0 0 25 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4321721 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=167492 CPUtime=0.68 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 991 1250 0 0 68 0 0 0 25 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4232721 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=167492 CPUtime=0.69 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 1039 1250 0 0 69 0 0 0 18 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250947 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=167492 CPUtime=0.69 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 865 1250 0 0 69 0 0 0 18 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=167492 CPUtime=0.69 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 1018 1250 0 0 69 0 0 0 18 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4351437 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=167492 CPUtime=0.68 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 975 1250 0 0 68 0 0 0 18 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=167492 CPUtime=0.68 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 879 1250 0 0 68 0 0 0 25 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=167492 CPUtime=0.69 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 1069 1250 0 0 69 0 0 0 18 0 9 0 722392883 171511808 3111 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.51
Current children cumulated vsize (KiB) 167492

[startup+1.50035 s]
/proc/loadavg: 7.53 8.03 8.05 9/438 15559
/proc/meminfo: memFree=7949204/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=171044 CPUtime=11.9 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 15681 1250 0 0 1186 4 0 0 25 0 9 0 722392882 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 42761 4004 179 55 0 40647 0
[pid=15545/tid=15551] ppid=15543 vsize=171044 CPUtime=1.47 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 1876 1250 0 0 147 0 0 0 25 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=171044 CPUtime=1.46 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 1797 1250 0 0 146 0 0 0 25 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4321015 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=171044 CPUtime=1.48 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 1812 1250 0 0 148 0 0 0 20 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=171044 CPUtime=1.48 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 2046 1250 0 0 148 0 0 0 20 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365122 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=171044 CPUtime=1.48 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 2179 1250 0 0 148 0 0 0 20 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=171044 CPUtime=1.48 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 1672 1250 0 0 148 0 0 0 20 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 18446744073699065964 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=171044 CPUtime=1.48 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 1704 1250 0 0 148 0 0 0 25 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=171044 CPUtime=1.48 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 2069 1250 0 0 148 0 0 0 20 0 9 0 722392883 175149056 4004 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.9
Current children cumulated vsize (KiB) 171044

[startup+3.10105 s]
/proc/loadavg: 7.53 8.03 8.05 9/438 15559
/proc/meminfo: memFree=7939780/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=179340 CPUtime=24.69 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 28901 1250 0 0 2462 7 0 0 25 0 9 0 722392882 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 44835 6078 179 55 0 42721 0
[pid=15545/tid=15551] ppid=15543 vsize=179340 CPUtime=3.06 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 3422 1250 0 0 306 0 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365106 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=179340 CPUtime=3.04 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 3144 1250 0 0 304 0 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4250795 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=179340 CPUtime=3.08 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 3536 1250 0 0 308 0 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=179340 CPUtime=3.09 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 4080 1250 0 0 308 1 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=179340 CPUtime=3.09 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 4035 1250 0 0 308 1 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365612 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=179340 CPUtime=3.08 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 2941 1250 0 0 308 0 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=179340 CPUtime=3.08 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 3839 1250 0 0 308 0 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4357013 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=179340 CPUtime=3.08 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 3378 1250 0 0 308 0 0 0 25 0 9 0 722392883 183644160 6078 33554432000 4194304 4417452 140733792306128 18446744073709551615 4251172 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.69
Current children cumulated vsize (KiB) 179340

[startup+6.30046 s]
/proc/loadavg: 7.57 8.03 8.05 10/438 15559
/proc/meminfo: memFree=7931224/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=188472 CPUtime=50.23 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 51255 1250 0 0 5011 12 0 0 25 0 9 0 722392882 192995328 8329 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 47118 8329 179 55 0 45004 0

################
# More data... #
################

/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 682426 1250 0 0 472139 104 0 0 25 0 9 0 722392883 723931136 137957 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=706964 CPUtime=4722.46 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 495623 1250 0 0 472163 83 0 0 25 0 9 0 722392883 723931136 137957 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=706964 CPUtime=4722.46 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 567691 1250 0 0 472157 89 0 0 25 0 9 0 722392883 723931136 137957 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=706964 CPUtime=4720.7 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 493387 1250 0 0 471989 81 0 0 25 0 9 0 722392883 723931136 137957 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=706964 CPUtime=4722.29 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 564360 1250 0 0 472144 85 0 0 25 0 9 0 722392883 723931136 137957 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37708.9
Current children cumulated vsize (KiB) 706964

[startup+4782.3 s]
/proc/loadavg: 8.39 8.23 8.13 9/438 15710
/proc/meminfo: memFree=7376336/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=740028 CPUtime=38187.1 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 4521314 1250 0 0 3818002 706 0 0 25 0 9 0 722392882 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 185007 146223 179 55 0 182893 0
[pid=15545/tid=15551] ppid=15543 vsize=740028 CPUtime=4781.44 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 627073 1250 0 0 478053 91 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=740028 CPUtime=4712.9 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 511966 1250 0 0 471210 80 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=740028 CPUtime=4782.43 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 560837 1250 0 0 478156 87 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=740028 CPUtime=4782.42 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 689355 1250 0 0 478136 106 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=740028 CPUtime=4782.45 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 495623 1250 0 0 478162 83 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=740028 CPUtime=4782.44 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 570650 1250 0 0 478155 89 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=740028 CPUtime=4780.68 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 498385 1250 0 0 477986 82 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=740028 CPUtime=4782.27 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 566899 1250 0 0 478142 85 0 0 25 0 9 0 722392883 757788672 146223 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38187.1
Current children cumulated vsize (KiB) 740028

[startup+4842.32 s]
/proc/loadavg: 8.29 8.23 8.13 9/438 15712
/proc/meminfo: memFree=7331928/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=784204 CPUtime=38666.3 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 4549596 1250 0 0 3865923 711 0 0 25 0 9 0 722392882 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 196051 157267 179 55 0 193937 0
[pid=15545/tid=15551] ppid=15543 vsize=784204 CPUtime=4841.46 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 631742 1250 0 0 484054 92 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=784204 CPUtime=4772.04 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 517266 1250 0 0 477123 81 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=784204 CPUtime=4842.45 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 562421 1250 0 0 484158 87 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=784204 CPUtime=4842.44 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 693690 1250 0 0 484137 107 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=784204 CPUtime=4842.46 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 495911 1250 0 0 484163 83 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=784204 CPUtime=4842.46 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 577214 1250 0 0 484156 90 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=784204 CPUtime=4840.68 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 498406 1250 0 0 483986 82 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=784204 CPUtime=4842.29 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 572420 1250 0 0 484142 87 0 0 25 0 9 0 722392883 803024896 157267 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38666.3
Current children cumulated vsize (KiB) 784204

[startup+4902.3 s]
/proc/loadavg: 8.17 8.20 8.13 9/438 15713
/proc/meminfo: memFree=7378408/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=737324 CPUtime=39145.4 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 4583691 1250 0 0 3913817 718 0 0 25 0 9 0 722392882 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 184331 145547 179 55 0 182217 0
[pid=15545/tid=15551] ppid=15543 vsize=737324 CPUtime=4901.44 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 635948 1250 0 0 490052 92 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4366117 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=737324 CPUtime=4831.16 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 520262 1250 0 0 483035 81 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=737324 CPUtime=4902.44 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 566757 1250 0 0 490156 88 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=737324 CPUtime=4902.42 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 700460 1250 0 0 490135 107 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=737324 CPUtime=4902.45 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 495911 1250 0 0 490162 83 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=737324 CPUtime=4902.44 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 580845 1250 0 0 490153 91 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=737324 CPUtime=4900.64 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 507618 1250 0 0 489980 84 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=737324 CPUtime=4902.28 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 575364 1250 0 0 490140 88 0 0 25 0 9 0 722392883 755019776 145547 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39145.4
Current children cumulated vsize (KiB) 737324

[startup+4962.3 s]
/proc/loadavg: 8.16 8.19 8.12 9/438 15715
/proc/meminfo: memFree=7378152/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=738116 CPUtime=39624.5 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 4607054 1250 0 0 3961724 723 0 0 25 0 9 0 722392882 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 184529 145745 179 55 0 182415 0
[pid=15545/tid=15551] ppid=15543 vsize=738116 CPUtime=4961.44 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 639076 1250 0 0 496051 93 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=738116 CPUtime=4890.28 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 522678 1250 0 0 488946 82 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4365050 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=738116 CPUtime=4962.43 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 574236 1250 0 0 496154 89 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=738116 CPUtime=4962.42 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 704681 1250 0 0 496134 108 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=738116 CPUtime=4962.45 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 495911 1250 0 0 496162 83 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=738116 CPUtime=4962.45 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 583966 1250 0 0 496153 92 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=738116 CPUtime=4960.64 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 507618 1250 0 0 495980 84 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=738116 CPUtime=4962.28 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 578362 1250 0 0 496140 88 0 0 25 0 9 0 722392883 755830784 145745 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39624.5
Current children cumulated vsize (KiB) 738116



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.4 s]
/proc/loadavg: 8.17 8.19 8.13 10/438 15716
/proc/meminfo: memFree=7332752/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=783264 CPUtime=40000.8 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 4648252 1250 0 0 3999352 729 0 0 25 0 9 0 722392882 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 195816 157032 179 55 0 193702 0
[pid=15545/tid=15551] ppid=15543 vsize=783264 CPUtime=5008.57 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 643424 1250 0 0 500764 93 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=783264 CPUtime=4936.71 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 525687 1250 0 0 493589 82 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=783264 CPUtime=5009.56 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 578332 1250 0 0 500867 89 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=783264 CPUtime=5009.56 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 712142 1250 0 0 500846 110 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=783264 CPUtime=5009.58 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 506186 1250 0 0 500874 84 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=783264 CPUtime=5009.58 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 587354 1250 0 0 500866 92 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=783264 CPUtime=5007.76 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 510571 1250 0 0 500691 85 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=783264 CPUtime=5009.41 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 584030 1250 0 0 500853 88 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 783264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.4 s]
/proc/loadavg: 8.17 8.19 8.13 10/438 15716
/proc/meminfo: memFree=7332752/32951124 swapFree=63308224/67111528
[pid=15545] ppid=15543 vsize=783264 CPUtime=40000.8 cores=0-7
/proc/15545/stat : 15545 (plingeling) S 15543 15545 15270 0 -1 4202496 4648252 1250 0 0 3999352 729 0 0 25 0 9 0 722392882 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/15545/statm: 195816 157032 179 55 0 193702 0
[pid=15545/tid=15551] ppid=15543 vsize=783264 CPUtime=5008.57 cores=0-7
/proc/15545/task/15551/stat : 15551 (plingeling) R 15543 15545 15270 0 -1 4202560 643424 1250 0 0 500764 93 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15545/tid=15552] ppid=15543 vsize=783264 CPUtime=4936.71 cores=0-7
/proc/15545/task/15552/stat : 15552 (plingeling) R 15543 15545 15270 0 -1 4202560 525687 1250 0 0 493589 82 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15545/tid=15553] ppid=15543 vsize=783264 CPUtime=5009.56 cores=0-7
/proc/15545/task/15553/stat : 15553 (plingeling) R 15543 15545 15270 0 -1 4202560 578332 1250 0 0 500867 89 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15545/tid=15554] ppid=15543 vsize=783264 CPUtime=5009.56 cores=0-7
/proc/15545/task/15554/stat : 15554 (plingeling) R 15543 15545 15270 0 -1 4202560 712142 1250 0 0 500846 110 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=15545/tid=15555] ppid=15543 vsize=783264 CPUtime=5009.58 cores=0-7
/proc/15545/task/15555/stat : 15555 (plingeling) R 15543 15545 15270 0 -1 4202560 506186 1250 0 0 500874 84 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=15545/tid=15556] ppid=15543 vsize=783264 CPUtime=5009.58 cores=0-7
/proc/15545/task/15556/stat : 15556 (plingeling) R 15543 15545 15270 0 -1 4202560 587354 1250 0 0 500866 92 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15545/tid=15557] ppid=15543 vsize=783264 CPUtime=5007.76 cores=0-7
/proc/15545/task/15557/stat : 15557 (plingeling) R 15543 15545 15270 0 -1 4202560 510571 1250 0 0 500691 85 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=15545/tid=15558] ppid=15543 vsize=783264 CPUtime=5009.41 cores=0-7
/proc/15545/task/15558/stat : 15558 (plingeling) R 15543 15545 15270 0 -1 4202560 584030 1250 0 0 500853 88 0 0 25 0 9 0 722392883 802062336 157032 33554432000 4194304 4417452 140733792306128 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 783264

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.47
CPU time (s): 40000.9
CPU user time (s): 39993.6
CPU system time (s): 7.31789
CPU usage (%): 798.507
Max. virtual memory (cumulated for all children) (KiB): 809408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.6
system time used= 7.31789
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4649502
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 227
involuntary context switches= 347917

runsolver used 20.4709 second user time and 52.406 second system time

The end

Launcher Data

Begin job on node135 at 2011-05-23 01:45:50
IDJOB=3394826
IDBENCH=85304
IDSOLVER=1851
FILE ID=node135/3394826-1306107950
RUNJOBID= node135-1306102930-15284
PBS_JOBID= 13387998
Free space on /tmp= 73360 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT05/crafted/jarvisalo05/mod2-rand3bip-sat/mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394826-1306107950/watcher-3394826-1306107950 -o /tmp/evaluation-result-3394826-1306107950/solver-3394826-1306107950 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394826-1306107950.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 51d9aefd9da7f94abc32dd024090dc46
RANDOM SEED=2020031069

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       7962984 kB
Buffers:        351664 kB
Cached:       10707216 kB
SwapCached:      18108 kB
Active:       13739888 kB
Inactive:     10950232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       7962984 kB
SwapTotal:    67111528 kB
SwapFree:     63308224 kB
Dirty:             428 kB
Writeback:           0 kB
AnonPages:    13618516 kB
Mapped:          25904 kB
Slab:           166268 kB
PageTables:      65444 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 124372364 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73360 MiB
End job on node135 at 2011-05-23 03:09:22