Trace number 3371458

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.13 1203.03

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom21.cnf
MD5SUMe6407843d1fbd00b68d4ad600a25dfb2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables48639
Number of clauses162901
Sum of the clauses size415741
Maximum clause length1542
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 283161
Number of clauses of size 378900
Number of clauses of size 4230
Number of clauses of size 519
Number of clauses of size over 5590

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371458-1305423777/watcher-3371458-1305423777 -o /tmp/evaluation-result-3371458-1305423777/solver-3371458-1305423777 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371458-1305423777.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 7.71 7.66 5/292 4048
/proc/meminfo: memFree=29191320/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=13904 CPUtime=0 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) R 4046 4048 3918 0 -1 4202496 1565 1252 0 0 0 0 0 0 22 0 1 0 653975662 14237696 1495 33554432000 4194304 4417452 140734046650560 18446744073709551615 228122407892 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4048/statm: 3476 1495 144 55 0 1362 0

[startup+0.021688 s]
/proc/loadavg: 8.04 7.71 7.66 5/292 4048
/proc/meminfo: memFree=29191320/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=16900 CPUtime=0.01 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) R 4046 4048 3918 0 -1 4202496 2319 1252 0 0 1 0 0 0 22 0 1 0 653975662 17305600 2249 33554432000 4194304 4417452 140734046650560 18446744073709551615 4262049 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4048/statm: 4225 2249 149 55 0 2111 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16900

[startup+0.100687 s]
/proc/loadavg: 8.04 7.71 7.66 5/292 4048
/proc/meminfo: memFree=29191320/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=29600 CPUtime=0.09 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) R 4046 4048 3918 0 -1 4202496 5494 1252 0 0 9 0 0 0 22 0 1 0 653975662 30310400 5424 33554432000 4194304 4417452 140734046650560 18446744073709551615 4231358 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4048/statm: 7400 5424 149 55 0 5286 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29600

[startup+0.300608 s]
/proc/loadavg: 8.04 7.71 7.66 5/292 4048
/proc/meminfo: memFree=29191320/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=92144 CPUtime=0.57 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 14354 1252 0 0 55 2 0 0 23 0 5 0 653975662 94355456 10816 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 23036 10816 173 55 0 20922 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 92144

[startup+0.700537 s]
/proc/loadavg: 8.04 7.71 7.66 5/292 4048
/proc/meminfo: memFree=29191320/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=155288 CPUtime=2.17 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 18295 1252 0 0 215 2 0 0 23 0 5 0 653975662 159014912 11504 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 38822 11504 175 55 0 36708 0
Current children cumulated CPU time (s) 2.17
Current children cumulated vsize (KiB) 155288

[startup+1.50039 s]
/proc/loadavg: 8.04 7.71 7.66 9/297 4058
/proc/meminfo: memFree=29142176/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=155288 CPUtime=5.36 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 23658 1252 0 0 533 3 0 0 23 0 5 0 653975662 159014912 11514 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 38822 11514 175 55 0 36708 0
[pid=4048/tid=4055] ppid=4046 vsize=155288 CPUtime=1.29 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 2817 1252 0 0 129 0 0 0 25 0 5 0 653975682 159014912 11514 33554432000 4194304 4417452 140734046650560 18446744073709551615 4292295 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=155288 CPUtime=1.28 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 8546 1252 0 0 127 1 0 0 25 0 5 0 653975682 159014912 11514 33554432000 4194304 4417452 140734046650560 18446744073709551615 4284595 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=155288 CPUtime=1.28 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 1775 1252 0 0 128 0 0 0 25 0 5 0 653975682 159014912 11514 33554432000 4194304 4417452 140734046650560 18446744073709551615 4306573 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=155288 CPUtime=1.29 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 1053 1252 0 0 129 0 0 0 25 0 5 0 653975682 159014912 11514 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364456 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.36
Current children cumulated vsize (KiB) 155288

[startup+3.1011 s]
/proc/loadavg: 8.04 7.71 7.66 9/297 4058
/proc/meminfo: memFree=29126552/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=174308 CPUtime=11.75 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 33932 1252 0 0 1171 4 0 0 23 0 5 0 653975662 178491392 15025 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 43577 15025 180 55 0 41463 0
[pid=4048/tid=4055] ppid=4046 vsize=174308 CPUtime=2.88 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 5126 1252 0 0 288 0 0 0 25 0 5 0 653975682 178491392 15025 33554432000 4194304 4417452 140734046650560 18446744073709551615 4272418 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=174308 CPUtime=2.88 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 13568 1252 0 0 287 1 0 0 25 0 5 0 653975682 178491392 15025 33554432000 4194304 4417452 140734046650560 18446744073709551615 4252216 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=174308 CPUtime=2.87 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 4718 1252 0 0 287 0 0 0 25 0 5 0 653975682 178491392 15025 33554432000 4194304 4417452 140734046650560 18446744073709551615 4366407 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=174308 CPUtime=2.89 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 1053 1252 0 0 289 0 0 0 25 0 5 0 653975682 178491392 15025 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.75
Current children cumulated vsize (KiB) 174308

[startup+6.30052 s]
/proc/loadavg: 8.04 7.71 7.66 9/297 4058
/proc/meminfo: memFree=29100392/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=169092 CPUtime=24.52 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 35473 1252 0 0 2448 4 0 0 23 0 5 0 653975662 173150208 13878 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 42273 13878 180 55 0 40159 0
[pid=4048/tid=4055] ppid=4046 vsize=169092 CPUtime=6.08 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 5453 1252 0 0 608 0 0 0 25 0 5 0 653975682 173150208 13878 33554432000 4194304 4417452 140734046650560 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=169092 CPUtime=6.08 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 13738 1252 0 0 607 1 0 0 25 0 5 0 653975682 173150208 13878 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=169092 CPUtime=6.04 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 4738 1252 0 0 604 0 0 0 25 0 5 0 653975682 173150208 13878 33554432000 4194304 4417452 140734046650560 18446744073709551615 4250980 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=169092 CPUtime=6.09 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 2077 1252 0 0 609 0 0 0 25 0 5 0 653975682 173150208 13878 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.52
Current children cumulated vsize (KiB) 169092

[startup+12.7004 s]
/proc/loadavg: 8.03 7.72 7.66 9/297 4058
/proc/meminfo: memFree=29116148/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=174616 CPUtime=50.06 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 37166 1252 0 0 5002 4 0 0 23 0 5 0 653975662 178806784 15289 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 43654 15289 180 55 0 41540 0
[pid=4048/tid=4055] ppid=4046 vsize=174616 CPUtime=12.48 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 5948 1252 0 0 1248 0 0 0 25 0 5 0 653975682 178806784 15289 33554432000 4194304 4417452 140734046650560 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=174616 CPUtime=12.48 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 14083 1252 0 0 1247 1 0 0 25 0 5 0 653975682 178806784 15289 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364427 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=174616 CPUtime=12.38 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 5315 1252 0 0 1238 0 0 0 25 0 5 0 653975682 178806784 15289 33554432000 4194304 4417452 140734046650560 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=174616 CPUtime=12.49 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 2353 1252 0 0 1249 0 0 0 25 0 5 0 653975682 178806784 15289 33554432000 4194304 4417452 140734046650560 18446744073709551615 4353598 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.06
Current children cumulated vsize (KiB) 174616

[startup+25.5011 s]
/proc/loadavg: 8.03 7.73 7.67 9/297 4059
/proc/meminfo: memFree=29064176/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=192884 CPUtime=101.15 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 49129 1252 0 0 10109 6 0 0 23 0 5 0 653975662 197513216 19675 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 48221 19675 180 55 0 46107 0
[pid=4048/tid=4055] ppid=4046 vsize=192884 CPUtime=25.29 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 9233 1252 0 0 2528 1 0 0 25 0 5 0 653975682 197513216 19675 33554432000 4194304 4417452 140734046650560 18446744073709551615 4356889 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=192884 CPUtime=25.29 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 15873 1252 0 0 2527 2 0 0 25 0 5 0 653975682 197513216 19675 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=192884 CPUtime=25.05 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 7236 1252 0 0 2505 0 0 0 25 0 5 0 653975682 197513216 19675 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236852 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=192884 CPUtime=25.28 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 7320 1252 0 0 2528 0 0 0 25 0 5 0 653975682 197513216 19675 33554432000 4194304 4417452 140734046650560 18446744073709551615 4358123 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.15
Current children cumulated vsize (KiB) 192884

[startup+51.1004 s]
/proc/loadavg: 8.10 7.77 7.68 9/297 4059
/proc/meminfo: memFree=29057700/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=216768 CPUtime=203.32 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 66339 1252 0 0 20324 8 0 0 23 0 5 0 653975662 221970432 25646 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 54192 25646 180 55 0 52078 0
[pid=4048/tid=4055] ppid=4046 vsize=216768 CPUtime=50.89 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 11556 1252 0 0 5088 1 0 0 25 0 5 0 653975682 221970432 25646 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236816 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=216768 CPUtime=50.88 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 20343 1252 0 0 5086 2 0 0 25 0 5 0 653975682 221970432 25646 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364703 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=216768 CPUtime=50.42 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 10085 1252 0 0 5042 0 0 0 25 0 5 0 653975682 221970432 25646 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=216768 CPUtime=50.89 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 14888 1252 0 0 5088 1 0 0 25 0 5 0 653975682 221970432 25646 33554432000 4194304 4417452 140734046650560 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.32
Current children cumulated vsize (KiB) 216768

[startup+102.311 s]
/proc/loadavg: 8.08 7.81 7.70 9/297 4061
/proc/meminfo: memFree=28991828/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=267532 CPUtime=407.7 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 106589 1252 0 0 40756 14 0 0 23 0 5 0 653975662 273952768 38337 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 66883 38337 180 55 0 64769 0
[pid=4048/tid=4055] ppid=4046 vsize=267532 CPUtime=102.1 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 17881 1252 0 0 10208 2 0 0 25 0 5 0 653975682 273952768 38337 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=267532 CPUtime=102.1 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 27351 1252 0 0 10206 4 0 0 25 0 5 0 653975682 273952768 38337 33554432000 4194304 4417452 140734046650560 18446744073709551615 4365038 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=267532 CPUtime=101.17 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 13142 1252 0 0 10116 1 0 0 25 0 5 0 653975682 273952768 38337 33554432000 4194304 4417452 140734046650560 18446744073709551615 4277861 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=267532 CPUtime=102.1 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 38748 1252 0 0 10205 5 0 0 25 0 5 0 653975682 273952768 38337 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.7
Current children cumulated vsize (KiB) 267532

[startup+162.3 s]
/proc/loadavg: 8.17 7.89 7.73 9/297 4062
/proc/meminfo: memFree=28966020/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=282712 CPUtime=647.11 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 125026 1252 0 0 64696 15 0 0 23 0 5 0 653975662 289497088 42132 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 70678 42132 180 55 0 68564 0
[pid=4048/tid=4055] ppid=4046 vsize=282712 CPUtime=162.09 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 25836 1252 0 0 16207 2 0 0 25 0 5 0 653975682 289497088 42132 33554432000 4194304 4417452 140734046650560 18446744073709551615 4275960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=282712 CPUtime=162.08 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 32162 1252 0 0 16204 4 0 0 25 0 5 0 653975682 289497088 42132 33554432000 4194304 4417452 140734046650560 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=282712 CPUtime=160.62 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 15006 1252 0 0 16061 1 0 0 25 0 5 0 653975682 289497088 42132 33554432000 4194304 4417452 140734046650560 18446744073709551615 4254862 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=282712 CPUtime=162.09 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 42555 1252 0 0 16204 5 0 0 25 0 5 0 653975682 289497088 42132 33554432000 4194304 4417452 140734046650560 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.11
Current children cumulated vsize (KiB) 282712


################
# More data... #
################

[pid=4048/tid=4056] ppid=4046 vsize=412116 CPUtime=702.1 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 92603 1252 0 0 70198 12 0 0 25 0 5 0 653975682 422006784 74483 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=412116 CPUtime=695.72 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 77473 1252 0 0 69562 10 0 0 25 0 5 0 653975682 422006784 74483 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=412116 CPUtime=702.1 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 117153 1252 0 0 70196 14 0 0 25 0 5 0 653975682 422006784 74483 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2802.26
Current children cumulated vsize (KiB) 412116

[startup+762.311 s]
/proc/loadavg: 8.16 8.11 7.91 9/297 4078
/proc/meminfo: memFree=28692340/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=403076 CPUtime=3041.76 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 412023 1252 0 0 304121 55 0 0 23 0 5 0 653975662 412749824 72223 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 100769 72223 180 55 0 98655 0
[pid=4048/tid=4055] ppid=4046 vsize=403076 CPUtime=762.12 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 110916 1252 0 0 76197 15 0 0 25 0 5 0 653975682 412749824 72223 33554432000 4194304 4417452 140734046650560 18446744073709551615 4365434 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=403076 CPUtime=762.11 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 92614 1252 0 0 76199 12 0 0 25 0 5 0 653975682 412749824 72223 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=403076 CPUtime=755.18 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 77473 1252 0 0 75508 10 0 0 25 0 5 0 653975682 412749824 72223 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=403076 CPUtime=762.12 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 121553 1252 0 0 76197 15 0 0 25 0 5 0 653975682 412749824 72223 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3041.76
Current children cumulated vsize (KiB) 403076

[startup+822.3 s]
/proc/loadavg: 8.10 8.10 7.92 9/297 4080
/proc/meminfo: memFree=28683884/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=425064 CPUtime=3281.18 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 431168 1252 0 0 328060 58 0 0 23 0 5 0 653975662 435265536 77720 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 106266 77720 180 55 0 104152 0
[pid=4048/tid=4055] ppid=4046 vsize=425064 CPUtime=822.11 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 118657 1252 0 0 82195 16 0 0 25 0 5 0 653975682 435265536 77720 33554432000 4194304 4417452 140734046650560 18446744073709551615 4366063 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=425064 CPUtime=822.1 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 94662 1252 0 0 82198 12 0 0 25 0 5 0 653975682 435265536 77720 33554432000 4194304 4417452 140734046650560 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=425064 CPUtime=814.63 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 77484 1252 0 0 81453 10 0 0 25 0 5 0 653975682 435265536 77720 33554432000 4194304 4417452 140734046650560 18446744073709551615 4253214 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=425064 CPUtime=822.1 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 130898 1252 0 0 82194 16 0 0 25 0 5 0 653975682 435265536 77720 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3281.18
Current children cumulated vsize (KiB) 425064

[startup+882.301 s]
/proc/loadavg: 8.13 8.11 7.93 9/297 4082
/proc/meminfo: memFree=28640452/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=457456 CPUtime=3520.63 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 463617 1252 0 0 352001 62 0 0 23 0 5 0 653975662 468434944 85818 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 114364 85818 180 55 0 112250 0
[pid=4048/tid=4055] ppid=4046 vsize=457456 CPUtime=882.1 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 128528 1252 0 0 88193 17 0 0 25 0 5 0 653975682 468434944 85818 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=457456 CPUtime=882.1 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 94673 1252 0 0 88198 12 0 0 25 0 5 0 653975682 468434944 85818 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364791 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=457456 CPUtime=874.08 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 84570 1252 0 0 87397 11 0 0 25 0 5 0 653975682 468434944 85818 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=457456 CPUtime=882.1 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 146379 1252 0 0 88192 18 0 0 25 0 5 0 653975682 468434944 85818 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3520.63
Current children cumulated vsize (KiB) 457456

[startup+942.301 s]
/proc/loadavg: 8.08 8.10 7.94 9/297 4083
/proc/meminfo: memFree=28590416/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=462796 CPUtime=3760.1 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 485056 1252 0 0 375945 65 0 0 23 0 5 0 653975662 473903104 87153 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 115699 87153 180 55 0 113585 0
[pid=4048/tid=4055] ppid=4046 vsize=462796 CPUtime=942.11 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 135643 1252 0 0 94192 19 0 0 25 0 5 0 653975682 473903104 87153 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=462796 CPUtime=942.1 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 98769 1252 0 0 94197 13 0 0 25 0 5 0 653975682 473903104 87153 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=462796 CPUtime=933.55 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 88678 1252 0 0 93343 12 0 0 25 0 5 0 653975682 473903104 87153 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=462796 CPUtime=942.11 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 152499 1252 0 0 94192 19 0 0 25 0 5 0 653975682 473903104 87153 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3760.1
Current children cumulated vsize (KiB) 462796

[startup+1002.3 s]
/proc/loadavg: 8.19 8.13 7.95 9/297 4085
/proc/meminfo: memFree=28623480/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=421520 CPUtime=3999.55 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 495234 1252 0 0 399889 66 0 0 23 0 5 0 653975662 431636480 76866 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 105380 76866 180 55 0 103266 0
[pid=4048/tid=4055] ppid=4046 vsize=421520 CPUtime=1002.11 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 139739 1252 0 0 100192 19 0 0 25 0 5 0 653975682 431636480 76866 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236590 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=421520 CPUtime=1002.11 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 98779 1252 0 0 100198 13 0 0 25 0 5 0 653975682 431636480 76866 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=421520 CPUtime=993 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 88678 1252 0 0 99288 12 0 0 25 0 5 0 653975682 431636480 76866 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=421520 CPUtime=1002.11 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 158571 1252 0 0 100191 20 0 0 25 0 5 0 653975682 431636480 76866 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3999.55
Current children cumulated vsize (KiB) 421520

[startup+1062.3 s]
/proc/loadavg: 8.14 8.12 7.96 9/297 4086
/proc/meminfo: memFree=28644392/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=462584 CPUtime=4239.03 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 532830 1252 0 0 423832 71 0 0 23 0 5 0 653975662 473686016 87100 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 115646 87100 180 55 0 113532 0
[pid=4048/tid=4055] ppid=4046 vsize=462584 CPUtime=1062.12 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 154386 1252 0 0 106191 21 0 0 25 0 5 0 653975682 473686016 87100 33554432000 4194304 4417452 140734046650560 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=462584 CPUtime=1062.11 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 115776 1252 0 0 106196 15 0 0 25 0 5 0 653975682 473686016 87100 33554432000 4194304 4417452 140734046650560 18446744073709551615 4366646 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=462584 CPUtime=1052.46 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 93670 1252 0 0 105234 12 0 0 25 0 5 0 653975682 473686016 87100 33554432000 4194304 4417452 140734046650560 18446744073709551615 4275920 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=462584 CPUtime=1062.11 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 159531 1252 0 0 106191 20 0 0 25 0 5 0 653975682 473686016 87100 33554432000 4194304 4417452 140734046650560 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4239.03
Current children cumulated vsize (KiB) 462584

[startup+1122.3 s]
/proc/loadavg: 8.23 8.14 7.97 10/297 4170
/proc/meminfo: memFree=28850404/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=517464 CPUtime=4478.47 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 566057 1252 0 0 447771 76 0 0 23 0 5 0 653975662 529883136 100820 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 129366 100820 180 55 0 127252 0
[pid=4048/tid=4055] ppid=4046 vsize=517464 CPUtime=1122.11 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 163789 1252 0 0 112189 22 0 0 25 0 5 0 653975682 529883136 100820 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=517464 CPUtime=1122.11 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 115776 1252 0 0 112196 15 0 0 25 0 5 0 653975682 529883136 100820 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=517464 CPUtime=1111.91 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 97766 1252 0 0 111178 13 0 0 25 0 5 0 653975682 529883136 100820 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364619 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=517464 CPUtime=1122.11 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 179259 1252 0 0 112189 22 0 0 25 0 5 0 653975682 529883136 100820 33554432000 4194304 4417452 140734046650560 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4478.47
Current children cumulated vsize (KiB) 517464

[startup+1182.3 s]
/proc/loadavg: 8.54 8.25 8.02 9/297 4645
/proc/meminfo: memFree=28860196/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=490492 CPUtime=4717.44 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 582905 1252 0 0 471665 79 0 0 23 0 5 0 653975662 502263808 94077 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 122623 94077 180 55 0 120509 0
[pid=4048/tid=4055] ppid=4046 vsize=490492 CPUtime=1182.01 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 169657 1252 0 0 118178 23 0 0 25 0 5 0 653975682 502263808 94077 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=490492 CPUtime=1182 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 119883 1252 0 0 118184 16 0 0 25 0 5 0 653975682 502263808 94077 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=490492 CPUtime=1171.37 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 97777 1252 0 0 117123 14 0 0 25 0 5 0 653975682 502263808 94077 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=490492 CPUtime=1181.83 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 186121 1252 0 0 118160 23 0 0 25 0 5 0 653975682 502263808 94077 33554432000 4194304 4417452 140734046650560 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4717.44
Current children cumulated vsize (KiB) 490492



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.39 8.23 8.02 9/297 4645
/proc/meminfo: memFree=28833740/32951124 swapFree=54427468/67111528
[pid=4048] ppid=4046 vsize=513888 CPUtime=4800.06 cores=1,3,5,7
/proc/4048/stat : 4048 (plingeling) S 4046 4048 3918 0 -1 4202496 592252 1252 0 0 479926 80 0 0 23 0 5 0 653975662 526221312 99926 33554432000 4194304 4417452 140734046650560 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4048/statm: 128472 99926 180 55 0 126358 0
[pid=4048/tid=4055] ppid=4046 vsize=513888 CPUtime=1202.72 cores=1,3,5,7
/proc/4048/task/4055/stat : 4055 (plingeling) R 4046 4048 3918 0 -1 4202560 174908 1252 0 0 120248 24 0 0 25 0 5 0 653975682 526221312 99926 33554432000 4194304 4417452 140734046650560 18446744073709551615 4277945 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4048/tid=4056] ppid=4046 vsize=513888 CPUtime=1202.71 cores=1,3,5,7
/proc/4048/task/4056/stat : 4056 (plingeling) R 4046 4048 3918 0 -1 4202560 119883 1252 0 0 120255 16 0 0 25 0 5 0 653975682 526221312 99926 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4048/tid=4057] ppid=4046 vsize=513888 CPUtime=1191.88 cores=1,3,5,7
/proc/4048/task/4057/stat : 4057 (plingeling) R 4046 4048 3918 0 -1 4202560 101873 1252 0 0 119174 14 0 0 25 0 5 0 653975682 526221312 99926 33554432000 4194304 4417452 140734046650560 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4048/tid=4058] ppid=4046 vsize=513888 CPUtime=1202.54 cores=1,3,5,7
/proc/4048/task/4058/stat : 4058 (plingeling) R 4046 4048 3918 0 -1 4202560 186121 1252 0 0 120231 23 0 0 25 0 5 0 653975682 526221312 99926 33554432000 4194304 4417452 140734046650560 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 513888

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.03
CPU time (s): 4800.13
CPU user time (s): 4799.31
CPU system time (s): 0.824874
CPU usage (%): 399.003
Max. virtual memory (cumulated for all children) (KiB): 528808

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.31
system time used= 0.824874
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 593504
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 120
involuntary context switches= 35759

runsolver used 3.02854 second user time and 7.92279 second system time

The end

Launcher Data

Begin job on node138 at 2011-05-15 03:42:57
IDJOB=3371458
IDBENCH=83135
IDSOLVER=1848
FILE ID=node138/3371458-1305423777
RUNJOBID= node138-1305423354-3937
PBS_JOBID= 13324591
Free space on /tmp= 73340 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom21.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371458-1305423777/watcher-3371458-1305423777 -o /tmp/evaluation-result-3371458-1305423777/solver-3371458-1305423777 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371458-1305423777.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e6407843d1fbd00b68d4ad600a25dfb2
RANDOM SEED=1648187204

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29191344 kB
Buffers:        256388 kB
Cached:        3152624 kB
SwapCached:      18472 kB
Active:         980720 kB
Inactive:      2565516 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29191344 kB
SwapTotal:    67111528 kB
SwapFree:     54427468 kB
Dirty:            3004 kB
Writeback:           8 kB
AnonPages:      130072 kB
Mapped:           9476 kB
Slab:           110852 kB
PageTables:      40680 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 39645484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73612 MiB
End job on node138 at 2011-05-15 04:03:02