Trace number 3290173

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.4 1201.72

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_3_keyfind_1.cnf
MD5SUM4738c3d0ccd52030cff8addcec6bcde9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1404
Number of clauses7572
Sum of the clauses size29588
Maximum clause length5
Minimum clause length1
Number of clauses of size 1140
Number of clauses of size 2240
Number of clauses of size 32992
Number of clauses of size 41008
Number of clauses of size 53192
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290173-1304096408/watcher-3290173-1304096408 -o /tmp/evaluation-result-3290173-1304096408/solver-3290173-1304096408 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3290173-1304096408.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.49 7.81 7.99 6/185 7015
/proc/meminfo: memFree=29725476/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=9496 CPUtime=0 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) R 7013 7015 6968 0 -1 4202496 443 1251 0 0 0 0 0 0 23 0 1 0 521238673 9723904 372 33554432000 4194304 4417332 140737325197968 18446744073709551615 255377301248 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/7015/statm: 2374 372 147 55 0 260 0

[startup+0.100068 s]
/proc/loadavg: 6.49 7.81 7.99 6/185 7015
/proc/meminfo: memFree=29725476/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=53168 CPUtime=0.34 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1263 1251 0 0 34 0 0 0 23 0 5 0 521238673 54444032 1120 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 13292 1120 179 55 0 11178 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 53168

[startup+0.201049 s]
/proc/loadavg: 6.49 7.81 7.99 6/185 7015
/proc/meminfo: memFree=29725476/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=53512 CPUtime=0.75 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1451 1251 0 0 75 0 0 0 23 0 5 0 521238673 54796288 1206 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 13378 1206 179 55 0 11264 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 53512

[startup+0.30103 s]
/proc/loadavg: 6.49 7.81 7.99 6/185 7015
/proc/meminfo: memFree=29725476/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=54672 CPUtime=1.15 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1853 1251 0 0 115 0 0 0 23 0 5 0 521238673 55984128 1481 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 13668 1481 179 55 0 11554 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 54672

[startup+0.700957 s]
/proc/loadavg: 6.49 7.81 7.99 6/185 7015
/proc/meminfo: memFree=29725476/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=57404 CPUtime=2.74 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 3673 1251 0 0 274 0 0 0 23 0 5 0 521238673 58781696 2179 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 14351 2179 179 55 0 12237 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 57404

[startup+1.50081 s]
/proc/loadavg: 6.49 7.81 7.99 9/190 7025
/proc/meminfo: memFree=29707968/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=61208 CPUtime=5.94 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 7075 1251 0 0 593 1 0 0 23 0 5 0 521238673 62676992 3108 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 15302 3108 179 55 0 13188 0
[pid=7015/tid=7022] ppid=7013 vsize=61208 CPUtime=1.48 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 1335 1251 0 0 148 0 0 0 25 0 5 0 521238675 62676992 3108 33554432000 4194304 4417332 140737325197968 18446744073709551615 4352528 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=61208 CPUtime=1.48 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 1095 1251 0 0 148 0 0 0 25 0 5 0 521238675 62676992 3108 33554432000 4194304 4417332 140737325197968 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=61208 CPUtime=1.47 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 2164 1251 0 0 147 0 0 0 25 0 5 0 521238675 62676992 3108 33554432000 4194304 4417332 140737325197968 18446744073709551615 4365872 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=61208 CPUtime=1.48 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 1569 1251 0 0 148 0 0 0 25 0 5 0 521238675 62676992 3108 33554432000 4194304 4417332 140737325197968 18446744073709551615 4357806 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 61208

[startup+3.10051 s]
/proc/loadavg: 6.49 7.81 7.99 9/190 7025
/proc/meminfo: memFree=29701768/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=63024 CPUtime=12.33 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 11856 1251 0 0 1232 1 0 0 23 0 5 0 521238673 64536576 3552 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 15756 3552 179 55 0 13642 0
[pid=7015/tid=7022] ppid=7013 vsize=63024 CPUtime=3.08 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 2264 1251 0 0 308 0 0 0 25 0 5 0 521238675 64536576 3552 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=63024 CPUtime=3.08 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 2529 1251 0 0 308 0 0 0 25 0 5 0 521238675 64536576 3552 33554432000 4194304 4417332 140737325197968 18446744073709551615 4354444 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=63024 CPUtime=3.06 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 3346 1251 0 0 306 0 0 0 25 0 5 0 521238675 64536576 3552 33554432000 4194304 4417332 140737325197968 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=63024 CPUtime=3.08 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 2805 1251 0 0 308 0 0 0 25 0 5 0 521238675 64536576 3552 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 63024

[startup+6.30092 s]
/proc/loadavg: 6.61 7.81 7.99 10/190 7025
/proc/meminfo: memFree=29694100/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=70588 CPUtime=25.11 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 20837 1251 0 0 2509 2 0 0 23 0 5 0 521238673 72282112 5448 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 17647 5448 179 55 0 15533 0
[pid=7015/tid=7022] ppid=7013 vsize=70588 CPUtime=6.28 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 4313 1251 0 0 628 0 0 0 25 0 5 0 521238675 72282112 5448 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=70588 CPUtime=6.28 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 5101 1251 0 0 628 0 0 0 25 0 5 0 521238675 72282112 5448 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=70588 CPUtime=6.24 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 5813 1251 0 0 624 0 0 0 25 0 5 0 521238675 72282112 5448 33554432000 4194304 4417332 140737325197968 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=70588 CPUtime=6.27 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 4698 1251 0 0 627 0 0 0 25 0 5 0 521238675 72282112 5448 33554432000 4194304 4417332 140737325197968 18446744073709551615 4357456 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 70588

[startup+12.7007 s]
/proc/loadavg: 6.72 7.81 7.99 10/190 7025
/proc/meminfo: memFree=29674780/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=81132 CPUtime=50.68 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 38329 1251 0 0 5063 5 0 0 23 0 5 0 521238673 83079168 8084 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 20283 8084 179 55 0 18169 0
[pid=7015/tid=7022] ppid=7013 vsize=81132 CPUtime=12.67 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 8077 1251 0 0 1267 0 0 0 25 0 5 0 521238675 83079168 8084 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=81132 CPUtime=12.68 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 10216 1251 0 0 1267 1 0 0 25 0 5 0 521238675 83079168 8084 33554432000 4194304 4417332 140737325197968 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=81132 CPUtime=12.61 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 10684 1251 0 0 1259 2 0 0 25 0 5 0 521238675 83079168 8084 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=81132 CPUtime=12.68 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 8440 1251 0 0 1267 1 0 0 25 0 5 0 521238675 83079168 8084 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 81132

[startup+25.5004 s]
/proc/loadavg: 7.15 7.86 8.00 10/190 7025
/proc/meminfo: memFree=29667584/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=83920 CPUtime=101.8 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 70362 1251 0 0 10170 10 0 0 23 0 5 0 521238673 85934080 8781 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 20980 8781 179 55 0 18866 0
[pid=7015/tid=7022] ppid=7013 vsize=83920 CPUtime=25.48 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 14777 1251 0 0 2546 2 0 0 25 0 5 0 521238675 85934080 8781 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=83920 CPUtime=25.48 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 18288 1251 0 0 2546 2 0 0 25 0 5 0 521238675 85934080 8781 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=83920 CPUtime=25.33 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 19541 1251 0 0 2531 2 0 0 25 0 5 0 521238675 85934080 8781 33554432000 4194304 4417332 140737325197968 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=83920 CPUtime=25.47 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 16844 1251 0 0 2545 2 0 0 25 0 5 0 521238675 85934080 8781 33554432000 4194304 4417332 140737325197968 18446744073709551615 4366058 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 83920

[startup+51.1006 s]
/proc/loadavg: 7.51 7.88 8.00 10/190 7026
/proc/meminfo: memFree=29637556/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=107168 CPUtime=204.08 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 126234 1251 0 0 20388 20 0 0 23 0 5 0 521238673 109740032 14593 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 26792 14593 179 55 0 24678 0
[pid=7015/tid=7022] ppid=7013 vsize=107168 CPUtime=51.08 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 29445 1251 0 0 5104 4 0 0 25 0 5 0 521238675 109740032 14593 33554432000 4194304 4417332 140737325197968 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=107168 CPUtime=51.07 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 30296 1251 0 0 5103 4 0 0 25 0 5 0 521238675 109740032 14593 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=107168 CPUtime=50.8 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 32351 1251 0 0 5076 4 0 0 25 0 5 0 521238675 109740032 14593 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=107168 CPUtime=51.08 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 33230 1251 0 0 5103 5 0 0 25 0 5 0 521238675 109740032 14593 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 107168

[startup+102.301 s]
/proc/loadavg: 7.82 7.91 8.00 10/190 7036
/proc/meminfo: memFree=29603280/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=119572 CPUtime=408.62 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 213455 1251 0 0 40827 35 0 0 23 0 5 0 521238673 122441728 17694 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 29893 17694 179 55 0 27779 0
[pid=7015/tid=7022] ppid=7013 vsize=119572 CPUtime=102.28 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 48327 1251 0 0 10221 7 0 0 25 0 5 0 521238675 122441728 17694 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=119572 CPUtime=102.28 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 48010 1251 0 0 10221 7 0 0 25 0 5 0 521238675 122441728 17694 33554432000 4194304 4417332 140737325197968 18446744073709551615 4356832 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=119572 CPUtime=101.72 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 59987 1251 0 0 10163 9 0 0 25 0 5 0 521238675 122441728 17694 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=119572 CPUtime=102.28 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 56219 1251 0 0 10219 9 0 0 25 0 5 0 521238675 122441728 17694 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 119572

[startup+162.301 s]
/proc/loadavg: 8.18 8.00 8.03 10/190 7038
/proc/meminfo: memFree=29579456/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=143116 CPUtime=648.28 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 318387 1251 0 0 64777 51 0 0 23 0 5 0 521238673 146550784 23580 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 35779 23580 179 55 0 33665 0
[pid=7015/tid=7022] ppid=7013 vsize=143116 CPUtime=162.28 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 77385 1251 0 0 16217 11 0 0 25 0 5 0 521238675 146550784 23580 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=143116 CPUtime=162.28 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 77977 1251 0 0 16216 12 0 0 25 0 5 0 521238675 146550784 23580 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=143116 CPUtime=161.4 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 86647 1251 0 0 16127 13 0 0 25 0 5 0 521238675 146550784 23580 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=143116 CPUtime=162.28 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 75466 1251 0 0 16215 13 0 0 25 0 5 0 521238675 146550784 23580 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.28
Current children cumulated vsize (KiB) 143116


################
# More data... #
################

[pid=7015/tid=7023] ppid=7013 vsize=219960 CPUtime=702.3 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 229366 1251 0 0 70191 39 0 0 25 0 5 0 521238675 225239040 42792 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=219960 CPUtime=698.47 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 245348 1251 0 0 69809 38 0 0 25 0 5 0 521238675 225239040 42792 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=219960 CPUtime=702.29 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 207173 1251 0 0 70196 33 0 0 25 0 5 0 521238675 225239040 42792 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2805.39
Current children cumulated vsize (KiB) 219960

[startup+762.301 s]
/proc/loadavg: 8.22 8.14 8.08 9/190 7165
/proc/meminfo: memFree=29499836/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=226640 CPUtime=3045.1 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 971237 1251 0 0 304353 157 0 0 23 0 5 0 521238673 232079360 44462 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 56660 44462 180 55 0 54546 0
[pid=7015/tid=7022] ppid=7013 vsize=225380 CPUtime=762.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 242614 1251 0 0 76194 37 0 0 25 0 5 0 521238675 230789120 44147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=225380 CPUtime=762.31 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 242339 1251 0 0 76190 41 0 0 25 0 5 0 521238675 230789120 44147 33554432000 4194304 4417332 140737325197968 18446744073709551615 255377359274 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=225380 CPUtime=758.15 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 262839 1251 0 0 75774 41 0 0 25 0 5 0 521238675 230789120 44147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364788 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=225380 CPUtime=762.3 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 222533 1251 0 0 76194 36 0 0 25 0 5 0 521238675 230789120 44147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4366053 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3045.1
Current children cumulated vsize (KiB) 226640

[startup+822.301 s]
/proc/loadavg: 8.29 8.17 8.09 10/190 7167
/proc/meminfo: memFree=29461592/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=255984 CPUtime=3284.76 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1033982 1251 0 0 328308 168 0 0 23 0 5 0 521238673 262127616 51798 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 63996 51798 180 55 0 61882 0
[pid=7015/tid=7022] ppid=7013 vsize=255984 CPUtime=822.3 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 254367 1251 0 0 82191 39 0 0 25 0 5 0 521238675 262127616 51798 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=255984 CPUtime=822.3 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 254422 1251 0 0 82187 43 0 0 25 0 5 0 521238675 262127616 51798 33554432000 4194304 4417332 140737325197968 18446744073709551615 4366025 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=255984 CPUtime=817.82 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 283687 1251 0 0 81737 45 0 0 25 0 5 0 521238675 262127616 51798 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=255984 CPUtime=822.3 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 240594 1251 0 0 82190 40 0 0 25 0 5 0 521238675 262127616 51798 33554432000 4194304 4417332 140737325197968 18446744073709551615 4250848 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.76
Current children cumulated vsize (KiB) 255984

[startup+882.307 s]
/proc/loadavg: 8.18 8.17 8.09 9/190 7168
/proc/meminfo: memFree=29502108/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=212264 CPUtime=3524.47 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1085540 1251 0 0 352270 177 0 0 23 0 5 0 521238673 217358336 40868 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 53066 40868 180 55 0 50952 0
[pid=7015/tid=7022] ppid=7013 vsize=212264 CPUtime=882.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 266082 1251 0 0 88190 41 0 0 25 0 5 0 521238675 217358336 40868 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=212264 CPUtime=882.31 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 266349 1251 0 0 88186 45 0 0 25 0 5 0 521238675 217358336 40868 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=212264 CPUtime=877.49 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 298000 1251 0 0 87702 47 0 0 25 0 5 0 521238675 217358336 40868 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=212264 CPUtime=882.31 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 254197 1251 0 0 88189 42 0 0 25 0 5 0 521238675 217358336 40868 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.47
Current children cumulated vsize (KiB) 212264

[startup+942.3 s]
/proc/loadavg: 8.34 8.21 8.11 9/190 7170
/proc/meminfo: memFree=29439448/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=259328 CPUtime=3764.12 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1130350 1251 0 0 376228 184 0 0 23 0 5 0 521238673 265551872 52634 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 64832 52634 180 55 0 62718 0
[pid=7015/tid=7022] ppid=7013 vsize=259328 CPUtime=942.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 278742 1251 0 0 94188 43 0 0 25 0 5 0 521238675 265551872 52634 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=259328 CPUtime=942.3 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 275707 1251 0 0 94184 46 0 0 25 0 5 0 521238675 265551872 52634 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=259328 CPUtime=937.17 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 309616 1251 0 0 93668 49 0 0 25 0 5 0 521238675 265551872 52634 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=259328 CPUtime=942.31 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 265373 1251 0 0 94186 45 0 0 25 0 5 0 521238675 265551872 52634 33554432000 4194304 4417332 140737325197968 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 259328

[startup+1002.3 s]
/proc/loadavg: 8.38 8.23 8.12 9/190 7171
/proc/meminfo: memFree=29485044/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=209380 CPUtime=4003.8 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1175678 1251 0 0 400188 192 0 0 23 0 5 0 521238673 214405120 40147 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 52345 40147 180 55 0 50231 0
[pid=7015/tid=7022] ppid=7013 vsize=209380 CPUtime=1002.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 289287 1251 0 0 100186 45 0 0 25 0 5 0 521238675 214405120 40147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=209380 CPUtime=1002.31 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 284146 1251 0 0 100183 48 0 0 25 0 5 0 521238675 214405120 40147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=209380 CPUtime=996.84 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 318284 1251 0 0 99634 50 0 0 25 0 5 0 521238675 214405120 40147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=209380 CPUtime=1002.31 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 283049 1251 0 0 100183 48 0 0 25 0 5 0 521238675 214405120 40147 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.8
Current children cumulated vsize (KiB) 209380

[startup+1062.3 s]
/proc/loadavg: 8.30 8.23 8.12 9/190 7173
/proc/meminfo: memFree=29433928/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=251572 CPUtime=4243.49 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1220252 1251 0 0 424150 199 0 0 23 0 5 0 521238673 257609728 50695 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 62893 50695 180 55 0 60779 0
[pid=7015/tid=7022] ppid=7013 vsize=251572 CPUtime=1062.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 301399 1251 0 0 106184 47 0 0 25 0 5 0 521238675 257609728 50695 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=251572 CPUtime=1062.31 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 293588 1251 0 0 106182 49 0 0 25 0 5 0 521238675 257609728 50695 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=251572 CPUtime=1056.52 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 333090 1251 0 0 105599 53 0 0 25 0 5 0 521238675 257609728 50695 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=251572 CPUtime=1062.3 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 291263 1251 0 0 106182 48 0 0 25 0 5 0 521238675 257609728 50695 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.49
Current children cumulated vsize (KiB) 251572

[startup+1122.3 s]
/proc/loadavg: 8.33 8.24 8.13 9/190 7175
/proc/meminfo: memFree=29421740/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=256996 CPUtime=4483.17 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1272507 1251 0 0 448109 208 0 0 23 0 5 0 521238673 263163904 52051 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 64249 52051 180 55 0 62135 0
[pid=7015/tid=7022] ppid=7013 vsize=256996 CPUtime=1122.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 313240 1251 0 0 112183 48 0 0 25 0 5 0 521238675 263163904 52051 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=256996 CPUtime=1122.31 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 304334 1251 0 0 112180 51 0 0 25 0 5 0 521238675 263163904 52051 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=256996 CPUtime=1116.19 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 345036 1251 0 0 111564 55 0 0 25 0 5 0 521238675 263163904 52051 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=256996 CPUtime=1122.31 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 308985 1251 0 0 112179 52 0 0 25 0 5 0 521238675 263163904 52051 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4483.17
Current children cumulated vsize (KiB) 256996

[startup+1182.3 s]
/proc/loadavg: 8.24 8.22 8.13 9/190 7176
/proc/meminfo: memFree=29443908/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=242720 CPUtime=4722.85 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1312928 1251 0 0 472071 214 0 0 23 0 5 0 521238673 248545280 48482 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 60680 48482 180 55 0 58566 0
[pid=7015/tid=7022] ppid=7013 vsize=242720 CPUtime=1182.31 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 322117 1251 0 0 118182 49 0 0 25 0 5 0 521238675 248545280 48482 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=242720 CPUtime=1182.32 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 313432 1251 0 0 118179 53 0 0 25 0 5 0 521238675 248545280 48482 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=242720 CPUtime=1175.87 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 356100 1251 0 0 117530 57 0 0 25 0 5 0 521238675 248545280 48482 33554432000 4194304 4417332 140737325197968 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=242720 CPUtime=1182.31 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 320367 1251 0 0 118178 53 0 0 25 0 5 0 521238675 248545280 48482 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.85
Current children cumulated vsize (KiB) 242720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.17 8.21 8.12 9/190 7177
/proc/meminfo: memFree=29430628/32951124 swapFree=67111352/67111528
[pid=7015] ppid=7013 vsize=230504 CPUtime=4800.36 cores=1,3,5,7
/proc/7015/stat : 7015 (plingeling) S 7013 7015 6968 0 -1 4202496 1325185 1251 0 0 479820 216 0 0 23 0 5 0 521238673 236036096 45428 33554432000 4194304 4417332 140737325197968 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7015/statm: 57626 45428 180 55 0 55512 0
[pid=7015/tid=7022] ppid=7013 vsize=230504 CPUtime=1201.72 cores=1,3,5,7
/proc/7015/task/7022/stat : 7022 (plingeling) R 7013 7015 6968 0 -1 4202560 324191 1251 0 0 120122 50 0 0 25 0 5 0 521238675 236036096 45428 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7015/tid=7023] ppid=7013 vsize=230504 CPUtime=1201.72 cores=1,3,5,7
/proc/7015/task/7023/stat : 7023 (plingeling) R 7013 7015 6968 0 -1 4202560 316459 1251 0 0 120119 53 0 0 25 0 5 0 521238675 236036096 45428 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7015/tid=7024] ppid=7013 vsize=230504 CPUtime=1195.16 cores=1,3,5,7
/proc/7015/task/7024/stat : 7024 (plingeling) R 7013 7015 6968 0 -1 4202560 359688 1251 0 0 119459 57 0 0 25 0 5 0 521238675 236036096 45428 33554432000 4194304 4417332 140737325197968 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7015/tid=7025] ppid=7013 vsize=230504 CPUtime=1201.72 cores=1,3,5,7
/proc/7015/task/7025/stat : 7025 (plingeling) R 7013 7015 6968 0 -1 4202560 323935 1251 0 0 120118 54 0 0 25 0 5 0 521238675 236036096 45428 33554432000 4194304 4417332 140737325197968 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 230504

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.72
CPU time (s): 4800.4
CPU user time (s): 4798.23
CPU system time (s): 2.17467
CPU usage (%): 399.46
Max. virtual memory (cumulated for all children) (KiB): 285868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.23
system time used= 2.17467
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1326436
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 135
involuntary context switches= 32193

runsolver used 1.87571 second user time and 4.68729 second system time

The end

Launcher Data 

Begin job on node135 at 2011-04-29 19:00:08
IDJOB=3290173
IDBENCH=83421
IDSOLVER=1605
FILE ID=node135/3290173-1304096408
RUNJOBID= node135-1304096408-6987
PBS_JOBID= 13170608
Free space on /tmp= 71120 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_3_keyfind_1.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290173-1304096408/watcher-3290173-1304096408 -o /tmp/evaluation-result-3290173-1304096408/solver-3290173-1304096408 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3290173-1304096408.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4738c3d0ccd52030cff8addcec6bcde9
RANDOM SEED=1138693942

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29725864 kB
Buffers:        911116 kB
Cached:        1727292 kB
SwapCached:        172 kB
Active:         117932 kB
Inactive:      2588020 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29725864 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:             544 kB
Writeback:           0 kB
AnonPages:       67884 kB
Mapped:          15116 kB
Slab:           453596 kB
PageTables:       5540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   254776 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71120 MiB
End job on node135 at 2011-04-29 19:20:12