Trace number 3371059

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.4 1202.83

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-13-13-unsat.cnf
MD5SUMb828910e9308a3dd9d5f850f224ef842
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark385.978
Satisfiable
(Un)Satisfiability was proved
Number of variables169
Number of clauses1183
Sum of the clauses size4225
Maximum clause length13
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21014
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5169

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371059-1305426532/watcher-3371059-1305426532 -o /tmp/evaluation-result-3371059-1305426532/solver-3371059-1305426532 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371059-1305426532.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.85 1.02 1.19 3/293 13557
/proc/meminfo: memFree=16708344/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=49988 CPUtime=0 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 361 1253 0 0 0 0 0 0 25 0 5 0 654255967 51187712 287 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 12497 287 170 55 0 10383 0
[pid=13557/tid=13563] ppid=13555 vsize=50156 CPUtime=0 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 36 1253 0 0 0 0 0 0 25 0 5 0 654255967 51359744 339 33554432000 4194304 4417452 140733812028080 18446744073709551615 4235973 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=50156 CPUtime=0 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 17 1253 0 0 0 0 0 0 25 0 5 0 654255967 51359744 339 33554432000 4194304 4417452 140733812028080 18446744073709551615 218370651112 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=50156 CPUtime=0 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 20 1253 0 0 0 0 0 0 25 0 5 0 654255967 51359744 339 33554432000 4194304 4417452 140733812028080 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=50156 CPUtime=0 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 1 1253 0 0 0 0 0 0 25 0 5 0 654255967 51359744 339 33554432000 4194304 4417452 140733812028080 18446744073709551615 218371062254 0 0 4096 17442 0 0 0 -1 3 0 0 0

[startup+0.114465 s]
/proc/loadavg: 0.85 1.02 1.19 3/293 13557
/proc/meminfo: memFree=16708344/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=118224 CPUtime=0.43 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 1450 1253 0 0 43 0 0 0 25 0 5 0 654255967 121061376 1061 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 29556 1061 180 55 0 27442 0
[pid=13557/tid=13563] ppid=13555 vsize=118224 CPUtime=0.1 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 133 1253 0 0 10 0 0 0 25 0 5 0 654255967 121061376 1061 33554432000 4194304 4417452 140733812028080 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=118224 CPUtime=0.1 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 193 1253 0 0 10 0 0 0 25 0 5 0 654255967 121061376 1061 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364854 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=118224 CPUtime=0.1 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 283 1253 0 0 10 0 0 0 25 0 5 0 654255967 121061376 1061 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364896 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=118224 CPUtime=0.1 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 501 1253 0 0 10 0 0 0 25 0 5 0 654255967 121061376 1061 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 118224

[startup+0.200439 s]
/proc/loadavg: 0.85 1.02 1.19 3/293 13557
/proc/meminfo: memFree=16708344/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=121016 CPUtime=0.77 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 2757 1253 0 0 77 0 0 0 25 0 5 0 654255967 123920384 1767 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 30254 1767 180 55 0 28140 0
[pid=13557/tid=13563] ppid=13555 vsize=121016 CPUtime=0.19 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 406 1253 0 0 19 0 0 0 25 0 5 0 654255967 123920384 1767 33554432000 4194304 4417452 140733812028080 18446744073709551615 4357719 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=121016 CPUtime=0.19 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 576 1253 0 0 19 0 0 0 25 0 5 0 654255967 123920384 1767 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=121016 CPUtime=0.19 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 510 1253 0 0 19 0 0 0 25 0 5 0 654255967 123920384 1767 33554432000 4194304 4417452 140733812028080 18446744073709551615 4308806 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=121016 CPUtime=0.18 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 925 1253 0 0 18 0 0 0 25 0 5 0 654255967 123920384 1767 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 121016

[startup+0.30045 s]
/proc/loadavg: 0.85 1.02 1.19 3/293 13557
/proc/meminfo: memFree=16708344/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=121444 CPUtime=1.17 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 3311 1253 0 0 117 0 0 0 25 0 5 0 654255967 124358656 1874 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 30361 1874 180 55 0 28247 0
[pid=13557/tid=13563] ppid=13555 vsize=121444 CPUtime=0.29 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 470 1253 0 0 29 0 0 0 25 0 5 0 654255967 124358656 1874 33554432000 4194304 4417452 140733812028080 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=121444 CPUtime=0.29 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 681 1253 0 0 29 0 0 0 25 0 5 0 654255967 124358656 1874 33554432000 4194304 4417452 140733812028080 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=121444 CPUtime=0.29 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 574 1253 0 0 29 0 0 0 25 0 5 0 654255967 124358656 1874 33554432000 4194304 4417452 140733812028080 18446744073709551615 4235985 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=121444 CPUtime=0.28 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 1246 1253 0 0 28 0 0 0 25 0 5 0 654255967 124358656 1874 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 121444

[startup+0.70037 s]
/proc/loadavg: 0.85 1.02 1.19 3/293 13557
/proc/meminfo: memFree=16708344/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=126336 CPUtime=2.77 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 9911 1253 0 0 276 1 0 0 25 0 5 0 654255967 129368064 3093 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 31584 3093 180 55 0 29470 0
[pid=13557/tid=13563] ppid=13555 vsize=126336 CPUtime=0.69 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 2025 1253 0 0 69 0 0 0 25 0 5 0 654255967 129368064 3093 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=126336 CPUtime=0.69 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 2319 1253 0 0 69 0 0 0 25 0 5 0 654255967 129368064 3093 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=126336 CPUtime=0.69 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 2535 1253 0 0 69 0 0 0 25 0 5 0 654255967 129368064 3093 33554432000 4194304 4417452 140733812028080 18446744073709551615 4321595 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=126336 CPUtime=0.68 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 2692 1253 0 0 68 0 0 0 25 0 5 0 654255967 129368064 3093 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 126336

[startup+1.50021 s]
/proc/loadavg: 1.42 1.13 1.22 9/300 13639
/proc/meminfo: memFree=16680892/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=127524 CPUtime=5.96 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 20911 1253 0 0 593 3 0 0 25 0 5 0 654255967 130584576 3384 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 31881 3384 180 55 0 29767 0
[pid=13557/tid=13563] ppid=13555 vsize=127524 CPUtime=1.48 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 4663 1253 0 0 148 0 0 0 25 0 5 0 654255967 130584576 3384 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=127524 CPUtime=1.48 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 4891 1253 0 0 148 0 0 0 25 0 5 0 654255967 130584576 3384 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=127524 CPUtime=1.48 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 5552 1253 0 0 148 0 0 0 25 0 5 0 654255967 130584576 3384 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=127524 CPUtime=1.47 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 5465 1253 0 0 147 0 0 0 25 0 5 0 654255967 130584576 3384 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 127524

[startup+3.10093 s]
/proc/loadavg: 1.42 1.13 1.22 9/300 13639
/proc/meminfo: memFree=16668244/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=136500 CPUtime=12.35 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 41212 1253 0 0 1230 5 0 0 25 0 5 0 654255967 139776000 5614 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 34125 5614 180 55 0 32011 0
[pid=13557/tid=13563] ppid=13555 vsize=136500 CPUtime=3.09 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 10299 1253 0 0 308 1 0 0 25 0 5 0 654255967 139776000 5614 33554432000 4194304 4417452 140733812028080 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=136500 CPUtime=3.09 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 10181 1253 0 0 308 1 0 0 25 0 5 0 654255967 139776000 5614 33554432000 4194304 4417452 140733812028080 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=136500 CPUtime=3.09 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 10820 1253 0 0 308 1 0 0 25 0 5 0 654255967 139776000 5614 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=136500 CPUtime=3.06 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 9572 1253 0 0 305 1 0 0 25 0 5 0 654255967 139776000 5614 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 136500

[startup+6.30036 s]
/proc/loadavg: 1.42 1.13 1.22 9/300 13639
/proc/meminfo: memFree=16639912/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=143896 CPUtime=25.12 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 88642 1253 0 0 2500 12 0 0 25 0 5 0 654255967 147349504 7388 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 35974 7412 180 55 0 33860 0
[pid=13557/tid=13563] ppid=13555 vsize=143896 CPUtime=6.28 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 22912 1253 0 0 626 2 0 0 25 0 5 0 654255967 147349504 7424 33554432000 4194304 4417452 140733812028080 18446744073709551615 4354492 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=143896 CPUtime=6.28 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 24977 1253 0 0 625 3 0 0 25 0 5 0 654255967 147349504 7439 33554432000 4194304 4417452 140733812028080 18446744073709551615 218370651229 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=143896 CPUtime=6.29 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 22193 1253 0 0 627 2 0 0 25 0 5 0 654255967 147349504 7454 33554432000 4194304 4417452 140733812028080 18446744073709551615 4311458 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=143896 CPUtime=6.23 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 18271 1253 0 0 621 2 0 0 25 0 5 0 654255967 147349504 7468 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 143896

[startup+12.7012 s]
/proc/loadavg: 2.43 1.36 1.30 9/300 13639
/proc/meminfo: memFree=16620840/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=149556 CPUtime=50.66 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 186069 1253 0 0 5039 27 0 0 25 0 5 0 654255967 153145344 8879 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 37389 8879 180 55 0 35275 0
[pid=13557/tid=13563] ppid=13555 vsize=149556 CPUtime=12.68 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 49592 1253 0 0 1262 6 0 0 25 0 5 0 654255967 153145344 8879 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=149556 CPUtime=12.68 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 54771 1253 0 0 1260 8 0 0 25 0 5 0 654255967 153145344 8879 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=149556 CPUtime=12.68 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 53501 1253 0 0 1261 7 0 0 25 0 5 0 654255967 153145344 8879 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=149556 CPUtime=12.57 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 27865 1253 0 0 1253 4 0 0 25 0 5 0 654255967 153145344 8879 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 149556

[startup+25.501 s]
/proc/loadavg: 3.37 1.59 1.37 9/300 13675
/proc/meminfo: memFree=16646980/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=156536 CPUtime=101.74 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 309065 1253 0 0 10128 46 0 0 25 0 5 0 654255967 160292864 10592 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 39134 10592 180 55 0 37020 0
[pid=13557/tid=13563] ppid=13555 vsize=156536 CPUtime=25.49 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 78786 1253 0 0 2538 11 0 0 25 0 5 0 654255967 160292864 10592 33554432000 4194304 4417452 140733812028080 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=156536 CPUtime=25.49 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 90026 1253 0 0 2535 14 0 0 25 0 5 0 654255967 160292864 10592 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366126 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=156536 CPUtime=25.49 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 91780 1253 0 0 2536 13 0 0 25 0 5 0 654255967 160292864 10592 33554432000 4194304 4417452 140733812028080 18446744073709551615 4259629 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=156536 CPUtime=25.25 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 48133 1253 0 0 2518 7 0 0 25 0 5 0 654255967 160292864 10592 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.74
Current children cumulated vsize (KiB) 156536

[startup+51.1004 s]
/proc/loadavg: 4.95 2.10 1.55 9/300 13676
/proc/meminfo: memFree=16602604/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=166648 CPUtime=203.91 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 564871 1253 0 0 20307 84 0 0 25 0 5 0 654255967 170647552 13123 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 41662 13145 180 55 0 39548 0
[pid=13557/tid=13563] ppid=13555 vsize=166648 CPUtime=51.08 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 162651 1253 0 0 5085 23 0 0 25 0 5 0 654255967 170647552 13157 33554432000 4194304 4417452 140733812028080 18446744073709551615 218370651229 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=166648 CPUtime=51.09 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 157540 1253 0 0 5085 24 0 0 25 0 5 0 654255967 170647552 13170 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=166648 CPUtime=51.09 cores=1,3,5,7

################
# More data... #
################

[pid=13557/tid=13564] ppid=13555 vsize=365440 CPUtime=762.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1022966 1253 0 0 76081 150 0 0 25 0 5 0 654255967 374210560 62898 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366092 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=365440 CPUtime=762.31 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1021863 1253 0 0 76079 152 0 0 25 0 5 0 654255967 374210560 62898 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=365440 CPUtime=755.38 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 371831 1253 0 0 75476 62 0 0 25 0 5 0 654255967 374210560 62898 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3042.31
Current children cumulated vsize (KiB) 365440

[startup+822.301 s]
/proc/loadavg: 8.00 7.59 5.20 9/300 13697
/proc/meminfo: memFree=16119280/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=356832 CPUtime=3281.75 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 3647653 1253 0 0 327629 546 0 0 25 0 5 0 654255967 365395968 60786 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 89208 60786 180 55 0 87094 0
[pid=13557/tid=13563] ppid=13555 vsize=356832 CPUtime=822.28 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1126447 1253 0 0 82062 166 0 0 25 0 5 0 654255967 365395968 60786 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=356832 CPUtime=822.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1070471 1253 0 0 82074 157 0 0 25 0 5 0 654255967 365395968 60786 33554432000 4194304 4417452 140733812028080 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=356832 CPUtime=822.31 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1055063 1253 0 0 82074 157 0 0 25 0 5 0 654255967 365395968 60786 33554432000 4194304 4417452 140733812028080 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=356832 CPUtime=814.83 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 395332 1253 0 0 81418 65 0 0 25 0 5 0 654255967 365395968 60786 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3281.75
Current children cumulated vsize (KiB) 356832

[startup+882.312 s]
/proc/loadavg: 8.00 7.66 5.38 9/300 13698
/proc/meminfo: memFree=16079060/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=386724 CPUtime=3521.25 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 3749638 1253 0 0 351562 563 0 0 25 0 5 0 654255967 396005376 68604 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 96681 68604 180 55 0 94567 0
[pid=13557/tid=13563] ppid=13555 vsize=386724 CPUtime=882.29 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1163234 1253 0 0 88057 172 0 0 25 0 5 0 654255967 396005376 68604 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=386724 CPUtime=882.32 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1108800 1253 0 0 88069 163 0 0 25 0 5 0 654255967 396005376 68604 33554432000 4194304 4417452 140733812028080 18446744073709551615 4365047 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=386724 CPUtime=882.32 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1068525 1253 0 0 88073 159 0 0 25 0 5 0 654255967 396005376 68604 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=386724 CPUtime=874.29 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 408739 1253 0 0 87362 67 0 0 25 0 5 0 654255967 396005376 68604 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3521.25
Current children cumulated vsize (KiB) 386724

[startup+942.301 s]
/proc/loadavg: 8.00 7.72 5.54 9/300 13700
/proc/meminfo: memFree=16070720/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=358516 CPUtime=3760.68 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 3806913 1253 0 0 375495 573 0 0 25 0 5 0 654255967 367120384 61276 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 89629 61276 180 55 0 87515 0
[pid=13557/tid=13563] ppid=13555 vsize=358516 CPUtime=942.28 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1174541 1253 0 0 94054 174 0 0 25 0 5 0 654255967 367120384 61276 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=358516 CPUtime=942.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1135382 1253 0 0 94064 167 0 0 25 0 5 0 654255967 367120384 61276 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=358516 CPUtime=942.3 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1073355 1253 0 0 94070 160 0 0 25 0 5 0 654255967 367120384 61276 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=358516 CPUtime=933.75 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 423295 1253 0 0 93305 70 0 0 25 0 5 0 654255967 367120384 61276 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3760.68
Current children cumulated vsize (KiB) 358516

[startup+1002.3 s]
/proc/loadavg: 8.05 7.78 5.69 9/300 13701
/proc/meminfo: memFree=16091644/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=358268 CPUtime=4000.12 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 3955951 1253 0 0 399418 594 0 0 25 0 5 0 654255967 366866432 61267 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 89567 61267 180 55 0 87453 0
[pid=13557/tid=13563] ppid=13555 vsize=358268 CPUtime=1002.27 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1208349 1253 0 0 100048 179 0 0 25 0 5 0 654255967 366866432 61267 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=358268 CPUtime=1002.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1166878 1253 0 0 100059 172 0 0 25 0 5 0 654255967 366866432 61267 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=358268 CPUtime=1002.31 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1152898 1253 0 0 100060 171 0 0 25 0 5 0 654255967 366866432 61267 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=358268 CPUtime=993.2 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 427486 1253 0 0 99249 71 0 0 25 0 5 0 654255967 366866432 61267 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4000.12
Current children cumulated vsize (KiB) 358268

[startup+1062.3 s]
/proc/loadavg: 8.14 7.85 5.85 9/300 13703
/proc/meminfo: memFree=16047716/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=360544 CPUtime=4239.58 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 4005332 1253 0 0 423356 602 0 0 25 0 5 0 654255967 369197056 61752 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 90136 61752 180 55 0 88022 0
[pid=13557/tid=13563] ppid=13555 vsize=360544 CPUtime=1062.27 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1220243 1253 0 0 106046 181 0 0 25 0 5 0 654255967 369197056 61752 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=360544 CPUtime=1062.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1183474 1253 0 0 106056 175 0 0 25 0 5 0 654255967 369197056 61752 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=360544 CPUtime=1062.32 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1159593 1253 0 0 106060 172 0 0 25 0 5 0 654255967 369197056 61752 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=360544 CPUtime=1052.66 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 441682 1253 0 0 105193 73 0 0 25 0 5 0 654255967 369197056 61752 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4239.58
Current children cumulated vsize (KiB) 360544

[startup+1122.3 s]
/proc/loadavg: 8.16 7.91 5.99 9/300 13705
/proc/meminfo: memFree=15963856/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=372572 CPUtime=4479.04 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 4126190 1253 0 0 447285 619 0 0 25 0 5 0 654255967 381513728 64751 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 93143 64751 180 55 0 91029 0
[pid=13557/tid=13563] ppid=13555 vsize=372572 CPUtime=1122.27 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1233915 1253 0 0 112044 183 0 0 25 0 5 0 654255967 381513728 64751 33554432000 4194304 4417452 140733812028080 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=372572 CPUtime=1122.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1228850 1253 0 0 112049 182 0 0 25 0 5 0 654255967 381513728 64751 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=372572 CPUtime=1122.32 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1205019 1253 0 0 112054 178 0 0 25 0 5 0 654255967 381513728 64751 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=372572 CPUtime=1112.11 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 458066 1253 0 0 111136 75 0 0 25 0 5 0 654255967 381513728 64751 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4479.04
Current children cumulated vsize (KiB) 372572

[startup+1182.3 s]
/proc/loadavg: 8.16 7.95 6.12 9/300 13706
/proc/meminfo: memFree=15847396/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=441728 CPUtime=4718.51 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 4217533 1253 0 0 471218 633 0 0 25 0 5 0 654255967 452329472 81978 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 110432 81978 180 55 0 108318 0
[pid=13557/tid=13563] ppid=13555 vsize=441728 CPUtime=1182.27 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1280121 1253 0 0 118038 189 0 0 25 0 5 0 654255967 452329472 81978 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=441728 CPUtime=1182.31 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1244440 1253 0 0 118047 184 0 0 25 0 5 0 654255967 452329472 81978 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=441728 CPUtime=1182.31 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1207890 1253 0 0 118053 178 0 0 25 0 5 0 654255967 452329472 81978 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=441728 CPUtime=1171.57 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 484742 1253 0 0 117077 80 0 0 25 0 5 0 654255967 452329472 81978 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4718.51
Current children cumulated vsize (KiB) 441728



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 8.11 7.95 6.16 9/300 13707
/proc/meminfo: memFree=15861772/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=414532 CPUtime=4800.34 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 4238730 1253 0 0 479398 636 0 0 25 0 5 0 654255967 424480768 76442 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 103633 76453 180 55 0 101519 0
[pid=13557/tid=13563] ppid=13555 vsize=414532 CPUtime=1202.79 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1294035 1253 0 0 120088 191 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=414532 CPUtime=1202.82 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1245989 1253 0 0 120098 184 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4241841 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=414532 CPUtime=1202.83 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1214034 1253 0 0 120104 179 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=414532 CPUtime=1191.88 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 484742 1253 0 0 119108 80 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 414532

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.8 s]
/proc/loadavg: 8.11 7.95 6.16 9/300 13707
/proc/meminfo: memFree=15861772/32951124 swapFree=52307768/67111528
[pid=13557] ppid=13555 vsize=414532 CPUtime=4800.34 cores=1,3,5,7
/proc/13557/stat : 13557 (plingeling) S 13555 13557 13510 0 -1 4202496 4238730 1253 0 0 479398 636 0 0 25 0 5 0 654255967 424480768 76442 33554432000 4194304 4417452 140733812028080 18446744073709551615 218382759909 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/13557/statm: 103633 76453 180 55 0 101519 0
[pid=13557/tid=13563] ppid=13555 vsize=414532 CPUtime=1202.79 cores=1,3,5,7
/proc/13557/task/13563/stat : 13563 (plingeling) R 13555 13557 13510 0 -1 4202560 1294035 1253 0 0 120088 191 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13557/tid=13564] ppid=13555 vsize=414532 CPUtime=1202.82 cores=1,3,5,7
/proc/13557/task/13564/stat : 13564 (plingeling) R 13555 13557 13510 0 -1 4202560 1245989 1253 0 0 120098 184 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4241841 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13557/tid=13565] ppid=13555 vsize=414532 CPUtime=1202.83 cores=1,3,5,7
/proc/13557/task/13565/stat : 13565 (plingeling) R 13555 13557 13510 0 -1 4202560 1214034 1253 0 0 120104 179 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13557/tid=13566] ppid=13555 vsize=414532 CPUtime=1191.88 cores=1,3,5,7
/proc/13557/task/13566/stat : 13566 (plingeling) R 13555 13557 13510 0 -1 4202560 484742 1253 0 0 119108 80 0 0 25 0 5 0 654255967 424480768 76852 33554432000 4194304 4417452 140733812028080 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 414532

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.83
CPU time (s): 4800.4
CPU user time (s): 4794.02
CPU system time (s): 6.38003
CPU usage (%): 399.091
Max. virtual memory (cumulated for all children) (KiB): 452524

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.02
system time used= 6.38003
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4240393
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 292
involuntary context switches= 34412

runsolver used 2.96955 second user time and 7.98079 second system time

The end

Launcher Data 

Begin job on node101 at 2011-05-15 04:28:52
IDJOB=3371059
IDBENCH=83217
IDSOLVER=1848
FILE ID=node101/3371059-1305426532
RUNJOBID= node101-1305426532-13529
PBS_JOBID= 13324601
Free space on /tmp= 73760 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-13-13-unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371059-1305426532/watcher-3371059-1305426532 -o /tmp/evaluation-result-3371059-1305426532/solver-3371059-1305426532 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371059-1305426532.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b828910e9308a3dd9d5f850f224ef842
RANDOM SEED=1045209271

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16708756 kB
Buffers:        329480 kB
Cached:        5978076 kB
SwapCached:      14848 kB
Active:       10844652 kB
Inactive:      5118992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16708756 kB
SwapTotal:    67111528 kB
SwapFree:     52307768 kB
Dirty:             508 kB
Writeback:           0 kB
AnonPages:     9653544 kB
Mapped:          14796 kB
Slab:           151112 kB
PageTables:      62424 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 42040984 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73760 MiB
End job on node101 at 2011-05-15 04:48:57