Trace number 3370990

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.28 1203.73

General information on the benchmark

NameSAT02/handmade/pehoushek/plainoldcnf/
5cnf_4300_4300_110.shuffled.cnf
MD5SUM34f8b747bfe8e7b589b8832e56ae8363
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.022996
Satisfiable
(Un)Satisfiability was proved
Number of variables110
Number of clauses1892
Sum of the clauses size9308
Maximum clause length5
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 33
Number of clauses of size 4146
Number of clauses of size 51743
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370990-1305432305/watcher-3370990-1305432305 -o /tmp/evaluation-result-3370990-1305432305/solver-3370990-1305432305 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370990-1305432305.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.64 7.78 7.84 5/365 16524
/proc/meminfo: memFree=30207480/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=116420 CPUtime=0.03 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 596 1257 0 0 3 0 0 0 18 0 5 0 635646750 119214080 523 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 29105 523 177 55 0 26991 0
[pid=16522/tid=16537] ppid=16520 vsize=116420 CPUtime=0.01 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 20 1257 0 0 1 0 0 0 19 0 5 0 635646750 119214080 523 33554432000 4194304 4417452 140735014555504 18446744073709551615 4249193 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=116420 CPUtime=0.01 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 2 1257 0 0 1 0 0 0 19 0 5 0 635646750 119214080 523 33554432000 4194304 4417452 140735014555504 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=116420 CPUtime=0 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 2 1257 0 0 0 0 0 0 20 0 5 0 635646750 119214080 523 33554432000 4194304 4417452 140735014555504 18446744073709551615 212039760415 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=116420 CPUtime=0.01 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 37 1257 0 0 1 0 0 0 18 0 5 0 635646750 119214080 523 33554432000 4194304 4417452 140735014555504 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 0 0 0 0

[startup+0.134187 s]
/proc/loadavg: 6.64 7.78 7.84 5/365 16524
/proc/meminfo: memFree=30207480/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=118220 CPUtime=0.49 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 1239 1257 0 0 49 0 0 0 18 0 5 0 635646750 121057280 960 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 29555 960 179 55 0 27441 0
[pid=16522/tid=16537] ppid=16520 vsize=118220 CPUtime=0.12 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 111 1257 0 0 12 0 0 0 19 0 5 0 635646750 121057280 960 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=118220 CPUtime=0.12 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 192 1257 0 0 12 0 0 0 20 0 5 0 635646750 121057280 960 33554432000 4194304 4417452 140735014555504 18446744073709551615 4250757 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=118220 CPUtime=0.11 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 122 1257 0 0 11 0 0 0 20 0 5 0 635646750 121057280 960 33554432000 4194304 4417452 140735014555504 18446744073709551615 4278570 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=118220 CPUtime=0.12 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 279 1257 0 0 12 0 0 0 18 0 5 0 635646750 121057280 960 33554432000 4194304 4417452 140735014555504 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 118220

[startup+0.234169 s]
/proc/loadavg: 6.64 7.78 7.84 5/365 16524
/proc/meminfo: memFree=30207480/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=119776 CPUtime=0.88 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 2491 1257 0 0 88 0 0 0 18 0 5 0 635646750 122650624 1375 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 29944 1375 179 55 0 27830 0
[pid=16522/tid=16537] ppid=16520 vsize=119776 CPUtime=0.22 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 413 1257 0 0 22 0 0 0 20 0 5 0 635646750 122650624 1375 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=119776 CPUtime=0.22 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 502 1257 0 0 22 0 0 0 20 0 5 0 635646750 122650624 1375 33554432000 4194304 4417452 140735014555504 18446744073709551615 4354141 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=119776 CPUtime=0.21 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 412 1257 0 0 21 0 0 0 20 0 5 0 635646750 122650624 1375 33554432000 4194304 4417452 140735014555504 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=119776 CPUtime=0.22 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 629 1257 0 0 22 0 0 0 18 0 5 0 635646750 122650624 1375 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.88
Current children cumulated vsize (KiB) 119776

[startup+0.301159 s]
/proc/loadavg: 6.64 7.78 7.84 5/365 16524
/proc/meminfo: memFree=30207480/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=119540 CPUtime=1.15 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 3143 1257 0 0 115 0 0 0 18 0 5 0 635646750 122408960 1316 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 29885 1316 179 55 0 27771 0
[pid=16522/tid=16537] ppid=16520 vsize=119540 CPUtime=0.29 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 567 1257 0 0 29 0 0 0 20 0 5 0 635646750 122408960 1316 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=119540 CPUtime=0.29 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 711 1257 0 0 29 0 0 0 20 0 5 0 635646750 122408960 1316 33554432000 4194304 4417452 140735014555504 18446744073709551615 4356894 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=119540 CPUtime=0.27 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 567 1257 0 0 27 0 0 0 20 0 5 0 635646750 122408960 1316 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=119540 CPUtime=0.28 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 763 1257 0 0 28 0 0 0 18 0 5 0 635646750 122408960 1316 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 119540

[startup+0.701087 s]
/proc/loadavg: 6.64 7.78 7.84 5/365 16524
/proc/meminfo: memFree=30207480/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=121728 CPUtime=2.75 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 5881 1257 0 0 275 0 0 0 18 0 5 0 635646750 124649472 1863 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 30432 1863 179 55 0 28318 0
[pid=16522/tid=16537] ppid=16520 vsize=121728 CPUtime=0.69 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 1048 1257 0 0 69 0 0 0 21 0 5 0 635646750 124649472 1863 33554432000 4194304 4417452 140735014555504 18446744073709551615 4270313 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=121728 CPUtime=0.68 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 1676 1257 0 0 68 0 0 0 21 0 5 0 635646750 124649472 1863 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=121728 CPUtime=0.67 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 1189 1257 0 0 67 0 0 0 21 0 5 0 635646750 124649472 1863 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=121728 CPUtime=0.68 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 1433 1257 0 0 68 0 0 0 18 0 5 0 635646750 124649472 1863 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 121728

[startup+1.50094 s]
/proc/loadavg: 6.75 7.78 7.84 10/373 16543
/proc/meminfo: memFree=30189944/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=125396 CPUtime=5.93 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 10964 1257 0 0 592 1 0 0 18 0 5 0 635646750 128405504 2780 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 31349 2780 179 55 0 29235 0
[pid=16522/tid=16537] ppid=16520 vsize=125396 CPUtime=1.49 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 2577 1257 0 0 149 0 0 0 23 0 5 0 635646750 128405504 2780 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=125396 CPUtime=1.48 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 3093 1257 0 0 148 0 0 0 23 0 5 0 635646750 128405504 2780 33554432000 4194304 4417452 140735014555504 18446744073709551615 4250873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=125396 CPUtime=1.46 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 2409 1257 0 0 146 0 0 0 23 0 5 0 635646750 128405504 2780 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=125396 CPUtime=1.48 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 2350 1257 0 0 148 0 0 0 20 0 5 0 635646750 128405504 2780 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 125396

[startup+3.10066 s]
/proc/loadavg: 6.75 7.78 7.84 10/373 16543
/proc/meminfo: memFree=30182752/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=127692 CPUtime=12.32 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 19905 1257 0 0 1229 3 0 0 18 0 5 0 635646750 130756608 3360 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 31923 3360 179 55 0 29809 0
[pid=16522/tid=16537] ppid=16520 vsize=127692 CPUtime=3.08 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 4886 1257 0 0 308 0 0 0 25 0 5 0 635646750 130756608 3360 33554432000 4194304 4417452 140735014555504 18446744073709551615 4247005 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=127692 CPUtime=3.08 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 5596 1257 0 0 308 0 0 0 25 0 5 0 635646750 130756608 3360 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364687 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=127692 CPUtime=3.04 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 4506 1257 0 0 304 0 0 0 25 0 5 0 635646750 130756608 3360 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=127692 CPUtime=3.08 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 4382 1257 0 0 308 0 0 0 25 0 5 0 635646750 130756608 3360 33554432000 4194304 4417452 140735014555504 18446744073709551615 4357269 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 127692

[startup+6.30109 s]
/proc/loadavg: 6.75 7.78 7.84 10/373 16543
/proc/meminfo: memFree=30177932/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=128844 CPUtime=25.08 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 32530 1257 0 0 2502 6 0 0 18 0 5 0 635646750 131936256 3616 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 32211 3616 179 55 0 30097 0
[pid=16522/tid=16537] ppid=16520 vsize=128844 CPUtime=6.28 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 8183 1257 0 0 627 1 0 0 25 0 5 0 635646750 131936256 3616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=128844 CPUtime=6.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 8540 1257 0 0 627 1 0 0 25 0 5 0 635646750 131936256 3616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=128844 CPUtime=6.2 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 7584 1257 0 0 619 1 0 0 25 0 5 0 635646750 131936256 3616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=128844 CPUtime=6.28 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 7688 1257 0 0 627 1 0 0 25 0 5 0 635646750 131936256 3616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.08
Current children cumulated vsize (KiB) 128844

[startup+12.7009 s]
/proc/loadavg: 6.94 7.79 7.85 10/373 16543
/proc/meminfo: memFree=30162844/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=132716 CPUtime=50.6 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 56670 1257 0 0 5051 9 0 0 18 0 5 0 635646750 135901184 4616 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 33179 4616 179 55 0 31065 0
[pid=16522/tid=16537] ppid=16520 vsize=132716 CPUtime=12.68 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 14083 1257 0 0 1266 2 0 0 25 0 5 0 635646750 135901184 4616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4353830 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=132716 CPUtime=12.68 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 14705 1257 0 0 1266 2 0 0 25 0 5 0 635646750 135901184 4616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=132716 CPUtime=12.52 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 13960 1257 0 0 1250 2 0 0 25 0 5 0 635646750 135901184 4616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=132716 CPUtime=12.68 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 13387 1257 0 0 1267 1 0 0 25 0 5 0 635646750 135901184 4616 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.6
Current children cumulated vsize (KiB) 132716

[startup+25.5007 s]
/proc/loadavg: 7.10 7.80 7.85 10/373 16543
/proc/meminfo: memFree=30153536/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=142876 CPUtime=101.65 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 88680 1257 0 0 10151 14 0 0 18 0 5 0 635646750 146305024 7144 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 35719 7144 179 55 0 33605 0
[pid=16522/tid=16537] ppid=16520 vsize=142876 CPUtime=25.48 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 21821 1257 0 0 2545 3 0 0 25 0 5 0 635646750 146305024 7144 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=142876 CPUtime=25.48 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 22627 1257 0 0 2545 3 0 0 25 0 5 0 635646750 146305024 7144 33554432000 4194304 4417452 140735014555504 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=142876 CPUtime=25.18 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 22622 1257 0 0 2514 4 0 0 25 0 5 0 635646750 146305024 7144 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=142876 CPUtime=25.48 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 21075 1257 0 0 2546 2 0 0 25 0 5 0 635646750 146305024 7144 33554432000 4194304 4417452 140735014555504 18446744073709551615 4366607 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.65
Current children cumulated vsize (KiB) 142876

[startup+51.1011 s]
/proc/loadavg: 7.41 7.81 7.85 10/373 16544
/proc/meminfo: memFree=30130188/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=154032 CPUtime=203.75 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 143773 1257 0 0 20353 22 0 0 18 0 5 0 635646750 157728768 9945 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 38508 9945 179 55 0 36394 0
[pid=16522/tid=16537] ppid=16520 vsize=154032 CPUtime=51.07 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 35807 1257 0 0 5103 4 0 0 25 0 5 0 635646750 157728768 9945 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=154032 CPUtime=51.08 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 35968 1257 0 0 5103 5 0 0 25 0 5 0 635646750 157728768 9945 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=154032 CPUtime=50.47 cores=0,2,4,6

################
# More data... #
################

[pid=16522/tid=16539] ppid=16520 vsize=208212 CPUtime=702.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 170872 1257 0 0 70200 28 0 0 25 0 5 0 635646750 213209088 23457 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=208212 CPUtime=694.01 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 170681 1257 0 0 69371 30 0 0 25 0 5 0 635646750 213209088 23457 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=208212 CPUtime=702.3 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 176140 1257 0 0 70203 27 0 0 25 0 5 0 635646750 213209088 23457 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800.79
Current children cumulated vsize (KiB) 208212

[startup+762.301 s]
/proc/loadavg: 8.12 8.09 7.97 10/373 16563
/proc/meminfo: memFree=30025496/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=220068 CPUtime=3040.11 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 723587 1257 0 0 303892 119 0 0 18 0 5 0 635646750 225349632 26422 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 55017 26422 179 55 0 52903 0
[pid=16522/tid=16537] ppid=16520 vsize=220068 CPUtime=762.17 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 187282 1257 0 0 76187 30 0 0 25 0 5 0 635646750 225349632 26422 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=220068 CPUtime=762.29 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 177144 1257 0 0 76200 29 0 0 25 0 5 0 635646750 225349632 26422 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=220068 CPUtime=753.31 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 177186 1257 0 0 75300 31 0 0 25 0 5 0 635646750 225349632 26422 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=220068 CPUtime=762.32 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 181440 1257 0 0 76204 28 0 0 25 0 5 0 635646750 225349632 26422 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3040.11
Current children cumulated vsize (KiB) 220068

[startup+822.3 s]
/proc/loadavg: 8.12 8.10 7.98 10/373 16565
/proc/meminfo: memFree=30002880/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=218284 CPUtime=3279.35 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 756210 1257 0 0 327810 125 0 0 18 0 5 0 635646750 223522816 25976 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 54571 25976 179 55 0 52457 0
[pid=16522/tid=16537] ppid=16520 vsize=218284 CPUtime=822.14 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 193632 1257 0 0 82183 31 0 0 25 0 5 0 635646750 223522816 25976 33554432000 4194304 4417452 140735014555504 18446744073709551615 4366117 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=218284 CPUtime=822.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 187787 1257 0 0 82197 31 0 0 25 0 5 0 635646750 223522816 25976 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=218284 CPUtime=812.6 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 183834 1257 0 0 81227 33 0 0 25 0 5 0 635646750 223522816 25976 33554432000 4194304 4417452 140735014555504 18446744073709551615 4343760 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=218284 CPUtime=822.3 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 190422 1257 0 0 82201 29 0 0 25 0 5 0 635646750 223522816 25976 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3279.35
Current children cumulated vsize (KiB) 218284

[startup+882.315 s]
/proc/loadavg: 8.11 8.11 7.99 10/373 16566
/proc/meminfo: memFree=29991792/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=227540 CPUtime=3518.69 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 786109 1257 0 0 351739 130 0 0 18 0 5 0 635646750 233000960 28290 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 56885 28290 179 55 0 54771 0
[pid=16522/tid=16537] ppid=16520 vsize=227540 CPUtime=882.15 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 201322 1257 0 0 88183 32 0 0 25 0 5 0 635646750 233000960 28290 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=227540 CPUtime=882.3 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 194376 1257 0 0 88197 33 0 0 25 0 5 0 635646750 233000960 28290 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=227540 CPUtime=871.9 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 193128 1257 0 0 87156 34 0 0 25 0 5 0 635646750 233000960 28290 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=227540 CPUtime=882.32 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 196748 1257 0 0 88202 30 0 0 25 0 5 0 635646750 233000960 28290 33554432000 4194304 4417452 140735014555504 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3518.69
Current children cumulated vsize (KiB) 227540

[startup+942.301 s]
/proc/loadavg: 8.26 8.14 8.01 10/373 16568
/proc/meminfo: memFree=29987036/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=233948 CPUtime=3757.94 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 817481 1257 0 0 375659 135 0 0 18 0 5 0 635646750 239562752 29916 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 58487 29916 179 55 0 56373 0
[pid=16522/tid=16537] ppid=16520 vsize=233948 CPUtime=942.12 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 207823 1257 0 0 94179 33 0 0 25 0 5 0 635646750 239562752 29916 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=233948 CPUtime=942.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 203978 1257 0 0 94194 34 0 0 25 0 5 0 635646750 239562752 29916 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=233948 CPUtime=931.18 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 199610 1257 0 0 93083 35 0 0 25 0 5 0 635646750 239562752 29916 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=233948 CPUtime=942.31 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 205535 1257 0 0 94200 31 0 0 25 0 5 0 635646750 239562752 29916 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3757.94
Current children cumulated vsize (KiB) 233948

[startup+1002.3 s]
/proc/loadavg: 8.10 8.12 8.00 10/373 16570
/proc/meminfo: memFree=29973236/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=237660 CPUtime=3997.21 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 846770 1257 0 0 399581 140 0 0 18 0 5 0 635646750 243363840 30839 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 59415 30839 179 55 0 57301 0
[pid=16522/tid=16537] ppid=16520 vsize=237660 CPUtime=1002.11 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 217019 1257 0 0 100176 35 0 0 25 0 5 0 635646750 243363840 30839 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=237660 CPUtime=1002.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 212130 1257 0 0 100193 35 0 0 25 0 5 0 635646750 243363840 30839 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=237660 CPUtime=990.48 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 207065 1257 0 0 99011 37 0 0 25 0 5 0 635646750 243363840 30839 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=237660 CPUtime=1002.31 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 210021 1257 0 0 100199 32 0 0 25 0 5 0 635646750 243363840 30839 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3997.21
Current children cumulated vsize (KiB) 237660

[startup+1062.3 s]
/proc/loadavg: 8.14 8.12 8.01 10/373 16571
/proc/meminfo: memFree=29995384/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=230656 CPUtime=4236.5 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 874947 1257 0 0 423505 145 0 0 18 0 5 0 635646750 236191744 29099 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 57664 29099 179 55 0 55550 0
[pid=16522/tid=16537] ppid=16520 vsize=230656 CPUtime=1062.09 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 222310 1257 0 0 106174 35 0 0 25 0 5 0 635646750 236191744 29099 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=230656 CPUtime=1062.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 220321 1257 0 0 106192 36 0 0 25 0 5 0 635646750 236191744 29099 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=230656 CPUtime=1049.77 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 213906 1257 0 0 104939 38 0 0 25 0 5 0 635646750 236191744 29099 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=230656 CPUtime=1062.31 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 217875 1257 0 0 106198 33 0 0 25 0 5 0 635646750 236191744 29099 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4236.5
Current children cumulated vsize (KiB) 230656

[startup+1122.3 s]
/proc/loadavg: 8.20 8.13 8.01 10/373 16573
/proc/meminfo: memFree=29995956/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=217376 CPUtime=4475.78 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 899525 1257 0 0 447429 149 0 0 18 0 5 0 635646750 222593024 25777 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 54344 25777 179 55 0 52230 0
[pid=16522/tid=16537] ppid=16520 vsize=217376 CPUtime=1122.09 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 229603 1257 0 0 112173 36 0 0 25 0 5 0 635646750 222593024 25777 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=217376 CPUtime=1122.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 225498 1257 0 0 112190 38 0 0 25 0 5 0 635646750 222593024 25777 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=217376 CPUtime=1109.07 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 220385 1257 0 0 110867 40 0 0 25 0 5 0 635646750 222593024 25777 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=217376 CPUtime=1122.32 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 223504 1257 0 0 112198 34 0 0 25 0 5 0 635646750 222593024 25777 33554432000 4194304 4417452 140735014555504 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4475.78
Current children cumulated vsize (KiB) 217376

[startup+1182.3 s]
/proc/loadavg: 8.14 8.12 8.01 10/373 16574
/proc/meminfo: memFree=29967516/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=217976 CPUtime=4715.08 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 923258 1257 0 0 471355 153 0 0 18 0 5 0 635646750 223207424 25930 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 54494 25930 179 55 0 52380 0
[pid=16522/tid=16537] ppid=16520 vsize=217976 CPUtime=1182.07 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 235217 1257 0 0 118170 37 0 0 25 0 5 0 635646750 223207424 25930 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=217976 CPUtime=1182.28 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 233972 1257 0 0 118189 39 0 0 25 0 5 0 635646750 223207424 25930 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=217976 CPUtime=1168.37 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 225617 1257 0 0 116797 40 0 0 25 0 5 0 635646750 223207424 25930 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=217976 CPUtime=1182.31 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 227917 1257 0 0 118197 34 0 0 25 0 5 0 635646750 223207424 25930 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4715.08
Current children cumulated vsize (KiB) 217976



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 8.18 8.13 8.02 10/374 16578
/proc/meminfo: memFree=29961896/32951124 swapFree=51873460/67111528
[pid=16522] ppid=16520 vsize=236096 CPUtime=4800.24 cores=0,2,4,6
/proc/16522/stat : 16522 (plingeling) S 16520 16522 8955 0 -1 4202496 932190 1257 0 0 479869 155 0 0 18 0 5 0 635646750 241762304 30460 33554432000 4194304 4417452 140735014555504 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16522/statm: 59024 30460 179 55 0 56910 0
[pid=16522/tid=16537] ppid=16520 vsize=236096 CPUtime=1203.49 cores=0,2,4,6
/proc/16522/task/16537/stat : 16537 (plingeling) R 16520 16522 8955 0 -1 4202560 236997 1257 0 0 120312 37 0 0 25 0 5 0 635646750 241762304 30460 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16522/tid=16539] ppid=16520 vsize=236096 CPUtime=1203.62 cores=0,2,4,6
/proc/16522/task/16539/stat : 16539 (plingeling) R 16520 16522 8955 0 -1 4202560 235587 1257 0 0 120323 39 0 0 25 0 5 0 635646750 241762304 30460 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16522/tid=16540] ppid=16520 vsize=236096 CPUtime=1189.36 cores=0,2,4,6
/proc/16522/task/16540/stat : 16540 (plingeling) R 16520 16522 8955 0 -1 4202560 227449 1257 0 0 118895 41 0 0 25 0 5 0 635646750 241762304 30460 33554432000 4194304 4417452 140735014555504 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16522/tid=16541] ppid=16520 vsize=236096 CPUtime=1203.73 cores=0,2,4,6
/proc/16522/task/16541/stat : 16541 (plingeling) R 16520 16522 8955 0 -1 4202560 231622 1257 0 0 120338 35 0 0 25 0 5 0 635646750 241762304 30460 33554432000 4194304 4417452 140735014555504 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 236096

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.73
CPU time (s): 4800.28
CPU user time (s): 4798.72
CPU system time (s): 1.55976
CPU usage (%): 398.785
Max. virtual memory (cumulated for all children) (KiB): 246636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.72
system time used= 1.55976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 933447
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 179
involuntary context switches= 40769

runsolver used 4.01939 second user time and 10.1914 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-15 06:05:05
IDJOB=3370990
IDBENCH=87455
IDSOLVER=1848
FILE ID=node146/3370990-1305432305
RUNJOBID= node146-1305432305-16500
PBS_JOBID= 13324589
Free space on /tmp= 73336 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT02/handmade/pehoushek/plainoldcnf/5cnf_4300_4300_110.shuffled.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370990-1305432305/watcher-3370990-1305432305 -o /tmp/evaluation-result-3370990-1305432305/solver-3370990-1305432305 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370990-1305432305.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 34f8b747bfe8e7b589b8832e56ae8363
RANDOM SEED=1940272296

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30208132 kB
Buffers:        102332 kB
Cached:         169732 kB
SwapCached:      56148 kB
Active:         766944 kB
Inactive:      1747376 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30208132 kB
SwapTotal:    67111528 kB
SwapFree:     51873460 kB
Dirty:             528 kB
Writeback:           0 kB
AnonPages:     2193196 kB
Mapped:          16724 kB
Slab:           104116 kB
PageTables:      58952 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 81758556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73336 MiB
End job on node146 at 2011-05-15 06:25:11