Trace number 3438406

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.9 5009.85

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v945c61409g6.cnf
MD5SUM2094ee8d4e443e860293b947e469bd81
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3439.73
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438406-1306916239/watcher-3438406-1306916239 -o /tmp/evaluation-result-3438406-1306916239/solver-3438406-1306916239 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438406-1306916239.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.14 8.17 8.06 2/439 28149
/proc/meminfo: memFree=32295184/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=20832 CPUtime=0 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 924 0 0 0 0 0 0 0 24 0 1 0 803222711 21331968 549 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/28149/statm: 5208 549 296 106 0 711 0

[startup+0.0405639 s]
/proc/loadavg: 8.14 8.17 8.06 2/439 28149
/proc/meminfo: memFree=32295184/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=100852 CPUtime=0.1 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 2676 0 0 0 10 0 0 0 25 0 8 0 803222711 103272448 2111 33554432000 4194304 4625164 140733830305952 18446744073709551615 4504272 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 25213 2114 324 106 0 20716 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 100852

[startup+0.107596 s]
/proc/loadavg: 8.14 8.17 8.06 2/439 28149
/proc/meminfo: memFree=32295184/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=432472 CPUtime=0.63 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 6180 0 0 0 62 1 0 0 25 0 8 0 803222711 442851328 5170 33554432000 4194304 4625164 140733830305952 18446744073709551615 4499479 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 108118 5170 352 106 0 103621 0
Current children cumulated CPU time (s) 0.63
Current children cumulated vsize (KiB) 432472

[startup+0.300494 s]
/proc/loadavg: 8.14 8.17 8.06 2/439 28149
/proc/meminfo: memFree=32295184/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=436796 CPUtime=2.17 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 11302 0 0 0 216 1 0 0 25 0 8 0 803222711 447279104 8468 33554432000 4194304 4625164 140733830305952 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 109199 8468 352 106 0 104702 0
Current children cumulated CPU time (s) 2.17
Current children cumulated vsize (KiB) 436796

[startup+0.700423 s]
/proc/loadavg: 8.14 8.17 8.06 2/439 28149
/proc/meminfo: memFree=32295184/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=438464 CPUtime=5.37 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 19644 0 0 0 534 3 0 0 25 0 8 0 803222711 448987136 15755 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 109616 15755 354 106 0 105119 0
Current children cumulated CPU time (s) 5.37
Current children cumulated vsize (KiB) 438464

[startup+1.50128 s]
/proc/loadavg: 8.14 8.17 8.06 9/447 28157
/proc/meminfo: memFree=32224200/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=445108 CPUtime=11.76 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 29396 0 0 0 1172 4 0 0 25 0 8 0 803222711 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4519417 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 111277 20797 366 106 0 106780 0
[pid=28149/tid=28151] ppid=28147 vsize=445108 CPUtime=1.48 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 2572 0 0 0 148 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352765 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=445108 CPUtime=1.47 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 1795 0 0 0 147 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=445108 CPUtime=1.44 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3229 0 0 0 144 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=445108 CPUtime=1.44 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 2647 0 0 0 144 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=445108 CPUtime=1.45 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 2494 0 0 0 145 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=445108 CPUtime=1.45 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 2657 0 0 0 145 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=445108 CPUtime=1.47 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 2884 0 0 0 147 0 0 0 25 0 8 0 803222713 455790592 20797 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.76
Current children cumulated vsize (KiB) 445108

[startup+3.101 s]
/proc/loadavg: 8.14 8.17 8.06 9/447 28157
/proc/meminfo: memFree=32192448/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=454024 CPUtime=24.54 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 41674 0 0 0 2448 6 0 0 25 0 8 0 803222711 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 113506 26643 374 106 0 109009 0
[pid=28149/tid=28151] ppid=28147 vsize=454024 CPUtime=3.07 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3948 0 0 0 307 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=454024 CPUtime=3.07 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 1959 0 0 0 307 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=454024 CPUtime=3.04 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 5024 0 0 0 304 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=454024 CPUtime=3.02 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3787 0 0 0 302 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=454024 CPUtime=3.05 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3928 0 0 0 305 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=454024 CPUtime=3.05 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3920 0 0 0 305 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339148 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=454024 CPUtime=3.07 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 4116 0 0 0 307 0 0 0 25 0 8 0 803222713 464920576 26643 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.54
Current children cumulated vsize (KiB) 454024

[startup+6.30044 s]
/proc/loadavg: 8.21 8.18 8.06 9/447 28157
/proc/meminfo: memFree=32151652/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=484404 CPUtime=50.09 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 69738 0 0 0 4999 10 0 0 25 0 8 0 803222711 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 121101 39299 409 106 0 116604 0
[pid=28149/tid=28151] ppid=28147 vsize=484404 CPUtime=6.27 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 5829 0 0 0 627 0 0 0 25 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4288783 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=484404 CPUtime=6.27 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3332 0 0 0 627 0 0 0 25 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=484404 CPUtime=6.24 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 16363 0 0 0 623 1 0 0 25 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=484404 CPUtime=6.17 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 5865 0 0 0 617 0 0 0 25 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352145 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=484404 CPUtime=6.25 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 6307 0 0 0 624 1 0 0 25 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4289896 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=484404 CPUtime=6.26 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 6550 0 0 0 625 1 0 0 23 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=484404 CPUtime=6.27 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 4720 0 0 0 627 0 0 0 25 0 8 0 803222713 496029696 39299 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.09
Current children cumulated vsize (KiB) 484404

[startup+12.7003 s]
/proc/loadavg: 8.19 8.18 8.06 9/447 28157
/proc/meminfo: memFree=32101396/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=516376 CPUtime=101.19 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 103044 0 0 0 10104 15 0 0 25 0 8 0 803222711 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 129094 50120 401 106 0 124597 0
[pid=28149/tid=28151] ppid=28147 vsize=516376 CPUtime=12.67 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 8571 0 0 0 1267 0 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=516376 CPUtime=12.67 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 3827 0 0 0 1267 0 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=516376 CPUtime=12.64 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 31065 0 0 0 1261 3 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=516376 CPUtime=12.48 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 6420 0 0 0 1247 1 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=516376 CPUtime=12.66 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 9223 0 0 0 1264 2 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=516376 CPUtime=12.65 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 9873 0 0 0 1264 1 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4317260 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=516376 CPUtime=12.67 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 5343 0 0 0 1266 1 0 0 25 0 8 0 803222713 528769024 50120 33554432000 4194304 4625164 140733830305952 18446744073709551615 4464363 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.19
Current children cumulated vsize (KiB) 516376

[startup+25.5011 s]
/proc/loadavg: 8.15 8.17 8.06 9/447 28158
/proc/meminfo: memFree=32022656/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=551032 CPUtime=203.4 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 169064 0 0 0 20312 28 0 0 25 0 8 0 803222711 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 137758 69041 544 106 0 133261 0
[pid=28149/tid=28151] ppid=28147 vsize=551032 CPUtime=25.47 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 12832 0 0 0 2546 1 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=551032 CPUtime=25.47 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 6500 0 0 0 2546 1 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4462504 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=551032 CPUtime=25.44 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 72865 0 0 0 2534 10 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4334251 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=551032 CPUtime=25.09 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 9398 0 0 0 2508 1 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=551032 CPUtime=25.45 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 14385 0 0 0 2543 2 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=551032 CPUtime=25.46 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 14919 0 0 0 2543 3 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=551032 CPUtime=25.46 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 8198 0 0 0 2545 1 0 0 25 0 8 0 803222713 564256768 69041 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.4
Current children cumulated vsize (KiB) 551032

[startup+51.1006 s]
/proc/loadavg: 8.10 8.16 8.06 9/447 28158
/proc/meminfo: memFree=31925904/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=691448 CPUtime=407.81 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 338803 0 0 0 40723 58 0 0 25 0 8 0 803222711 708042752 93193 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 172862 93193 432 106 0 168365 0
[pid=28149/tid=28151] ppid=28147 vsize=691448 CPUtime=51.07 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 20654 0 0 0 5104 3 0 0 25 0 8 0 803222713 708042752 93193 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=691448 CPUtime=51.06 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 10480 0 0 0 5105 1 0 0 25 0 8 0 803222713 708042752 93193 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=691448 CPUtime=51.04 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 194688 0 0 0 5073 31 0 0 25 0 8 0 803222713 708042752 93193 33554432000 4194304 4625164 140733830305952 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=691448 CPUtime=50.31 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 13294 0 0 0 5029 2 0 0 25 0 8 0 803222713 708042752 93194 33554432000 4194304 4625164 140733830305952 18446744073709551615 4464984 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=691448 CPUtime=51.06 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 20707 0 0 0 5102 4 0 0 25 0 8 0 803222713 708042752 93194 33554432000 4194304 4625164 140733830305952 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=691448 CPUtime=51.05 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 23430 0 0 0 5101 4 0 0 25 0 8 0 803222713 708042752 93194 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=691448 CPUtime=51.05 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 8969 0 0 0 5103 2 0 0 25 0 8 0 803222713 708042752 93195 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.81

################
# More data... #
################

[pid=28149/tid=28153] ppid=28147 vsize=5462248 CPUtime=4662.24 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 31978102 0 0 0 461646 4578 0 0 25 0 8 0 803222713 5593341952 1051810 33554432000 4194304 4625164 140733830305952 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5462248 CPUtime=4626.22 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 165827 0 0 0 462585 37 0 0 25 0 8 0 803222713 5593341952 1051810 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5462248 CPUtime=4662.29 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 75808 0 0 0 466204 25 0 0 25 0 8 0 803222713 5593341952 1051810 33554432000 4194304 4625164 140733830305952 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5462248 CPUtime=4662.35 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 250853 0 0 0 466182 53 0 0 25 0 8 0 803222713 5593341952 1051810 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5462248 CPUtime=4660.34 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 79521 0 0 0 466012 22 0 0 25 0 8 0 803222713 5593341952 1051810 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37227.2
Current children cumulated vsize (KiB) 5462248

[startup+4722.32 s]
/proc/loadavg: 8.09 8.06 8.00 9/447 28302
/proc/meminfo: memFree=27963108/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=5465484 CPUtime=37706.5 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 35543690 0 0 0 3765445 5201 0 0 25 0 8 0 803222711 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 1366371 1080561 352 106 0 1361874 0
[pid=28149/tid=28151] ppid=28147 vsize=5465484 CPUtime=4722.39 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 184550 0 0 0 472201 38 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=5465484 CPUtime=4688.54 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 108669 0 0 0 468826 28 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=5465484 CPUtime=4722.26 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 32408922 0 0 0 467588 4638 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5465484 CPUtime=4686.24 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 166306 0 0 0 468587 37 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5465484 CPUtime=4722.31 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 75820 0 0 0 472206 25 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349336 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5465484 CPUtime=4722.37 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 250883 0 0 0 472184 53 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5465484 CPUtime=4720.34 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 79821 0 0 0 472011 23 0 0 25 0 8 0 803222713 5596655616 1080561 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37706.5
Current children cumulated vsize (KiB) 5465484

[startup+4782.3 s]
/proc/loadavg: 8.15 8.08 8.01 9/447 28304
/proc/meminfo: memFree=27745892/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=5534644 CPUtime=38185.4 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 36079265 0 0 0 3813270 5275 0 0 25 0 8 0 803222711 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 1383661 1131613 381 106 0 1379164 0
[pid=28149/tid=28151] ppid=28147 vsize=5534644 CPUtime=4782.37 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 184976 0 0 0 478199 38 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=5534644 CPUtime=4747.65 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 108888 0 0 0 474737 28 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=5534644 CPUtime=4782.24 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 32881021 0 0 0 473522 4702 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5534644 CPUtime=4746.23 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 166550 0 0 0 474585 38 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5534644 CPUtime=4782.3 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 75932 0 0 0 478205 25 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4348821 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5534644 CPUtime=4782.35 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 251076 0 0 0 478182 53 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5534644 CPUtime=4780.32 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 79958 0 0 0 478009 23 0 0 25 0 8 0 803222713 5667475456 1131613 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38185.4
Current children cumulated vsize (KiB) 5534644

[startup+4842.3 s]
/proc/loadavg: 8.11 8.08 8.01 9/447 28305
/proc/meminfo: memFree=27722792/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=5536836 CPUtime=38664.6 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 36458908 0 0 0 3861129 5327 0 0 25 0 8 0 803222711 5669720064 1139134 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 1384209 1139135 378 106 0 1379712 0
[pid=28149/tid=28151] ppid=28147 vsize=5536836 CPUtime=4842.37 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 185064 0 0 0 484199 38 0 0 25 0 8 0 803222713 5669720064 1139135 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=5536836 CPUtime=4806.76 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 109099 0 0 0 480648 28 0 0 25 0 8 0 803222713 5669720064 1139136 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=5536836 CPUtime=4842.24 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 33258985 0 0 0 479470 4754 0 0 25 0 8 0 803222713 5669720064 1139136 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5536836 CPUtime=4806.23 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 166816 0 0 0 480585 38 0 0 25 0 8 0 803222713 5669720064 1139137 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351984 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5536836 CPUtime=4842.3 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 75981 0 0 0 484205 25 0 0 25 0 8 0 803222713 5669720064 1139138 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5536836 CPUtime=4842.35 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 251101 0 0 0 484182 53 0 0 25 0 8 0 803222713 5669720064 1139138 33554432000 4194304 4625164 140733830305952 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5536836 CPUtime=4840.31 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 80024 0 0 0 484008 23 0 0 25 0 8 0 803222713 5669720064 1139138 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38664.6
Current children cumulated vsize (KiB) 5536836

[startup+4902.3 s]
/proc/loadavg: 8.09 8.08 8.01 9/447 28307
/proc/meminfo: memFree=27676748/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=5547624 CPUtime=39143.7 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 36882459 0 0 0 3908983 5385 0 0 25 0 8 0 803222711 5680766976 1148885 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 1386906 1148885 352 106 0 1382409 0
[pid=28149/tid=28151] ppid=28147 vsize=5547624 CPUtime=4902.37 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 185171 0 0 0 490199 38 0 0 25 0 8 0 803222713 5680766976 1148885 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=5547624 CPUtime=4865.9 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 109611 0 0 0 486561 29 0 0 25 0 8 0 803222713 5680766976 1148885 33554432000 4194304 4625164 140733830305952 18446744073709551615 4465169 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=5547624 CPUtime=4902.25 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 33673078 0 0 0 485415 4810 0 0 25 0 8 0 803222713 5680766976 1148885 33554432000 4194304 4625164 140733830305952 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5547624 CPUtime=4866.23 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 167253 0 0 0 486585 38 0 0 25 0 8 0 803222713 5680766976 1148885 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5547624 CPUtime=4902.3 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 76074 0 0 0 490205 25 0 0 25 0 8 0 803222713 5680766976 1148886 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349045 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5547624 CPUtime=4902.36 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 251132 0 0 0 490183 53 0 0 25 0 8 0 803222713 5680766976 1148888 33554432000 4194304 4625164 140733830305952 18446744073709551615 4330776 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5547624 CPUtime=4900.29 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 80091 0 0 0 490006 23 0 0 25 0 8 0 803222713 5680766976 1148888 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39143.7
Current children cumulated vsize (KiB) 5547624

[startup+4962.3 s]
/proc/loadavg: 8.08 8.08 8.01 9/447 28308
/proc/meminfo: memFree=27628608/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=5747096 CPUtime=39622.8 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 37393784 0 0 0 3956821 5458 0 0 25 0 8 0 803222711 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4360345 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 1436774 1164667 409 106 0 1432277 0
[pid=28149/tid=28151] ppid=28147 vsize=5747096 CPUtime=4962.37 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 185357 0 0 0 496199 38 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=5747096 CPUtime=4925.02 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 109850 0 0 0 492473 29 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=5747096 CPUtime=4962.24 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 34164924 0 0 0 491346 4878 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5747096 CPUtime=4926.22 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 167463 0 0 0 492584 38 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5747096 CPUtime=4962.29 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 76548 0 0 0 496204 25 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4348867 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5747096 CPUtime=4962.36 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 251147 0 0 0 496183 53 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4330810 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5747096 CPUtime=4960.27 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 80136 0 0 0 496004 23 0 0 25 0 8 0 803222713 5885026304 1164667 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39622.8
Current children cumulated vsize (KiB) 5747096



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.6 s]
/proc/loadavg: 8.09 8.08 8.01 9/447 28310
/proc/meminfo: memFree=27563228/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=5707300 CPUtime=40000.6 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) R 28147 28149 27737 0 -1 4202496 37758374 0 0 0 3994548 5509 0 0 25 0 8 0 803222711 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 1426825 1180304 406 106 0 1422328 0
[pid=28149/tid=28151] ppid=28147 vsize=5707300 CPUtime=5009.69 cores=0-7
/proc/28149/task/28151/stat : 28151 (SArTagnan) R 28147 28149 27737 0 -1 4202560 185449 0 0 0 500931 38 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=5707300 CPUtime=4971.62 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4202560 109931 0 0 0 497133 29 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28149/tid=28153] ppid=28147 vsize=5707300 CPUtime=5009.56 cores=0-7
/proc/28149/task/28153/stat : 28153 (SArTagnan) R 28147 28149 27737 0 -1 4202560 34509048 0 0 0 496031 4925 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28149/tid=28154] ppid=28147 vsize=5707300 CPUtime=4973.54 cores=0-7
/proc/28149/task/28154/stat : 28154 (SArTagnan) R 28147 28149 27737 0 -1 4202560 167617 0 0 0 497316 38 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28149/tid=28155] ppid=28147 vsize=5707300 CPUtime=5009.61 cores=0-7
/proc/28149/task/28155/stat : 28155 (SArTagnan) R 28147 28149 27737 0 -1 4202560 76592 0 0 0 500936 25 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28149/tid=28156] ppid=28147 vsize=5707300 CPUtime=5009.67 cores=0-7
/proc/28149/task/28156/stat : 28156 (SArTagnan) R 28147 28149 27737 0 -1 4202560 251356 0 0 0 500914 53 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28149/tid=28157] ppid=28147 vsize=5707300 CPUtime=5007.58 cores=0-7
/proc/28149/task/28157/stat : 28157 (SArTagnan) R 28147 28149 27737 0 -1 4202560 80180 0 0 0 500735 23 0 0 25 0 8 0 803222713 5844275200 1180304 33554432000 4194304 4625164 140733830305952 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 5707300

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.8 s]
/proc/loadavg: 8.09 8.08 8.01 9/447 28310
/proc/meminfo: memFree=27563228/32950928 swapFree=34365992/67111528
[pid=28149] ppid=28147 vsize=0 CPUtime=40000.8 cores=0-7
/proc/28149/stat : 28149 (SArTagnan) Z 28147 28149 27737 0 -1 4203548 37758374 0 0 0 3994556 5527 0 0 25 0 2 0 803222711 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28149/statm: 0 0 0 0 0 0 0
[pid=28149/tid=28152] ppid=28147 vsize=0 CPUtime=4971.8 cores=0-7
/proc/28149/task/28152/stat : 28152 (SArTagnan) R 28147 28149 27737 0 -1 4203588 109931 0 0 0 497133 47 0 0 25 0 2 0 803222713 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.85
CPU time (s): 40000.9
CPU user time (s): 39945.6
CPU system time (s): 55.3136
CPU usage (%): 798.445
Max. virtual memory (cumulated for all children) (KiB): 6364772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39945.6
system time used= 55.3136
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37758374
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22778
involuntary context switches= 174438

runsolver used 20.6689 second user time and 53.2699 second system time

The end

Launcher Data 

Begin job on node120 at 2011-06-01 10:17:20
IDJOB=3438406
IDBENCH=71300
IDSOLVER=1936
FILE ID=node120/3438406-1306916239
RUNJOBID= node120-1306911050-27751
PBS_JOBID= 13488507
Free space on /tmp= 73932 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v945c61409g6.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438406-1306916239/watcher-3438406-1306916239 -o /tmp/evaluation-result-3438406-1306916239/solver-3438406-1306916239 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438406-1306916239.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2094ee8d4e443e860293b947e469bd81
RANDOM SEED=498333363

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      32295588 kB
Buffers:        147272 kB
Cached:         196988 kB
SwapCached:      12852 kB
Active:         129228 kB
Inactive:       234308 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      32295588 kB
SwapTotal:    67111528 kB
SwapFree:     34365992 kB
Dirty:            1256 kB
Writeback:          24 kB
AnonPages:       17212 kB
Mapped:           8616 kB
Slab:           129784 kB
PageTables:      90748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 105367868 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73932 MiB
End job on node120 at 2011-06-01 11:40:51