Trace number 3438456

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.9 5011.05

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2400c266431gyes6.cnf
MD5SUMe23fefb786281285c1d045e8bc698d74
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438456-1306917833/watcher-3438456-1306917833 -o /tmp/evaluation-result-3438456-1306917833/solver-3438456-1306917833 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438456-1306917833.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.34 1.82 1.93 1/491 29890
/proc/meminfo: memFree=27407800/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=25884 CPUtime=0.01 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 990 0 1 0 1 0 0 0 25 0 1 0 882014012 26505216 609 33554432000 4194304 4625164 140733882083328 18446744073709551615 251367546624 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/29890/statm: 6471 610 296 106 0 1974 0

[startup+0.057013 s]
/proc/loadavg: 1.34 1.82 1.93 1/491 29890
/proc/meminfo: memFree=27407800/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=28820 CPUtime=0.04 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 2989 0 1 0 4 0 0 0 25 0 1 0 882014012 29511680 1139 33554432000 4194304 4625164 140733882083328 18446744073709551615 251367546624 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/29890/statm: 7205 1140 296 106 0 2708 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 28820

[startup+0.100973 s]
/proc/loadavg: 1.34 1.82 1.93 1/491 29890
/proc/meminfo: memFree=27407800/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=116884 CPUtime=0.17 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 9271 0 1 0 16 1 0 0 25 0 7 0 882014012 119689216 7420 33554432000 4194304 4625164 140733882083328 18446744073709551615 251367603185 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 29221 7420 301 106 0 24724 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 116884

[startup+0.320258 s]
/proc/loadavg: 1.34 1.82 1.93 1/491 29890
/proc/meminfo: memFree=27407800/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=478472 CPUtime=1.52 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 23117 0 1 0 149 3 0 0 18 0 8 0 882014012 489955328 18664 33554432000 4194304 4625164 140733882083328 18446744073709551615 251367590023 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 119618 18152 387 106 0 115121 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 478472

[startup+1.40668 s]
/proc/loadavg: 1.34 1.82 1.93 1/491 29890
/proc/meminfo: memFree=27407800/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=558228 CPUtime=10.05 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 44076 0 1 0 997 8 0 0 19 0 8 0 882014012 571625472 29442 33554432000 4194304 4625164 140733882083328 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 139557 29442 352 106 0 135060 0
Current children cumulated CPU time (s) 10.05
Current children cumulated vsize (KiB) 558228

[startup+1.50666 s]
/proc/loadavg: 1.34 1.82 1.93 1/491 29890
/proc/meminfo: memFree=27407800/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=558228 CPUtime=10.84 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 44594 0 1 0 1076 8 0 0 19 0 8 0 882014012 571625472 29875 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 139557 29875 352 106 0 135060 0
Current children cumulated CPU time (s) 10.84
Current children cumulated vsize (KiB) 558228

[startup+3.11937 s]
/proc/loadavg: 1.95 1.94 1.97 9/499 29898
/proc/meminfo: memFree=27237748/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=558228 CPUtime=23.71 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 63283 0 1 0 2360 11 0 0 23 0 8 0 882014012 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 139557 43909 356 106 0 135060 0
[pid=29890/tid=29892] ppid=29888 vsize=558228 CPUtime=2.98 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 3694 0 0 0 298 0 0 0 22 0 8 0 882014020 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=558228 CPUtime=2.73 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 4652 0 0 0 273 0 0 0 23 0 8 0 882014020 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=558228 CPUtime=3.02 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 8876 0 0 0 301 1 0 0 25 0 8 0 882014020 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=558228 CPUtime=3.01 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 4282 0 0 0 301 0 0 0 22 0 8 0 882014021 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=558228 CPUtime=3.01 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 5938 0 0 0 300 1 0 0 23 0 8 0 882014021 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4349036 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=558228 CPUtime=2.96 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 5249 0 0 0 296 0 0 0 22 0 8 0 882014021 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=558228 CPUtime=2.92 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 3861 0 0 0 292 0 0 0 23 0 8 0 882014030 571625472 43909 33554432000 4194304 4625164 140733882083328 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 23.71
Current children cumulated vsize (KiB) 558228

[startup+6.30078 s]
/proc/loadavg: 2.44 2.04 2.00 9/499 29898
/proc/meminfo: memFree=27164992/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=567400 CPUtime=49.25 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 92538 0 1 0 4909 16 0 0 25 0 8 0 882014012 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 141850 60549 395 106 0 137353 0
[pid=29890/tid=29892] ppid=29888 vsize=567400 CPUtime=6.13 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 5549 0 0 0 612 1 0 0 25 0 8 0 882014020 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=567400 CPUtime=5.94 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 5047 0 0 0 593 1 0 0 25 0 8 0 882014020 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=567400 CPUtime=6.22 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 18090 0 0 0 620 2 0 0 25 0 8 0 882014020 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4562867 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=567400 CPUtime=6.21 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 6113 0 0 0 620 1 0 0 25 0 8 0 882014021 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=567400 CPUtime=6.2 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 8559 0 0 0 619 1 0 0 25 0 8 0 882014021 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=567400 CPUtime=6.17 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 8036 0 0 0 616 1 0 0 25 0 8 0 882014021 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=567400 CPUtime=6.13 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 6185 0 0 0 612 1 0 0 25 0 8 0 882014030 581017600 60549 33554432000 4194304 4625164 140733882083328 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.25
Current children cumulated vsize (KiB) 567400

[startup+12.7006 s]
/proc/loadavg: 2.88 2.14 2.03 9/499 29898
/proc/meminfo: memFree=27080848/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=659256 CPUtime=100.21 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 132444 0 1 0 9997 24 0 0 25 0 8 0 882014012 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 164814 82936 423 106 0 160317 0
[pid=29890/tid=29892] ppid=29888 vsize=659256 CPUtime=12.42 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 8121 0 0 0 1241 1 0 0 25 0 8 0 882014020 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=659256 CPUtime=12.31 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 7797 0 0 0 1230 1 0 0 25 0 8 0 882014020 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=659256 CPUtime=12.61 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 31330 0 0 0 1256 5 0 0 25 0 8 0 882014020 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=659256 CPUtime=12.59 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 8600 0 0 0 1258 1 0 0 25 0 8 0 882014021 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=659256 CPUtime=12.59 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 9538 0 0 0 1257 2 0 0 25 0 8 0 882014021 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4349643 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=659256 CPUtime=12.55 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 13046 0 0 0 1253 2 0 0 25 0 8 0 882014021 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=659256 CPUtime=12.5 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 7074 0 0 0 1249 1 0 0 25 0 8 0 882014030 675078144 82936 33554432000 4194304 4625164 140733882083328 18446744073709551615 4465328 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 100.21
Current children cumulated vsize (KiB) 659256

[startup+25.5012 s]
/proc/loadavg: 3.67 2.33 2.10 9/499 29899
/proc/meminfo: memFree=26965096/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=708444 CPUtime=202.38 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 174920 0 1 0 20207 31 0 0 25 0 8 0 882014012 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 177111 111411 546 106 0 172614 0
[pid=29890/tid=29892] ppid=29888 vsize=708444 CPUtime=25 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 12598 0 0 0 2498 2 0 0 25 0 8 0 882014020 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=708444 CPUtime=25.11 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 8427 0 0 0 2510 1 0 0 25 0 8 0 882014020 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=708444 CPUtime=25.41 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 39940 0 0 0 2535 6 0 0 25 0 8 0 882014020 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 251367244110 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=708444 CPUtime=25.39 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 9172 0 0 0 2537 2 0 0 25 0 8 0 882014021 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=708444 CPUtime=25.39 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 13579 0 0 0 2537 2 0 0 25 0 8 0 882014021 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=708444 CPUtime=25.34 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 19265 0 0 0 2531 3 0 0 25 0 8 0 882014021 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=708444 CPUtime=25.3 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 7324 0 0 0 2529 1 0 0 25 0 8 0 882014030 725446656 111411 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 202.38
Current children cumulated vsize (KiB) 708444

[startup+51.1005 s]
/proc/loadavg: 5.21 2.80 2.26 9/499 29899
/proc/meminfo: memFree=26835300/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=942476 CPUtime=406.76 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 310616 0 1 0 40622 54 0 0 25 0 8 0 882014012 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 235619 144339 498 106 0 231122 0
[pid=29890/tid=29892] ppid=29888 vsize=942476 CPUtime=50.19 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 21302 0 0 0 5015 4 0 0 25 0 8 0 882014020 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=942476 CPUtime=50.71 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 12297 0 0 0 5069 2 0 0 25 0 8 0 882014020 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=942476 CPUtime=51 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 113216 0 0 0 5083 17 0 0 25 0 8 0 882014020 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=942476 CPUtime=50.99 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 12741 0 0 0 5097 2 0 0 25 0 8 0 882014021 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=942476 CPUtime=50.99 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 21823 0 0 0 5095 4 0 0 25 0 8 0 882014021 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=942476 CPUtime=50.93 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 30374 0 0 0 5088 5 0 0 25 0 8 0 882014021 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=942476 CPUtime=50.9 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 12169 0 0 0 5088 2 0 0 25 0 8 0 882014030 965095424 144339 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 406.76
Current children cumulated vsize (KiB) 942476

[startup+102.301 s]
/proc/loadavg: 6.95 3.69 2.59 9/499 29901
/proc/meminfo: memFree=26626576/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=1116204 CPUtime=815.51 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 615655 0 1 0 81445 106 0 0 25 0 8 0 882014012 1142992896 196204 33554432000 4194304 4625164 140733882083328 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 279051 196204 649 106 0 274554 0
[pid=29890/tid=29892] ppid=29888 vsize=1116204 CPUtime=100.55 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 31170 0 0 0 10048 7 0 0 25 0 8 0 882014020 1142992896 196205 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=1116204 CPUtime=101.92 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 19957 0 0 0 10188 4 0 0 25 0 8 0 882014020 1142992896 196205 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=1116204 CPUtime=102.21 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 353987 0 0 0 10169 52 0 0 25 0 8 0 882014020 1142992896 196205 33554432000 4194304 4625164 140733882083328 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 6 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 5468700

[startup+4722.3 s]
/proc/loadavg: 8.06 8.04 7.96 9/499 30045
/proc/meminfo: memFree=22997700/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=5535308 CPUtime=37697.3 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 35545708 0 1 0 3764020 5710 0 0 25 0 8 0 882014012 5668155392 1101042 33554432000 4194304 4625164 140733882083328 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 1383827 1101043 352 106 0 1379330 0
[pid=29890/tid=29892] ppid=29888 vsize=5535308 CPUtime=4654.99 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 172275 0 0 0 465460 39 0 0 25 0 8 0 882014020 5668155392 1101043 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=5535308 CPUtime=4710.02 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 225121 0 0 0 470813 189 0 0 25 0 8 0 882014020 5668155392 1101043 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=5535308 CPUtime=4722.3 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 32939951 0 0 0 467232 4998 0 0 25 0 8 0 882014020 5668155392 1101043 33554432000 4194304 4625164 140733882083328 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=5535308 CPUtime=4722.19 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 91240 0 0 0 472180 39 0 0 25 0 8 0 882014021 5668155392 1101043 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=5535308 CPUtime=4722.34 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 135339 0 0 0 472201 33 0 0 25 0 8 0 882014021 5668155392 1101044 33554432000 4194304 4625164 140733882083328 18446744073709551615 4329470 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=5535308 CPUtime=4720.99 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 182201 0 0 0 472059 40 0 0 25 0 8 0 882014021 5668155392 1101044 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=5535308 CPUtime=4722.14 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 135786 0 0 0 472120 94 0 0 25 0 8 0 882014030 5668155392 1101044 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37697.3
Current children cumulated vsize (KiB) 5535308

[startup+4782.3 s]
/proc/loadavg: 8.05 8.05 7.97 9/499 30046
/proc/meminfo: memFree=22950668/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=5535308 CPUtime=38176.3 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 36027879 0 1 0 3811835 5795 0 0 25 0 8 0 882014012 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 1383827 1112055 352 106 0 1379330 0
[pid=29890/tid=29892] ppid=29888 vsize=5535308 CPUtime=4714.99 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 172472 0 0 0 471460 39 0 0 25 0 8 0 882014020 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=5535308 CPUtime=4769.03 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 230653 0 0 0 476703 200 0 0 25 0 8 0 882014020 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=5535308 CPUtime=4782.3 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 33412401 0 0 0 473159 5071 0 0 25 0 8 0 882014020 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=5535308 CPUtime=4782.19 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 91280 0 0 0 478180 39 0 0 25 0 8 0 882014021 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351984 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=5535308 CPUtime=4782.34 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 135585 0 0 0 478201 33 0 0 25 0 8 0 882014021 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4329656 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=5535308 CPUtime=4780.98 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 182286 0 0 0 478058 40 0 0 25 0 8 0 882014021 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=5535308 CPUtime=4782.14 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 135962 0 0 0 478120 94 0 0 25 0 8 0 882014030 5668155392 1112055 33554432000 4194304 4625164 140733882083328 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38176.3
Current children cumulated vsize (KiB) 5535308

[startup+4842.3 s]
/proc/loadavg: 8.02 8.03 7.97 9/499 30048
/proc/meminfo: memFree=22930176/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=5535308 CPUtime=38655.3 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 36403356 0 1 0 3859676 5853 0 0 25 0 8 0 882014012 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 1383827 1116731 352 106 0 1379330 0
[pid=29890/tid=29892] ppid=29888 vsize=5535308 CPUtime=4775 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 173448 0 0 0 477460 40 0 0 25 0 8 0 882014020 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=5535308 CPUtime=4828.02 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 230709 0 0 0 482602 200 0 0 25 0 8 0 882014020 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=5535308 CPUtime=4842.3 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 33779681 0 0 0 479103 5127 0 0 25 0 8 0 882014020 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=5535308 CPUtime=4842.19 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 91363 0 0 0 484180 39 0 0 25 0 8 0 882014021 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=5535308 CPUtime=4842.34 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 135725 0 0 0 484201 33 0 0 25 0 8 0 882014021 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=5535308 CPUtime=4840.96 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 182778 0 0 0 484056 40 0 0 25 0 8 0 882014021 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=5535308 CPUtime=4842.15 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 136095 0 0 0 484121 94 0 0 25 0 8 0 882014030 5668155392 1116731 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38655.3
Current children cumulated vsize (KiB) 5535308

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 7.97 9/499 30050
/proc/meminfo: memFree=22905972/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=5539292 CPUtime=39134.3 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 36425947 0 1 0 3907572 5858 0 0 25 0 8 0 882014012 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 1384823 1123052 352 106 0 1380326 0
[pid=29890/tid=29892] ppid=29888 vsize=5539292 CPUtime=4835 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 174309 0 0 0 483460 40 0 0 25 0 8 0 882014020 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=5539292 CPUtime=4887.04 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 231548 0 0 0 488503 201 0 0 25 0 8 0 882014020 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=5539292 CPUtime=4902.3 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 33782812 0 0 0 485103 5127 0 0 25 0 8 0 882014020 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=5539292 CPUtime=4902.19 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 91428 0 0 0 490180 39 0 0 25 0 8 0 882014021 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=5539292 CPUtime=4902.35 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 135930 0 0 0 490202 33 0 0 25 0 8 0 882014021 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=5539292 CPUtime=4900.95 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 182994 0 0 0 490055 40 0 0 25 0 8 0 882014021 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=5539292 CPUtime=4902.14 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 136166 0 0 0 490120 94 0 0 25 0 8 0 882014030 5672235008 1123052 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39134.3
Current children cumulated vsize (KiB) 5539292

[startup+4962.3 s]
/proc/loadavg: 8.11 8.05 7.98 9/499 30051
/proc/meminfo: memFree=22729244/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=5604984 CPUtime=39613.3 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 36488729 0 1 0 3955454 5875 0 0 25 0 8 0 882014012 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4392976 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 1401246 1167009 352 106 0 1396749 0
[pid=29890/tid=29892] ppid=29888 vsize=5604984 CPUtime=4894.99 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 174653 0 0 0 489459 40 0 0 25 0 8 0 882014020 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=5604984 CPUtime=4946.02 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 233609 0 0 0 494400 202 0 0 25 0 8 0 882014020 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=5604984 CPUtime=4962.3 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 33785080 0 0 0 491103 5127 0 0 25 0 8 0 882014020 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=5604984 CPUtime=4962.19 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 91593 0 0 0 496180 39 0 0 25 0 8 0 882014021 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=5604984 CPUtime=4962.35 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 136301 0 0 0 496202 33 0 0 25 0 8 0 882014021 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=5604984 CPUtime=4960.93 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 183624 0 0 0 496053 40 0 0 25 0 8 0 882014021 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=5604984 CPUtime=4962.15 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 139424 0 0 0 496118 97 0 0 25 0 8 0 882014030 5739503616 1167009 33554432000 4194304 4625164 140733882083328 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39613.3
Current children cumulated vsize (KiB) 5604984



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.8 s]
/proc/loadavg: 8.05 8.04 7.98 9/499 30053
/proc/meminfo: memFree=22714080/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=5670520 CPUtime=40000.6 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) R 29888 29890 29864 0 -1 4202496 36524627 0 1 0 3994176 5885 0 0 25 0 8 0 882014012 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 1417630 1170564 352 106 0 1413133 0
[pid=29890/tid=29892] ppid=29888 vsize=5670520 CPUtime=4943.51 cores=0-7
/proc/29890/task/29892/stat : 29892 (SArTagnan) R 29888 29890 29864 0 -1 4202560 174958 0 0 0 494311 40 0 0 25 0 8 0 882014020 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=5670520 CPUtime=4993.71 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4202560 234114 0 0 0 499168 203 0 0 25 0 8 0 882014020 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29890/tid=29894] ppid=29888 vsize=5670520 CPUtime=5010.82 cores=0-7
/proc/29890/task/29894/stat : 29894 (SArTagnan) R 29888 29890 29864 0 -1 4202560 33789709 0 0 0 495954 5128 0 0 25 0 8 0 882014020 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=29890/tid=29895] ppid=29888 vsize=5670520 CPUtime=5010.72 cores=0-7
/proc/29890/task/29895/stat : 29895 (SArTagnan) R 29888 29890 29864 0 -1 4202560 91735 0 0 0 501033 39 0 0 25 0 8 0 882014021 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29890/tid=29896] ppid=29888 vsize=5670520 CPUtime=5010.87 cores=0-7
/proc/29890/task/29896/stat : 29896 (SArTagnan) R 29888 29890 29864 0 -1 4202560 136410 0 0 0 501054 33 0 0 25 0 8 0 882014021 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29890/tid=29897] ppid=29888 vsize=5670520 CPUtime=5009.44 cores=0-7
/proc/29890/task/29897/stat : 29897 (SArTagnan) R 29888 29890 29864 0 -1 4202560 183748 0 0 0 500904 40 0 0 25 0 8 0 882014021 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=29890/tid=29898] ppid=29888 vsize=5670520 CPUtime=5010.66 cores=0-7
/proc/29890/task/29898/stat : 29898 (SArTagnan) R 29888 29890 29864 0 -1 4202560 140509 0 0 0 500967 99 0 0 25 0 8 0 882014030 5806612480 1170564 33554432000 4194304 4625164 140733882083328 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 5670520

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.92 s]
/proc/loadavg: 8.05 8.04 7.98 9/499 30053
/proc/meminfo: memFree=22714080/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=0 CPUtime=40000.8 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) Z 29888 29890 29864 0 -1 4203548 36524629 0 1 0 3994180 5895 0 0 25 0 2 0 882014012 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 0 0 0 0 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=0 CPUtime=4993.82 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4203588 234114 0 0 0 499169 213 0 0 25 0 2 0 882014020 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

[startup+5011 s]
/proc/loadavg: 8.05 8.04 7.98 9/499 30053
/proc/meminfo: memFree=22714080/32950928 swapFree=34421304/67111528
[pid=29890] ppid=29888 vsize=0 CPUtime=40000.8 cores=0-7
/proc/29890/stat : 29890 (SArTagnan) Z 29888 29890 29864 0 -1 4203548 36524629 0 1 0 3994180 5902 0 0 25 0 2 0 882014012 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/29890/statm: 0 0 0 0 0 0 0
[pid=29890/tid=29893] ppid=29888 vsize=0 CPUtime=4993.9 cores=0-7
/proc/29890/task/29893/stat : 29893 (SArTagnan) R 29888 29890 29864 0 -1 4203588 234114 0 0 0 499169 221 0 0 25 0 2 0 882014020 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.05
CPU time (s): 40000.9
CPU user time (s): 39941.8
CPU system time (s): 59.07
CPU usage (%): 798.254
Max. virtual memory (cumulated for all children) (KiB): 6040840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39941.8
system time used= 59.07
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36524629
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9848
involuntary context switches= 170756

runsolver used 22.0756 second user time and 61.2157 second system time

The end

Launcher Data 

Begin job on node113 at 2011-06-01 10:43:53
IDJOB=3438456
IDBENCH=71366
IDSOLVER=1936
FILE ID=node113/3438456-1306917833
RUNJOBID= node113-1306917833-29878
PBS_JOBID= 13488522
Free space on /tmp= 73596 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2400c266431gyes6.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438456-1306917833/watcher-3438456-1306917833 -o /tmp/evaluation-result-3438456-1306917833/solver-3438456-1306917833 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438456-1306917833.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e23fefb786281285c1d045e8bc698d74
RANDOM SEED=17223040

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27408328 kB
Buffers:         66480 kB
Cached:         168036 kB
SwapCached:      13476 kB
Active:        5107920 kB
Inactive:       153052 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27408328 kB
SwapTotal:    67111528 kB
SwapFree:     34421304 kB
Dirty:            3920 kB
Writeback:           0 kB
AnonPages:     5024452 kB
Mapped:          20272 kB
Slab:            93008 kB
PageTables:     116216 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 154764932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73596 MiB
End job on node113 at 2011-06-01 12:07:26