Trace number 3439086

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001 5011.85

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-5_4232.cnf
MD5SUM86d9f733c618d2ca060f457ab8a19463
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4230
Number of clauses100443
Sum of the clauses size411786
Maximum clause length5
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 490429
Number of clauses of size 510014
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439086-1306927115/watcher-3439086-1306927115 -o /tmp/evaluation-result-3439086-1306927115/solver-3439086-1306927115 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439086-1306927115.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.06 8.02 1/507 23159
/proc/meminfo: memFree=19809916/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=23036 CPUtime=0.01 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 1426 0 0 0 1 0 0 0 25 0 1 0 882942240 23588864 978 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/23159/statm: 5759 981 296 106 0 1262 0

[startup+0.114621 s]
/proc/loadavg: 8.03 8.06 8.02 1/507 23159
/proc/meminfo: memFree=19809916/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=416796 CPUtime=0.29 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 16704 0 0 0 27 2 0 0 25 0 8 0 882942240 426799104 14052 33554432000 4194304 4625164 140734212798912 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 104199 14052 342 106 0 99702 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 416796

[startup+0.200417 s]
/proc/loadavg: 8.03 8.06 8.02 1/507 23159
/proc/meminfo: memFree=19809916/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=421196 CPUtime=0.98 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 20210 0 0 0 95 3 0 0 25 0 8 0 882942240 431304704 15362 33554432000 4194304 4625164 140734212798912 18446744073709551615 215988697631 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 105299 15362 344 106 0 100802 0
Current children cumulated CPU time (s) 0.98
Current children cumulated vsize (KiB) 421196

[startup+0.300399 s]
/proc/loadavg: 8.03 8.06 8.02 1/507 23159
/proc/meminfo: memFree=19809916/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=424132 CPUtime=1.77 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 22641 0 0 0 174 3 0 0 25 0 8 0 882942240 434311168 16329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4509998 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 106033 16332 344 106 0 101536 0
Current children cumulated CPU time (s) 1.77
Current children cumulated vsize (KiB) 424132

[startup+0.70033 s]
/proc/loadavg: 8.03 8.06 8.02 1/507 23159
/proc/meminfo: memFree=19809916/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=432456 CPUtime=4.97 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 30588 0 0 0 492 5 0 0 25 0 8 0 882942240 442834944 20144 33554432000 4194304 4625164 140734212798912 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 108114 20144 344 106 0 103617 0
Current children cumulated CPU time (s) 4.97
Current children cumulated vsize (KiB) 432456

[startup+1.50119 s]
/proc/loadavg: 8.03 8.06 8.02 9/515 23167
/proc/meminfo: memFree=19715124/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=436860 CPUtime=11.34 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 41403 0 0 0 1127 7 0 0 25 0 8 0 882942240 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 109215 26176 344 106 0 104718 0
[pid=23159/tid=23161] ppid=23157 vsize=436860 CPUtime=1.4 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 1902 0 0 0 140 0 0 0 25 0 8 0 882942248 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=436860 CPUtime=1.41 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 1887 0 0 0 141 0 0 0 25 0 8 0 882942248 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=436860 CPUtime=1.39 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 12860 0 0 0 137 2 0 0 25 0 8 0 882942248 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=436860 CPUtime=1.38 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 1822 0 0 0 138 0 0 0 25 0 8 0 882942248 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=436860 CPUtime=1.41 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 1894 0 0 0 141 0 0 0 25 0 8 0 882942248 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=436860 CPUtime=1.41 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3121 0 0 0 141 0 0 0 25 0 8 0 882942248 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=436860 CPUtime=1.4 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 1925 0 0 0 140 0 0 0 25 0 8 0 882942249 447344640 26176 33554432000 4194304 4625164 140734212798912 18446744073709551615 4465815 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.34
Current children cumulated vsize (KiB) 436860

[startup+3.10091 s]
/proc/loadavg: 8.03 8.06 8.02 9/515 23167
/proc/meminfo: memFree=19682636/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=458540 CPUtime=24.12 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 66498 0 0 0 2400 12 0 0 25 0 8 0 882942240 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4396545 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 114635 38050 348 106 0 110138 0
[pid=23159/tid=23161] ppid=23157 vsize=458540 CPUtime=3 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3551 0 0 0 300 0 0 0 25 0 8 0 882942248 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351853 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=458540 CPUtime=3 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3452 0 0 0 300 0 0 0 25 0 8 0 882942248 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=458540 CPUtime=2.99 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 27168 0 0 0 294 5 0 0 25 0 8 0 882942248 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=458540 CPUtime=2.95 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3489 0 0 0 295 0 0 0 25 0 8 0 882942248 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=458540 CPUtime=3.01 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3454 0 0 0 301 0 0 0 25 0 8 0 882942248 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=458540 CPUtime=3.01 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3847 0 0 0 300 1 0 0 25 0 8 0 882942248 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=458540 CPUtime=3 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 3540 0 0 0 300 0 0 0 25 0 8 0 882942249 469544960 38050 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.12
Current children cumulated vsize (KiB) 458540

[startup+6.30035 s]
/proc/loadavg: 8.03 8.06 8.02 9/515 23168
/proc/meminfo: memFree=19601060/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=494420 CPUtime=49.65 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 108569 0 0 0 4944 21 0 0 25 0 8 0 882942240 506286080 55959 33554432000 4194304 4625164 140734212798912 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 123605 55960 348 106 0 119108 0
[pid=23159/tid=23161] ppid=23157 vsize=494420 CPUtime=6.2 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 5945 0 0 0 620 0 0 0 25 0 8 0 882942248 506286080 55960 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=494420 CPUtime=6.21 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 6218 0 0 0 620 1 0 0 25 0 8 0 882942248 506286080 55960 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=494420 CPUtime=6.18 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 50525 0 0 0 608 10 0 0 25 0 8 0 882942248 506286080 55960 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=494420 CPUtime=6.1 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 4338 0 0 0 609 1 0 0 25 0 8 0 882942248 506286080 55960 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=494420 CPUtime=6.21 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 6193 0 0 0 620 1 0 0 25 0 8 0 882942248 506286080 55960 33554432000 4194304 4625164 140734212798912 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=494420 CPUtime=6.21 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 9152 0 0 0 619 2 0 0 25 0 8 0 882942248 506286080 55961 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=494420 CPUtime=6.2 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 6012 0 0 0 619 1 0 0 25 0 8 0 882942249 506286080 55961 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.65
Current children cumulated vsize (KiB) 494420

[startup+12.7012 s]
/proc/loadavg: 8.02 8.06 8.02 9/515 23168
/proc/meminfo: memFree=19472008/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=582272 CPUtime=100.75 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 183520 0 0 0 10041 34 0 0 25 0 8 0 882942240 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 145568 86123 348 106 0 141071 0
[pid=23159/tid=23161] ppid=23157 vsize=582272 CPUtime=12.61 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 7095 0 0 0 1260 1 0 0 25 0 8 0 882942248 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=582272 CPUtime=12.6 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 10899 0 0 0 1259 1 0 0 25 0 8 0 882942248 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351984 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=582272 CPUtime=12.59 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 100256 0 0 0 1241 18 0 0 25 0 8 0 882942248 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=582272 CPUtime=12.38 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 7397 0 0 0 1237 1 0 0 25 0 8 0 882942248 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=582272 CPUtime=12.61 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 11237 0 0 0 1260 1 0 0 25 0 8 0 882942248 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4436872 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=582272 CPUtime=12.61 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 15395 0 0 0 1258 3 0 0 25 0 8 0 882942248 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=582272 CPUtime=12.6 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 9890 0 0 0 1259 1 0 0 25 0 8 0 882942249 596246528 86123 33554432000 4194304 4625164 140734212798912 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.75
Current children cumulated vsize (KiB) 582272

[startup+25.501 s]
/proc/loadavg: 8.02 8.06 8.02 9/515 23168
/proc/meminfo: memFree=19265104/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=840676 CPUtime=202.91 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 314087 0 0 0 20234 57 0 0 25 0 8 0 882942240 860852224 136137 33554432000 4194304 4625164 140734212798912 18446744073709551615 4338016 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 210169 136138 348 106 0 205672 0
[pid=23159/tid=23161] ppid=23157 vsize=840676 CPUtime=25.4 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 12573 0 0 0 2538 2 0 0 25 0 8 0 882942248 860852224 136138 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=840676 CPUtime=25.41 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 17305 0 0 0 2538 3 0 0 25 0 8 0 882942248 860852224 136138 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=840676 CPUtime=25.38 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 192125 0 0 0 2504 34 0 0 25 0 8 0 882942248 860852224 136138 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=840676 CPUtime=24.96 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 12760 0 0 0 2493 3 0 0 25 0 8 0 882942248 860852224 136139 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=840676 CPUtime=25.41 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 17525 0 0 0 2538 3 0 0 25 0 8 0 882942248 860852224 136139 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=840676 CPUtime=25.41 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 18292 0 0 0 2537 4 0 0 25 0 8 0 882942248 860852224 136139 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=840676 CPUtime=25.4 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 16661 0 0 0 2538 2 0 0 25 0 8 0 882942249 860852224 136139 33554432000 4194304 4625164 140734212798912 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 202.91
Current children cumulated vsize (KiB) 840676

[startup+51.1005 s]
/proc/loadavg: 8.01 8.05 8.02 9/515 23169
/proc/meminfo: memFree=18944676/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=1180672 CPUtime=407.26 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 550905 0 0 0 40631 95 0 0 25 0 8 0 882942240 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 295168 216621 642 106 0 290671 0
[pid=23159/tid=23161] ppid=23157 vsize=1180672 CPUtime=51 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 19175 0 0 0 5096 4 0 0 25 0 8 0 882942248 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488002 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=1180672 CPUtime=51.01 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 28450 0 0 0 5096 5 0 0 25 0 8 0 882942248 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=1180672 CPUtime=50.98 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 353532 0 0 0 5043 55 0 0 25 0 8 0 882942248 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=1180672 CPUtime=50.12 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 20434 0 0 0 5008 4 0 0 25 0 8 0 882942248 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=1180672 CPUtime=51.01 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 30219 0 0 0 5095 6 0 0 25 0 8 0 882942248 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=1180672 CPUtime=51.01 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 39152 0 0 0 5093 8 0 0 25 0 8 0 882942248 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=1180672 CPUtime=51 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 18779 0 0 0 5097 3 0 0 25 0 8 0 882942249 1209008128 216621 33554432000 4194304 4625164 140734212798912 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.26

################
# More data... #
################

Current children cumulated vsize (KiB) 4796056

[startup+4722.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/515 23322
/proc/meminfo: memFree=15650172/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=4846280 CPUtime=37692.2 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 17614504 0 0 0 3765541 3684 0 0 25 0 8 0 882942240 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 1211570 1037949 352 106 0 1207073 0
[pid=23159/tid=23161] ppid=23157 vsize=4846280 CPUtime=4722.13 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81280 0 0 0 472190 23 0 0 25 0 8 0 882942248 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=4846280 CPUtime=4722.33 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 114696 0 0 0 472204 29 0 0 25 0 8 0 882942248 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=4846280 CPUtime=4639.97 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 16437637 0 0 0 460617 3380 0 0 25 0 8 0 882942248 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=4846280 CPUtime=4719.82 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81334 0 0 0 471957 25 0 0 25 0 8 0 882942248 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=4846280 CPUtime=4722.31 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 105399 0 0 0 472199 32 0 0 25 0 8 0 882942248 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4329724 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=4846280 CPUtime=4722.33 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 226729 0 0 0 472172 61 0 0 25 0 8 0 882942248 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=4846280 CPUtime=4722.25 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 120140 0 0 0 472184 41 0 0 25 0 8 0 882942249 4962590720 1037949 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37692.2
Current children cumulated vsize (KiB) 4846280

[startup+4782.3 s]
/proc/loadavg: 8.12 8.08 8.01 9/515 23325
/proc/meminfo: memFree=15617152/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=4896504 CPUtime=38171 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 17927409 0 0 0 3813357 3747 0 0 25 0 8 0 882942240 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 1224126 1044410 348 106 0 1219629 0
[pid=23159/tid=23161] ppid=23157 vsize=4896504 CPUtime=4782.11 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81304 0 0 0 478188 23 0 0 25 0 8 0 882942248 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=4896504 CPUtime=4782.31 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 114739 0 0 0 478202 29 0 0 25 0 8 0 882942248 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488064 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=4896504 CPUtime=4698.89 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 16743546 0 0 0 466447 3442 0 0 25 0 8 0 882942248 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=4896504 CPUtime=4779.8 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81357 0 0 0 477955 25 0 0 25 0 8 0 882942248 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=4896504 CPUtime=4782.29 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 111705 0 0 0 478196 33 0 0 25 0 8 0 882942248 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=4896504 CPUtime=4782.31 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 226746 0 0 0 478170 61 0 0 25 0 8 0 882942248 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=4896504 CPUtime=4782.23 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 120174 0 0 0 478182 41 0 0 25 0 8 0 882942249 5014020096 1044410 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38171
Current children cumulated vsize (KiB) 4896504

[startup+4842.32 s]
/proc/loadavg: 8.43 8.15 8.03 10/516 23331
/proc/meminfo: memFree=15572312/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=4896504 CPUtime=38649.3 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 18172346 0 0 0 3861124 3803 0 0 25 0 8 0 882942240 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 1224126 1048329 357 106 0 1219629 0
[pid=23159/tid=23161] ppid=23157 vsize=4896504 CPUtime=4842.13 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81377 0 0 0 484190 23 0 0 25 0 8 0 882942248 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=4896504 CPUtime=4842.33 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 114774 0 0 0 484204 29 0 0 25 0 8 0 882942248 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=4896504 CPUtime=4757.68 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 16987748 0 0 0 472271 3497 0 0 25 0 8 0 882942248 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=4896504 CPUtime=4839.12 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81404 0 0 0 483887 25 0 0 25 0 8 0 882942248 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=4896504 CPUtime=4842.31 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 111752 0 0 0 484198 33 0 0 25 0 8 0 882942248 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=4896504 CPUtime=4842.33 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 226762 0 0 0 484172 61 0 0 25 0 8 0 882942248 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330791 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=4896504 CPUtime=4842.24 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 120240 0 0 0 484183 41 0 0 25 0 8 0 882942249 5014020096 1048329 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38649.3
Current children cumulated vsize (KiB) 4896504

[startup+4902.3 s]
/proc/loadavg: 8.16 8.12 8.03 9/515 23332
/proc/meminfo: memFree=15597272/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=4896504 CPUtime=39128 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 18457616 0 0 0 3908944 3859 0 0 25 0 8 0 882942240 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 1224126 1051397 369 106 0 1219629 0
[pid=23159/tid=23161] ppid=23157 vsize=4896504 CPUtime=4902.11 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81432 0 0 0 490188 23 0 0 25 0 8 0 882942248 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=4896504 CPUtime=4902.31 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 114824 0 0 0 490202 29 0 0 25 0 8 0 882942248 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=4896504 CPUtime=4816.62 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 17272207 0 0 0 478111 3551 0 0 25 0 8 0 882942248 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=4896504 CPUtime=4899.06 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81434 0 0 0 489881 25 0 0 25 0 8 0 882942248 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=4896504 CPUtime=4902.29 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 111790 0 0 0 490196 33 0 0 25 0 8 0 882942248 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=4896504 CPUtime=4902.31 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 226779 0 0 0 490170 61 0 0 25 0 8 0 882942248 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=4896504 CPUtime=4902.22 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 120268 0 0 0 490181 41 0 0 25 0 8 0 882942249 5014020096 1051397 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39128
Current children cumulated vsize (KiB) 4896504

[startup+4962.3 s]
/proc/loadavg: 8.06 8.10 8.02 9/515 23334
/proc/meminfo: memFree=15590904/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=4896504 CPUtime=39606.9 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 18712923 0 0 0 3956781 3914 0 0 25 0 8 0 882942240 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 1224126 1049307 348 106 0 1219629 0
[pid=23159/tid=23161] ppid=23157 vsize=4896504 CPUtime=4962.11 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81473 0 0 0 496188 23 0 0 25 0 8 0 882942248 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=4896504 CPUtime=4962.31 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 114883 0 0 0 496202 29 0 0 25 0 8 0 882942248 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=4896504 CPUtime=4875.56 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 17526730 0 0 0 483950 3606 0 0 25 0 8 0 882942248 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=4896504 CPUtime=4959.06 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81457 0 0 0 495881 25 0 0 25 0 8 0 882942248 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331184 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=4896504 CPUtime=4962.29 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 111819 0 0 0 496196 33 0 0 25 0 8 0 882942248 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=4896504 CPUtime=4962.31 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 226795 0 0 0 496170 61 0 0 25 0 8 0 882942248 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330968 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=4896504 CPUtime=4962.22 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 120300 0 0 0 496181 41 0 0 25 0 8 0 882942249 5014020096 1049307 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39606.9
Current children cumulated vsize (KiB) 4896504



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.6 s]
/proc/loadavg: 8.07 8.10 8.02 10/515 23335
/proc/meminfo: memFree=15601664/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=4896504 CPUtime=40000.7 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) R 23157 23159 22892 0 -1 4202496 18793969 0 0 0 3996142 3932 0 0 25 0 8 0 882942240 5014020096 1049899 33554432000 4194304 4625164 140734212798912 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 1224126 1049899 348 106 0 1219629 0
[pid=23159/tid=23161] ppid=23157 vsize=4896504 CPUtime=5011.46 cores=0-7
/proc/23159/task/23161/stat : 23161 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81519 0 0 0 501122 24 0 0 25 0 8 0 882942248 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4487250 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23159/tid=23162] ppid=23157 vsize=4896504 CPUtime=5011.65 cores=0-7
/proc/23159/task/23162/stat : 23162 (SArTagnan) R 23157 23159 22892 0 -1 4202560 114926 0 0 0 501136 29 0 0 25 0 8 0 882942248 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=4896504 CPUtime=4924.01 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4202560 17607293 0 0 0 488777 3624 0 0 25 0 8 0 882942248 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23159/tid=23164] ppid=23157 vsize=4896504 CPUtime=5008.4 cores=0-7
/proc/23159/task/23164/stat : 23164 (SArTagnan) R 23157 23159 22892 0 -1 4202560 81479 0 0 0 500815 25 0 0 25 0 8 0 882942248 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23159/tid=23165] ppid=23157 vsize=4896504 CPUtime=5011.63 cores=0-7
/proc/23159/task/23165/stat : 23165 (SArTagnan) R 23157 23159 22892 0 -1 4202560 111858 0 0 0 501130 33 0 0 25 0 8 0 882942248 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330074 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23159/tid=23166] ppid=23157 vsize=4896504 CPUtime=5011.65 cores=0-7
/proc/23159/task/23166/stat : 23166 (SArTagnan) R 23157 23159 22892 0 -1 4202560 226808 0 0 0 501104 61 0 0 25 0 8 0 882942248 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23159/tid=23167] ppid=23157 vsize=4896504 CPUtime=5011.56 cores=0-7
/proc/23159/task/23167/stat : 23167 (SArTagnan) R 23157 23159 22892 0 -1 4202560 120332 0 0 0 501115 41 0 0 25 0 8 0 882942249 5014020096 1049904 33554432000 4194304 4625164 140734212798912 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 4896504

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.75 s]
/proc/loadavg: 8.07 8.10 8.02 10/515 23335
/proc/meminfo: memFree=15601664/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=0 CPUtime=40000.9 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) Z 23157 23159 22892 0 -1 4203548 18793974 0 0 0 3996149 3942 0 0 25 0 2 0 882942240 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 0 0 0 0 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=0 CPUtime=4924.12 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4203588 17607293 0 0 0 488778 3634 0 0 25 0 2 0 882942248 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

[startup+5011.8 s]
/proc/loadavg: 8.07 8.10 8.02 10/515 23335
/proc/meminfo: memFree=15601664/32950940 swapFree=67111364/67111528
[pid=23159] ppid=23157 vsize=0 CPUtime=40001 cores=0-7
/proc/23159/stat : 23159 (SArTagnan) Z 23157 23159 22892 0 -1 4203548 18793974 0 0 0 3996149 3947 0 0 25 0 2 0 882942240 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23159/statm: 0 0 0 0 0 0 0
[pid=23159/tid=23163] ppid=23157 vsize=0 CPUtime=4924.17 cores=0-7
/proc/23159/task/23163/stat : 23163 (SArTagnan) R 23157 23159 22892 0 -1 4203588 17607293 0 0 0 488778 3639 0 0 25 0 2 0 882942248 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.85
CPU time (s): 40001
CPU user time (s): 39961.5
CPU system time (s): 39.522
CPU usage (%): 798.129
Max. virtual memory (cumulated for all children) (KiB): 4896504

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39961.5
system time used= 39.522
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18793974
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1252
involuntary context switches= 181903

runsolver used 23.2455 second user time and 66.018 second system time

The end

Launcher Data 

Begin job on node117 at 2011-06-01 13:18:35
IDJOB=3439086
IDBENCH=83254
IDSOLVER=1936
FILE ID=node117/3439086-1306927115
RUNJOBID= node117-1306922035-22906
PBS_JOBID= 13488552
Free space on /tmp= 73628 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-5_4232.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439086-1306927115/watcher-3439086-1306927115 -o /tmp/evaluation-result-3439086-1306927115/solver-3439086-1306927115 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439086-1306927115.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 86d9f733c618d2ca060f457ab8a19463
RANDOM SEED=31234211

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      19809948 kB
Buffers:        314492 kB
Cached:        2661276 kB
SwapCached:          0 kB
Active:        9976036 kB
Inactive:      2784944 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      19809948 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            2724 kB
Writeback:           0 kB
AnonPages:     9785064 kB
Mapped:          41612 kB
Slab:           250828 kB
PageTables:      57956 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 149472040 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73628 MiB
End job on node117 at 2011-06-01 14:42:08