Trace number 3439521

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.5 5011.9

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/fphp/unsat/
harder/fphp-030-029.shuffled-as.sat05-1234.cnf
MD5SUMc12aa6a0ac1bca448bef51c167f3bbbb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark17.0914
Satisfiable
(Un)Satisfiability was proved
Number of variables870
Number of clauses24825
Sum of the clauses size50460
Maximum clause length29
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 224795
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439521-1306965420/watcher-3439521-1306965420 -o /tmp/evaluation-result-3439521-1306965420/solver-3439521-1306965420 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439521-1306965420.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.06 7.98 1/517 5513
/proc/meminfo: memFree=24252656/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=19528 CPUtime=0 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 592 0 0 0 0 0 0 0 23 0 1 0 808139705 19996672 483 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905730816 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/5513/statm: 4882 484 296 106 0 385 0
[pid=5513/tid=5514] ppid=5511 vsize=421792 CPUtime=0.01 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 58 0 0 0 1 0 0 0 18 0 8 0 808139706 431915008 1529 33554432000 4194304 4625164 140736201387648 18446744073709551615 4467406 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=421792 CPUtime=0 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 44 0 0 0 0 0 0 0 18 0 8 0 808139706 431915008 1529 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836063 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=421792 CPUtime=0 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 34 0 0 0 0 0 0 0 25 0 8 0 808139706 431915008 1529 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836014 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=421792 CPUtime=0 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 49 0 0 0 0 0 0 0 25 0 8 0 808139706 431915008 1530 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836063 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=421792 CPUtime=0 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 45 0 0 0 0 0 0 0 25 0 8 0 808139706 431915008 1530 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836063 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=421792 CPUtime=0 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 46 0 0 0 0 0 0 0 25 0 8 0 808139706 431915008 1530 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836063 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=421792 CPUtime=0 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 41 0 0 0 0 0 0 0 25 0 8 0 808139706 431915008 1530 33554432000 4194304 4625164 140736201387648 18446744073709551615 4292264 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.062231 s]
/proc/loadavg: 8.10 8.06 7.98 1/517 5513
/proc/meminfo: memFree=24252656/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=425784 CPUtime=0.4 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 5344 0 0 0 39 1 0 0 25 0 8 0 808139705 436002816 3668 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329088 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 106446 3670 351 106 0 101949 0
[pid=5513/tid=5514] ppid=5511 vsize=425784 CPUtime=0.05 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 225 0 0 0 5 0 0 0 18 0 8 0 808139706 436002816 3670 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905392161 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=425784 CPUtime=0.04 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 181 0 0 0 4 0 0 0 18 0 8 0 808139706 436002816 3670 33554432000 4194304 4625164 140736201387648 18446744073709551615 4484698 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=425784 CPUtime=0.04 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 332 0 0 0 4 0 0 0 25 0 8 0 808139706 436002816 3671 33554432000 4194304 4625164 140736201387648 18446744073709551615 4561152 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=425784 CPUtime=0.05 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 188 0 0 0 5 0 0 0 25 0 8 0 808139706 436002816 3671 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=425784 CPUtime=0.04 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 215 0 0 0 4 0 0 0 25 0 8 0 808139706 436002816 3672 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905392161 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=425784 CPUtime=0.05 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 189 0 0 0 5 0 0 0 18 0 8 0 808139706 436002816 3687 33554432000 4194304 4625164 140736201387648 18446744073709551615 4464483 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=425784 CPUtime=0.04 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 195 0 0 0 4 0 0 0 25 0 8 0 808139706 436002816 3697 33554432000 4194304 4625164 140736201387648 18446744073709551615 4292279 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 425784

[startup+0.101224 s]
/proc/loadavg: 8.10 8.06 7.98 1/517 5513
/proc/meminfo: memFree=24252656/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=426544 CPUtime=0.71 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 6351 0 0 0 70 1 0 0 25 0 8 0 808139705 436781056 4651 33554432000 4194304 4625164 140736201387648 18446744073709551615 4392604 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 106636 4651 353 106 0 102139 0
[pid=5513/tid=5514] ppid=5511 vsize=426544 CPUtime=0.09 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 291 0 0 0 9 0 0 0 18 0 8 0 808139706 436781056 4651 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905391813 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=426544 CPUtime=0.08 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 282 0 0 0 8 0 0 0 18 0 8 0 808139706 436781056 4652 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=426544 CPUtime=0.08 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 563 0 0 0 8 0 0 0 25 0 8 0 808139706 436781056 4653 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=426544 CPUtime=0.09 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 281 0 0 0 9 0 0 0 25 0 8 0 808139706 436781056 4654 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=426544 CPUtime=0.08 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 371 0 0 0 8 0 0 0 25 0 8 0 808139706 436781056 4654 33554432000 4194304 4625164 140736201387648 18446744073709551615 4349419 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=426544 CPUtime=0.08 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 321 0 0 0 8 0 0 0 18 0 8 0 808139706 436781056 4654 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905392161 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=426544 CPUtime=0.08 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 364 0 0 0 8 0 0 0 25 0 8 0 808139706 436781056 4654 33554432000 4194304 4625164 140736201387648 18446744073709551615 4464383 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 426544

[startup+0.301188 s]
/proc/loadavg: 8.10 8.06 7.98 1/517 5513
/proc/meminfo: memFree=24252656/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=429268 CPUtime=2.31 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 11285 0 0 0 229 2 0 0 25 0 8 0 808139705 439570432 9550 33554432000 4194304 4625164 140736201387648 18446744073709551615 4336608 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 107317 9550 355 106 0 102820 0
[pid=5513/tid=5514] ppid=5511 vsize=429268 CPUtime=0.29 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 884 0 0 0 29 0 0 0 18 0 8 0 808139706 439570432 9550 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905392161 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=429268 CPUtime=0.28 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 931 0 0 0 28 0 0 0 18 0 8 0 808139706 439570432 9550 33554432000 4194304 4625164 140736201387648 18446744073709551615 4345227 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=429268 CPUtime=0.27 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 1836 0 0 0 27 0 0 0 25 0 8 0 808139706 439570432 9550 33554432000 4194304 4625164 140736201387648 18446744073709551615 4556521 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=429268 CPUtime=0.28 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 715 0 0 0 28 0 0 0 25 0 8 0 808139706 439570432 9550 33554432000 4194304 4625164 140736201387648 18446744073709551615 4288950 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=429268 CPUtime=0.28 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 970 0 0 0 28 0 0 0 25 0 8 0 808139706 439570432 9552 33554432000 4194304 4625164 140736201387648 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=429268 CPUtime=0.28 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 940 0 0 0 28 0 0 0 18 0 8 0 808139706 439570432 9552 33554432000 4194304 4625164 140736201387648 18446744073709551615 4487022 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=429268 CPUtime=0.28 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 891 0 0 0 28 0 0 0 25 0 8 0 808139706 439570432 9553 33554432000 4194304 4625164 140736201387648 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.31
Current children cumulated vsize (KiB) 429268

[startup+0.701116 s]
/proc/loadavg: 8.10 8.06 7.98 1/517 5513
/proc/meminfo: memFree=24252656/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=434836 CPUtime=5.51 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 19836 0 0 0 546 5 0 0 25 0 8 0 808139705 445272064 17940 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905386965 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 108709 17941 366 106 0 104212 0
[pid=5513/tid=5514] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 1755 0 0 0 68 0 0 0 18 0 8 0 808139706 445272064 17941 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 1838 0 0 0 68 0 0 0 18 0 8 0 808139706 445272064 17942 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 4727 0 0 0 67 1 0 0 25 0 8 0 808139706 445272064 17942 33554432000 4194304 4625164 140736201387648 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 1567 0 0 0 68 0 0 0 25 0 8 0 808139706 445272064 17942 33554432000 4194304 4625164 140736201387648 18446744073709551615 4464278 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 1993 0 0 0 67 1 0 0 25 0 8 0 808139706 445272064 17943 33554432000 4194304 4625164 140736201387648 18446744073709551615 4349858 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 2048 0 0 0 68 0 0 0 18 0 8 0 808139706 445272064 17944 33554432000 4194304 4625164 140736201387648 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=434836 CPUtime=0.68 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 1458 0 0 0 68 0 0 0 25 0 8 0 808139706 445272064 17947 33554432000 4194304 4625164 140736201387648 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.51
Current children cumulated vsize (KiB) 434836

[startup+1.50097 s]
/proc/loadavg: 8.10 8.06 7.98 9/525 5521
/proc/meminfo: memFree=24163032/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=442960 CPUtime=11.89 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 34172 0 0 0 1181 8 0 0 25 0 8 0 808139705 453591040 30191 33554432000 4194304 4625164 140736201387648 18446744073709551615 4338057 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 110740 30191 352 106 0 106243 0
[pid=5513/tid=5514] ppid=5511 vsize=442960 CPUtime=1.48 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 2660 0 0 0 148 0 0 0 20 0 8 0 808139706 453591040 30191 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=442960 CPUtime=1.48 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 2963 0 0 0 148 0 0 0 20 0 8 0 808139706 453591040 30191 33554432000 4194304 4625164 140736201387648 18446744073709551615 4375254 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=442960 CPUtime=1.45 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 10574 0 0 0 143 2 0 0 25 0 8 0 808139706 453591040 30191 33554432000 4194304 4625164 140736201387648 18446744073709551615 4327642 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=442960 CPUtime=1.48 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 2538 0 0 0 148 0 0 0 25 0 8 0 808139706 453591040 30191 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=442960 CPUtime=1.48 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 3248 0 0 0 147 1 0 0 25 0 8 0 808139706 453591040 30191 33554432000 4194304 4625164 140736201387648 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=442960 CPUtime=1.48 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 3793 0 0 0 147 1 0 0 20 0 8 0 808139706 453591040 30192 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905389485 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=442960 CPUtime=1.48 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 2512 0 0 0 148 0 0 0 25 0 8 0 808139706 453591040 30192 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.89
Current children cumulated vsize (KiB) 442960

[startup+3.10068 s]
/proc/loadavg: 8.10 8.06 7.98 9/525 5521
/proc/meminfo: memFree=24097312/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=478880 CPUtime=24.65 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 65727 0 0 0 2451 14 0 0 25 0 8 0 808139705 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 119720 53248 446 106 0 115223 0
[pid=5513/tid=5514] ppid=5511 vsize=478880 CPUtime=3.08 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 4948 0 0 0 307 1 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=478880 CPUtime=3.07 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 5773 0 0 0 307 0 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905398234 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=478880 CPUtime=3.03 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 23154 0 0 0 299 4 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=478880 CPUtime=3.08 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 5312 0 0 0 307 1 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836063 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=478880 CPUtime=3.07 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 5916 0 0 0 306 1 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=478880 CPUtime=3.07 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 7712 0 0 0 306 1 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 218905836063 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=478880 CPUtime=3.07 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 4819 0 0 0 307 0 0 0 25 0 8 0 808139706 490373120 53248 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.65
Current children cumulated vsize (KiB) 478880

[startup+6.30111 s]
/proc/loadavg: 8.18 8.08 7.98 9/525 5521
/proc/meminfo: memFree=23943680/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=518656 CPUtime=50.19 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 127527 0 0 0 4995 24 0 0 25 0 8 0 808139705 531103744 86354 33554432000 4194304 4625164 140736201387648 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 129664 86357 352 106 0 125167 0
[pid=5513/tid=5514] ppid=5511 vsize=518656 CPUtime=6.28 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 8342 0 0 0 626 2 0 0 25 0 8 0 808139706 531103744 86357 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=518656 CPUtime=6.28 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 9855 0 0 0 627 1 0 0 25 0 8 0 808139706 531103744 86357 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=518656 CPUtime=6.18 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 55440 0 0 0 609 9 0 0 20 0 8 0 808139706 531103744 86357 33554432000 4194304 4625164 140736201387648 18446744073709551615 4546849 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=518656 CPUtime=6.28 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 9201 0 0 0 627 1 0 0 25 0 8 0 808139706 531103744 86357 33554432000 4194304 4625164 140736201387648 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=518656 CPUtime=6.28 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 9332 0 0 0 626 2 0 0 25 0 8 0 808139706 531103744 86358 33554432000 4194304 4625164 140736201387648 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=518656 CPUtime=6.28 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 14248 0 0 0 625 3 0 0 25 0 8 0 808139706 531103744 86358 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=518656 CPUtime=6.28 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 9458 0 0 0 627 1 0 0 25 0 8 0 808139706 531103744 86360 33554432000 4194304 4625164 140736201387648 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=5513/tid=5516] ppid=5511 vsize=4177304 CPUtime=4577.63 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 22244565 0 0 0 453610 4153 0 0 25 0 8 0 808139706 4277559296 882277 33554432000 4194304 4625164 140736201387648 18446744073709551615 4578811 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4177304 CPUtime=4662.42 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 72334 0 0 0 466222 20 0 0 25 0 8 0 808139706 4277559296 882277 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4177304 CPUtime=4662.37 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105337 0 0 0 466210 27 0 0 25 0 8 0 808139706 4277559296 882277 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4177304 CPUtime=4662.38 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102305 0 0 0 466216 22 0 0 25 0 8 0 808139706 4277559296 882277 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4177304 CPUtime=4661.03 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102787 0 0 0 466079 24 0 0 25 0 8 0 808139706 4277559296 882277 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37211.3
Current children cumulated vsize (KiB) 4177304

[startup+4722.32 s]
/proc/loadavg: 8.06 8.02 8.00 9/525 5671
/proc/meminfo: memFree=20710540/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=4177304 CPUtime=37690.4 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 27487090 0 0 0 3763823 5213 0 0 25 0 8 0 808139705 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4393051 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 1044326 883669 388 106 0 1039829 0
[pid=5513/tid=5514] ppid=5511 vsize=4177304 CPUtime=4722.13 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 83713 0 0 0 472193 20 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=4177304 CPUtime=4720.93 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102611 0 0 0 472070 23 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=4177304 CPUtime=4636.55 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 22679056 0 0 0 459417 4238 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4177304 CPUtime=4722.44 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 72365 0 0 0 472224 20 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4177304 CPUtime=4722.39 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105370 0 0 0 472212 27 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4177304 CPUtime=4722.41 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102354 0 0 0 472219 22 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4177304 CPUtime=4721.02 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102812 0 0 0 472078 24 0 0 25 0 8 0 808139706 4277559296 883669 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37690.4
Current children cumulated vsize (KiB) 4177304

[startup+4782.3 s]
/proc/loadavg: 8.08 8.03 8.00 9/525 5673
/proc/meminfo: memFree=20713104/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=4177304 CPUtime=38169.1 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 27917689 0 0 0 3811617 5295 0 0 25 0 8 0 808139705 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 1044326 885212 455 106 0 1039829 0
[pid=5513/tid=5514] ppid=5511 vsize=4177304 CPUtime=4782.11 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 83776 0 0 0 478191 20 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=4177304 CPUtime=4780.92 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102634 0 0 0 478069 23 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=4177304 CPUtime=4695.46 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 23095857 0 0 0 465228 4318 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4177304 CPUtime=4782.42 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 72399 0 0 0 478222 20 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4177304 CPUtime=4782.38 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105398 0 0 0 478211 27 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4177304 CPUtime=4782.39 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102404 0 0 0 478217 22 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4177304 CPUtime=4780.99 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102837 0 0 0 478075 24 0 0 25 0 8 0 808139706 4277559296 885212 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38169.1
Current children cumulated vsize (KiB) 4177304

[startup+4842.3 s]
/proc/loadavg: 8.13 8.06 8.01 9/525 5674
/proc/meminfo: memFree=20687004/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=4205000 CPUtime=38648 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 28307228 0 0 0 3859431 5371 0 0 25 0 8 0 808139705 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 1051250 889573 386 106 0 1046753 0
[pid=5513/tid=5514] ppid=5511 vsize=4205000 CPUtime=4842.11 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 83941 0 0 0 484191 20 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=4205000 CPUtime=4840.92 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102663 0 0 0 484069 23 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=4205000 CPUtime=4754.36 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 23455251 0 0 0 471049 4387 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4205000 CPUtime=4842.42 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 87093 0 0 0 484220 22 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4488037 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4205000 CPUtime=4842.38 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105490 0 0 0 484210 28 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4205000 CPUtime=4842.39 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102459 0 0 0 484217 22 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4205000 CPUtime=4840.98 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102862 0 0 0 484074 24 0 0 25 0 8 0 808139706 4305920000 889573 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38648
Current children cumulated vsize (KiB) 4205000

[startup+4902.3 s]
/proc/loadavg: 8.10 8.06 8.01 9/525 5676
/proc/meminfo: memFree=20649656/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=4265144 CPUtime=39126.9 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 28529117 0 0 0 3907279 5413 0 0 25 0 8 0 808139705 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 1066286 899511 406 106 0 1061789 0
[pid=5513/tid=5514] ppid=5511 vsize=4265144 CPUtime=4902.11 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 83963 0 0 0 490191 20 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=4265144 CPUtime=4900.92 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 134256 0 0 0 490064 28 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=4265144 CPUtime=4813.29 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 23570937 0 0 0 476921 4408 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4265144 CPUtime=4902.42 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 87114 0 0 0 490220 22 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4265144 CPUtime=4902.39 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105587 0 0 0 490211 28 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4265144 CPUtime=4902.39 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102496 0 0 0 490217 22 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4265144 CPUtime=4900.95 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102885 0 0 0 490071 24 0 0 25 0 8 0 808139706 4367507456 899511 33554432000 4194304 4625164 140736201387648 18446744073709551615 4330810 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39126.9
Current children cumulated vsize (KiB) 4265144

[startup+4962.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/525 5677
/proc/meminfo: memFree=20615752/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=4313148 CPUtime=39605.8 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 29020444 0 0 0 3955074 5508 0 0 25 0 8 0 808139705 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 1078287 907420 449 106 0 1073790 0
[pid=5513/tid=5514] ppid=5511 vsize=4313148 CPUtime=4962.11 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 83986 0 0 0 496191 20 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=4313148 CPUtime=4960.92 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 134445 0 0 0 496064 28 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=4313148 CPUtime=4872.18 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 24005374 0 0 0 482729 4489 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4313148 CPUtime=4962.42 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 87134 0 0 0 496220 22 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4313148 CPUtime=4962.39 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105687 0 0 0 496211 28 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329856 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4313148 CPUtime=4962.39 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 108566 0 0 0 496216 23 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4313148 CPUtime=4960.94 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102912 0 0 0 496070 24 0 0 25 0 8 0 808139706 4416663552 907420 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39605.8
Current children cumulated vsize (KiB) 4313148



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.7 s]
/proc/loadavg: 8.01 8.04 8.00 9/525 5679
/proc/meminfo: memFree=20622516/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=4313148 CPUtime=40000.2 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) R 5511 5513 5272 0 -1 4202496 29308227 0 0 0 3994452 5564 0 0 25 0 8 0 808139705 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 1078287 905433 352 106 0 1073790 0
[pid=5513/tid=5514] ppid=5511 vsize=4313148 CPUtime=5011.54 cores=0-7
/proc/5513/task/5514/stat : 5514 (SArTagnan) R 5511 5513 5272 0 -1 4202560 84002 0 0 0 501134 20 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5513/tid=5515] ppid=5511 vsize=4313148 CPUtime=5010.34 cores=0-7
/proc/5513/task/5515/stat : 5515 (SArTagnan) R 5511 5513 5272 0 -1 4202560 134461 0 0 0 501006 28 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=4313148 CPUtime=4920.68 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4202560 24292459 0 0 0 487523 4545 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5513/tid=5517] ppid=5511 vsize=4313148 CPUtime=5011.84 cores=0-7
/proc/5513/task/5517/stat : 5517 (SArTagnan) R 5511 5513 5272 0 -1 4202560 87151 0 0 0 501162 22 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5513/tid=5518] ppid=5511 vsize=4313148 CPUtime=5011.81 cores=0-7
/proc/5513/task/5518/stat : 5518 (SArTagnan) R 5511 5513 5272 0 -1 4202560 105712 0 0 0 501153 28 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5513/tid=5519] ppid=5511 vsize=4313148 CPUtime=5011.81 cores=0-7
/proc/5513/task/5519/stat : 5519 (SArTagnan) R 5511 5513 5272 0 -1 4202560 108701 0 0 0 501158 23 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5513/tid=5520] ppid=5511 vsize=4313148 CPUtime=5010.35 cores=0-7
/proc/5513/task/5520/stat : 5520 (SArTagnan) R 5511 5513 5272 0 -1 4202560 102934 0 0 0 501011 24 0 0 25 0 8 0 808139706 4416663552 905433 33554432000 4194304 4625164 140736201387648 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 4313148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.83 s]
/proc/loadavg: 8.01 8.04 8.00 9/525 5679
/proc/meminfo: memFree=20622516/32951124 swapFree=56930356/67111528
[pid=5513] ppid=5511 vsize=0 CPUtime=40000.4 cores=0-7
/proc/5513/stat : 5513 (SArTagnan) Z 5511 5513 5272 0 -1 4203548 29308227 0 0 0 3994466 5574 0 0 25 0 2 0 808139705 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5513/statm: 0 0 0 0 0 0 0
[pid=5513/tid=5516] ppid=5511 vsize=0 CPUtime=4920.79 cores=0-7
/proc/5513/task/5516/stat : 5516 (SArTagnan) R 5511 5513 5272 0 -1 4203588 24292459 0 0 0 487524 4555 0 0 25 0 2 0 808139706 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.9
CPU time (s): 40000.5
CPU user time (s): 39944.7
CPU system time (s): 55.8205
CPU usage (%): 798.11
Max. virtual memory (cumulated for all children) (KiB): 4378684

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39944.7
system time used= 55.8205
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29308227
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3618
involuntary context switches= 178991

runsolver used 23.3255 second user time and 67.7887 second system time

The end

Launcher Data 

Begin job on node137 at 2011-06-01 23:57:00
IDJOB=3439521
IDBENCH=85538
IDSOLVER=1936
FILE ID=node137/3439521-1306965420
RUNJOBID= node137-1306960405-5286
PBS_JOBID= 13497614
Free space on /tmp= 73464 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/sabharwal05/counting/fphp/unsat/harder/fphp-030-029.shuffled-as.sat05-1234.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439521-1306965420/watcher-3439521-1306965420 -o /tmp/evaluation-result-3439521-1306965420/solver-3439521-1306965420 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439521-1306965420.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c12aa6a0ac1bca448bef51c167f3bbbb
RANDOM SEED=235304616

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24252804 kB
Buffers:        153800 kB
Cached:         285496 kB
SwapCached:      12308 kB
Active:        8150480 kB
Inactive:       294448 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24252804 kB
SwapTotal:    67111528 kB
SwapFree:     56930356 kB
Dirty:             788 kB
Writeback:           0 kB
AnonPages:     8003308 kB
Mapped:          20276 kB
Slab:           106120 kB
PageTables:      74084 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 162514848 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73460 MiB
End job on node137 at 2011-06-02 01:20:34