Trace number 3439516

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.8 5011.56

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-020-019.shuffled-as.sat05-1190.cnf
MD5SUM81bbeaaf9f0ca3bfc36d743097777052
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1.58376
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses3630
Sum of the clauses size7600
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23610
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439516-1306965419/watcher-3439516-1306965419 -o /tmp/evaluation-result-3439516-1306965419/solver-3439516-1306965419 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439516-1306965419.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.20 8.07 8.00 1/491 759
/proc/meminfo: memFree=29175160/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=18656 CPUtime=0 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 428 0 0 0 0 0 0 0 25 0 1 0 808141571 19103744 365 33554432000 4194304 4625164 140736888579104 18446744073709551615 210646843147 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/759/statm: 4664 366 295 106 0 167 0
[pid=759/tid=760] ppid=757 vsize=90992 CPUtime=0.01 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 47152942679986 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=761] ppid=757 vsize=90992 CPUtime=0 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 210647202801 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=90992 CPUtime=0 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 210647202801 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=763] ppid=757 vsize=90992 CPUtime=0 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 210647202801 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=765] ppid=757 vsize=90992 CPUtime=0.01 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 47152942679986 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=90992 CPUtime=0.01 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 47152942679984 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=90992 CPUtime=0.01 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 808141571 93175808 527 33554432000 4194304 4625164 140736888579104 18446744073709551615 47152942679986 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.0317709 s]
/proc/loadavg: 8.20 8.07 8.00 1/491 759
/proc/meminfo: memFree=29175160/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=354392 CPUtime=0.21 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 1915 0 0 0 21 0 0 0 25 0 8 0 808141571 362897408 1413 33554432000 4194304 4625164 140736888579104 18446744073709551615 4360194 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 88598 1415 351 106 0 84101 0
[pid=759/tid=760] ppid=757 vsize=354392 CPUtime=0.02 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 34 0 0 0 2 0 0 0 25 0 8 0 808141571 362897408 1419 33554432000 4194304 4625164 140736888579104 18446744073709551615 210647251438 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=761] ppid=757 vsize=354392 CPUtime=0 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 58 0 0 0 0 0 0 0 25 0 8 0 808141571 362897408 1421 33554432000 4194304 4625164 140736888579104 18446744073709551615 210646804705 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=354392 CPUtime=0.01 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 110 0 0 0 1 0 0 0 18 0 8 0 808141571 362897408 1424 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=354392 CPUtime=0.02 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 60 0 0 0 2 0 0 0 18 0 8 0 808141571 362897408 1425 33554432000 4194304 4625164 140736888579104 18446744073709551615 4464748 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=354392 CPUtime=0.03 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 85 0 0 0 3 0 0 0 25 0 8 0 808141571 362897408 1427 33554432000 4194304 4625164 140736888579104 18446744073709551615 4437845 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=354392 CPUtime=0.03 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 76 0 0 0 3 0 0 0 25 0 8 0 808141571 362897408 1429 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339160 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=354392 CPUtime=0.03 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 61 0 0 0 3 0 0 0 18 0 8 0 808141571 362897408 1434 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 354392

[startup+0.113211 s]
/proc/loadavg: 8.20 8.07 8.00 1/491 759
/proc/meminfo: memFree=29175160/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=356984 CPUtime=0.75 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 4375 0 0 0 74 1 0 0 25 0 8 0 808141571 365551616 3626 33554432000 4194304 4625164 140736888579104 18446744073709551615 4511899 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 89246 3627 352 106 0 84749 0
[pid=759/tid=760] ppid=757 vsize=356984 CPUtime=0.06 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 164 0 0 0 6 0 0 0 25 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=356984 CPUtime=0.07 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 498 0 0 0 7 0 0 0 25 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=356984 CPUtime=0.09 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 578 0 0 0 9 0 0 0 18 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=356984 CPUtime=0.09 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 292 0 0 0 9 0 0 0 18 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=356984 CPUtime=0.1 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 421 0 0 0 10 0 0 0 18 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4349072 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=356984 CPUtime=0.1 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 384 0 0 0 10 0 0 0 25 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=356984 CPUtime=0.1 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 251 0 0 0 10 0 0 0 18 0 8 0 808141571 365551616 3627 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 356984

[startup+0.300935 s]
/proc/loadavg: 8.20 8.07 8.00 1/491 759
/proc/meminfo: memFree=29175160/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=363544 CPUtime=2.25 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 9179 0 0 0 223 2 0 0 25 0 8 0 808141571 372269056 8421 33554432000 4194304 4625164 140736888579104 18446744073709551615 4392552 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 90886 8421 353 106 0 86389 0
[pid=759/tid=760] ppid=757 vsize=363544 CPUtime=0.25 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 657 0 0 0 25 0 0 0 25 0 8 0 808141571 372269056 8421 33554432000 4194304 4625164 140736888579104 18446744073709551615 4291968 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=363544 CPUtime=0.25 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 1267 0 0 0 25 0 0 0 25 0 8 0 808141571 372269056 8421 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=363544 CPUtime=0.27 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 1809 0 0 0 27 0 0 0 18 0 8 0 808141571 372269056 8421 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=363544 CPUtime=0.27 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 746 0 0 0 27 0 0 0 18 0 8 0 808141571 372269056 8421 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=363544 CPUtime=0.28 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 1093 0 0 0 28 0 0 0 18 0 8 0 808141571 372269056 8421 33554432000 4194304 4625164 140736888579104 18446744073709551615 4349072 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=363544 CPUtime=0.29 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 878 0 0 0 29 0 0 0 25 0 8 0 808141571 372269056 8424 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=363544 CPUtime=0.29 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 724 0 0 0 29 0 0 0 18 0 8 0 808141571 372269056 8424 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352053 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.25
Current children cumulated vsize (KiB) 363544

[startup+0.700866 s]
/proc/loadavg: 8.20 8.07 8.00 1/491 759
/proc/meminfo: memFree=29175160/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=376620 CPUtime=5.44 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 19301 0 0 0 540 4 0 0 25 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 4528700 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 94155 16055 353 106 0 89658 0
[pid=759/tid=760] ppid=757 vsize=376620 CPUtime=0.65 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 1488 0 0 0 65 0 0 0 25 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=376620 CPUtime=0.66 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 2289 0 0 0 65 1 0 0 25 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=376620 CPUtime=0.67 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 4937 0 0 0 66 1 0 0 18 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=376620 CPUtime=0.67 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 1330 0 0 0 67 0 0 0 18 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=376620 CPUtime=0.68 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 2260 0 0 0 68 0 0 0 18 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 4349800 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=376620 CPUtime=0.69 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 1849 0 0 0 69 0 0 0 25 0 8 0 808141571 385658880 16055 33554432000 4194304 4625164 140736888579104 18446744073709551615 210646807585 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=376620 CPUtime=0.69 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 1532 0 0 0 69 0 0 0 18 0 8 0 808141571 385658880 16056 33554432000 4194304 4625164 140736888579104 18446744073709551615 210646807585 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.44
Current children cumulated vsize (KiB) 376620

[startup+1.50073 s]
/proc/loadavg: 8.18 8.07 8.00 9/499 768
/proc/meminfo: memFree=29090916/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=394020 CPUtime=11.82 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 37194 0 0 0 1175 7 0 0 25 0 8 0 808141571 403476480 27754 33554432000 4194304 4625164 140736888579104 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 98505 27754 352 106 0 94008 0
[pid=759/tid=760] ppid=757 vsize=394020 CPUtime=1.42 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 2452 0 0 0 142 0 0 0 25 0 8 0 808141571 403476480 27754 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=394020 CPUtime=1.45 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 4613 0 0 0 144 1 0 0 25 0 8 0 808141571 403476480 27754 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=394020 CPUtime=1.46 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 12086 0 0 0 145 1 0 0 20 0 8 0 808141571 403476480 27755 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=394020 CPUtime=1.47 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 2743 0 0 0 147 0 0 0 18 0 8 0 808141571 403476480 27755 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=394020 CPUtime=1.48 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 3677 0 0 0 147 1 0 0 18 0 8 0 808141571 403476480 27755 33554432000 4194304 4625164 140736888579104 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=394020 CPUtime=1.48 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 4010 0 0 0 148 0 0 0 25 0 8 0 808141571 403476480 27756 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=394020 CPUtime=1.49 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 2390 0 0 0 149 0 0 0 19 0 8 0 808141571 403476480 27756 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.82
Current children cumulated vsize (KiB) 394020

[startup+3.10047 s]
/proc/loadavg: 8.18 8.07 8.00 9/499 768
/proc/meminfo: memFree=29033432/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=431764 CPUtime=24.58 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 72463 0 0 0 2441 17 0 0 25 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 107941 45466 352 106 0 103444 0
[pid=759/tid=760] ppid=757 vsize=431764 CPUtime=3 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 3968 0 0 0 300 0 0 0 19 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=431764 CPUtime=3.05 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 8970 0 0 0 303 2 0 0 25 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=431764 CPUtime=3.07 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 26301 0 0 0 302 5 0 0 25 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=431764 CPUtime=3.07 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 5970 0 0 0 306 1 0 0 21 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4316420 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=431764 CPUtime=3.08 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 7693 0 0 0 306 2 0 0 21 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=431764 CPUtime=3.08 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 8261 0 0 0 306 2 0 0 19 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4486949 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=431764 CPUtime=3.08 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 3756 0 0 0 308 0 0 0 25 0 8 0 808141571 442126336 45466 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.58
Current children cumulated vsize (KiB) 431764

[startup+6.30093 s]
/proc/loadavg: 8.18 8.07 8.00 9/499 768
/proc/meminfo: memFree=28907580/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=499696 CPUtime=50.12 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 132981 0 0 0 4985 27 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 210646806853 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 124924 75015 358 106 0 120427 0
[pid=759/tid=760] ppid=757 vsize=499696 CPUtime=6.15 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 8476 0 0 0 614 1 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=499696 CPUtime=6.24 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 13200 0 0 0 621 3 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=499696 CPUtime=6.26 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 51579 0 0 0 617 9 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4562855 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=499696 CPUtime=6.27 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 12156 0 0 0 625 2 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=499696 CPUtime=6.28 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 14662 0 0 0 625 3 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=499696 CPUtime=6.28 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 13616 0 0 0 626 2 0 0 25 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=499696 CPUtime=6.28 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 8345 0 0 0 628 0 0 0 20 0 8 0 808141571 511688704 75015 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0

################
# More data... #
################

[pid=759/tid=762] ppid=757 vsize=3817660 CPUtime=4660.49 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 20537900 0 0 0 462273 3776 0 0 25 0 8 0 808141571 3909283840 761082 33554432000 4194304 4625164 140736888579104 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3817660 CPUtime=4662.32 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 91859 0 0 0 466212 20 0 0 25 0 8 0 808141571 3909283840 761082 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3817660 CPUtime=4660.7 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102819 0 0 0 466048 22 0 0 25 0 8 0 808141571 3909283840 761082 33554432000 4194304 4625164 140736888579104 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3817660 CPUtime=4662.34 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125031 0 0 0 466213 21 0 0 25 0 8 0 808141571 3909283840 761082 33554432000 4194304 4625164 140736888579104 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3817660 CPUtime=4662.32 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91352 0 0 0 466214 18 0 0 25 0 8 0 808141571 3909283840 761082 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330864 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37213.9
Current children cumulated vsize (KiB) 3817660

[startup+4722.32 s]
/proc/loadavg: 8.04 8.05 8.01 9/499 933
/proc/meminfo: memFree=26095304/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=3883196 CPUtime=37692.9 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 35944445 0 0 0 3762569 6726 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 970799 768886 587 106 0 966302 0
[pid=759/tid=760] ppid=757 vsize=3883196 CPUtime=4640.55 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 96119 0 0 0 464030 25 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=3883196 CPUtime=4721.78 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 133192 0 0 0 472086 92 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=3883196 CPUtime=4720.52 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 20558797 0 0 0 468272 3780 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3883196 CPUtime=4722.34 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 91877 0 0 0 472214 20 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331104 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3883196 CPUtime=4720.7 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102839 0 0 0 472048 22 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3883196 CPUtime=4722.36 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125049 0 0 0 472215 21 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3883196 CPUtime=4722.34 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91371 0 0 0 472216 18 0 0 25 0 8 0 808141571 3976392704 768886 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37693
Current children cumulated vsize (KiB) 3883196

[startup+4782.3 s]
/proc/loadavg: 8.05 8.05 8.01 9/499 935
/proc/meminfo: memFree=26104596/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=3817660 CPUtime=38171.8 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 36190813 0 0 0 3810404 6771 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 954415 766643 356 106 0 949918 0
[pid=759/tid=760] ppid=757 vsize=3817660 CPUtime=4699.49 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 96130 0 0 0 469924 25 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=3817660 CPUtime=4781.75 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 133204 0 0 0 478083 92 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=3817660 CPUtime=4780.49 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 20804709 0 0 0 474225 3824 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3817660 CPUtime=4782.32 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 91887 0 0 0 478212 20 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3817660 CPUtime=4780.67 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102859 0 0 0 478045 22 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3817660 CPUtime=4782.34 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125070 0 0 0 478213 21 0 0 25 0 8 0 808141571 3909283840 766643 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331194 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3817660 CPUtime=4782.33 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91385 0 0 0 478215 18 0 0 25 0 8 0 808141571 3909283840 766645 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38171.8
Current children cumulated vsize (KiB) 3817660

[startup+4842.3 s]
/proc/loadavg: 8.13 8.07 8.01 9/499 937
/proc/meminfo: memFree=26098764/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=3817660 CPUtime=38650.7 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 36453205 0 0 0 3858249 6818 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4393051 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 954415 767834 352 106 0 949918 0
[pid=759/tid=760] ppid=757 vsize=3817660 CPUtime=4758.44 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 96145 0 0 0 475819 25 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=3817660 CPUtime=4841.76 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 133215 0 0 0 484083 93 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=3817660 CPUtime=4840.49 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 21066841 0 0 0 480179 3870 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3817660 CPUtime=4842.32 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 91902 0 0 0 484212 20 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3817660 CPUtime=4840.64 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102877 0 0 0 484042 22 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3817660 CPUtime=4842.34 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125134 0 0 0 484213 21 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3817660 CPUtime=4842.33 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91396 0 0 0 484215 18 0 0 25 0 8 0 808141571 3909283840 767834 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38650.7
Current children cumulated vsize (KiB) 3817660

[startup+4902.3 s]
/proc/loadavg: 8.19 8.09 8.02 9/499 939
/proc/meminfo: memFree=26084744/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=3817660 CPUtime=39129.6 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 36731767 0 0 0 3906093 6870 0 0 25 0 8 0 808141571 3909283840 766991 33554432000 4194304 4625164 140736888579104 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 954415 766991 352 106 0 949918 0
[pid=759/tid=760] ppid=757 vsize=3817660 CPUtime=4817.41 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 96162 0 0 0 481716 25 0 0 25 0 8 0 808141571 3909283840 766991 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=3817660 CPUtime=4901.76 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 133230 0 0 0 490082 94 0 0 25 0 8 0 808141571 3909283840 766992 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=3817660 CPUtime=4900.5 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 21345129 0 0 0 486129 3921 0 0 25 0 8 0 808141571 3909283840 766997 33554432000 4194304 4625164 140736888579104 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3817660 CPUtime=4902.32 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 91915 0 0 0 490212 20 0 0 25 0 8 0 808141571 3909283840 766997 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330847 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3817660 CPUtime=4900.62 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102893 0 0 0 490040 22 0 0 25 0 8 0 808141571 3909283840 766997 33554432000 4194304 4625164 140736888579104 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3817660 CPUtime=4902.34 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125160 0 0 0 490213 21 0 0 25 0 8 0 808141571 3909283840 766997 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3817660 CPUtime=4902.33 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91405 0 0 0 490215 18 0 0 25 0 8 0 808141571 3909283840 766997 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39129.6
Current children cumulated vsize (KiB) 3817660

[startup+4962.3 s]
/proc/loadavg: 8.20 8.10 8.02 9/499 939
/proc/meminfo: memFree=26083620/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=3817660 CPUtime=39608.6 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 37053823 0 0 0 3953926 6930 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 954415 766788 352 106 0 949918 0
[pid=759/tid=760] ppid=757 vsize=3817660 CPUtime=4876.36 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 96180 0 0 0 487611 25 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=3817660 CPUtime=4961.75 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 133246 0 0 0 496081 94 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=3817660 CPUtime=4960.5 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 21666785 0 0 0 492069 3981 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4579584 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3817660 CPUtime=4962.32 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 91994 0 0 0 496212 20 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3817660 CPUtime=4960.6 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102913 0 0 0 496038 22 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330064 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3817660 CPUtime=4962.34 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125223 0 0 0 496213 21 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3817660 CPUtime=4962.33 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91414 0 0 0 496215 18 0 0 25 0 8 0 808141571 3909283840 766788 33554432000 4194304 4625164 140736888579104 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39608.6
Current children cumulated vsize (KiB) 3817660



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.4 s]
/proc/loadavg: 8.09 8.08 8.02 9/499 941
/proc/meminfo: memFree=26073196/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=3817660 CPUtime=40000.5 cores=0-7
/proc/759/stat : 759 (SArTagnan) R 757 759 542 0 -1 4202496 37355538 0 0 0 3993064 6988 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 954415 774537 604 106 0 949918 0
[pid=759/tid=760] ppid=757 vsize=3817660 CPUtime=4924.63 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4202560 96194 0 0 0 492438 25 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=759/tid=761] ppid=757 vsize=3817660 CPUtime=5010.87 cores=0-7
/proc/759/task/761/stat : 761 (SArTagnan) R 757 759 542 0 -1 4202560 133255 0 0 0 500992 95 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=759/tid=762] ppid=757 vsize=3817660 CPUtime=5009.62 cores=0-7
/proc/759/task/762/stat : 762 (SArTagnan) R 757 759 542 0 -1 4202560 21967707 0 0 0 496924 4038 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=759/tid=763] ppid=757 vsize=3817660 CPUtime=5011.44 cores=0-7
/proc/759/task/763/stat : 763 (SArTagnan) R 757 759 542 0 -1 4202560 92009 0 0 0 501124 20 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=759/tid=765] ppid=757 vsize=3817660 CPUtime=5009.7 cores=0-7
/proc/759/task/765/stat : 765 (SArTagnan) R 757 759 542 0 -1 4202560 102926 0 0 0 500948 22 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=759/tid=766] ppid=757 vsize=3817660 CPUtime=5011.46 cores=0-7
/proc/759/task/766/stat : 766 (SArTagnan) R 757 759 542 0 -1 4202560 125312 0 0 0 501125 21 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=759/tid=767] ppid=757 vsize=3817660 CPUtime=5011.45 cores=0-7
/proc/759/task/767/stat : 767 (SArTagnan) R 757 759 542 0 -1 4202560 91421 0 0 0 501127 18 0 0 25 0 8 0 808141571 3909283840 774537 33554432000 4194304 4625164 140736888579104 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 3817660

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.53 s]
/proc/loadavg: 8.09 8.08 8.02 2/494 942
/proc/meminfo: memFree=28264316/32951132 swapFree=57925096/67111528
[pid=759] ppid=757 vsize=0 CPUtime=40000.8 cores=0-7
/proc/759/stat : 759 (SArTagnan) Z 757 759 542 0 -1 4203548 37355538 0 0 0 3993080 6998 0 0 25 0 2 0 808141571 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/759/statm: 0 0 0 0 0 0 0
[pid=759/tid=760] ppid=757 vsize=0 CPUtime=4924.75 cores=0-7
/proc/759/task/760/stat : 760 (SArTagnan) R 757 759 542 0 -1 4203588 96194 0 0 0 492438 37 0 0 25 0 2 0 808141571 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.56
CPU time (s): 40000.8
CPU user time (s): 39930.8
CPU system time (s): 70.0234
CPU usage (%): 798.17
Max. virtual memory (cumulated for all children) (KiB): 4026240

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39930.8
system time used= 70.0234
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37355538
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3446
involuntary context switches= 131579

runsolver used 22.6246 second user time and 64.2022 second system time

The end

Launcher Data 

Begin job on node129 at 2011-06-01 23:57:00
IDJOB=3439516
IDBENCH=85459
IDSOLVER=1936
FILE ID=node129/3439516-1306965419
RUNJOBID= node129-1306960406-556
PBS_JOBID= 13497622
Free space on /tmp= 73752 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-020-019.shuffled-as.sat05-1190.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439516-1306965419/watcher-3439516-1306965419 -o /tmp/evaluation-result-3439516-1306965419/solver-3439516-1306965419 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439516-1306965419.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 81bbeaaf9f0ca3bfc36d743097777052
RANDOM SEED=1346475905

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      29175564 kB
Buffers:        280536 kB
Cached:        2061776 kB
SwapCached:      49316 kB
Active:         230872 kB
Inactive:      3261196 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      29175564 kB
SwapTotal:    67111528 kB
SwapFree:     57925096 kB
Dirty:             424 kB
Writeback:           0 kB
AnonPages:     1111688 kB
Mapped:          14464 kB
Slab:           153864 kB
PageTables:      59108 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 147302604 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73748 MiB
End job on node129 at 2011-06-02 01:20:33