Trace number 3250166

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.17 1201.76

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-3-6_2072.cnf
MD5SUMd2ef996f95bbf68a3c980c797dfdc364
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2071
Number of clauses159039
Sum of the clauses size479052
Maximum clause length6
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3158394
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5645

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250166-1304091677/watcher-3250166-1304091677 -o /tmp/evaluation-result-3250166-1304091677/solver-3250166-1304091677 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3250166-1304091677.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.51 7.98 7.99 5/180 19288
/proc/meminfo: memFree=30224668/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=22976 CPUtime=0 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 744 0 0 0 0 0 0 0 25 0 1 0 520768084 23527424 599 33554432000 4194304 4623224 140736804490496 18446744073709551615 253640859392 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/19288/statm: 5744 599 297 105 0 1248 0

[startup+0.0400841 s]
/proc/loadavg: 7.51 7.98 7.99 5/180 19288
/proc/meminfo: memFree=30224668/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=29132 CPUtime=0.03 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 4368 0 0 0 3 0 0 0 25 0 1 0 520768084 29831168 2444 33554432000 4194304 4623224 140736804490496 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/19288/statm: 7283 2444 297 105 0 2787 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29132

[startup+0.102609 s]
/proc/loadavg: 7.51 7.98 7.99 5/180 19288
/proc/meminfo: memFree=30224668/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=222908 CPUtime=0.12 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 13913 0 0 0 11 1 0 0 25 0 4 0 520768084 228257792 9498 33554432000 4194304 4623224 140736804490496 18446744073709551615 4355942 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 55727 9498 329 105 0 51231 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 222908

[startup+0.301004 s]
/proc/loadavg: 7.51 7.98 7.99 5/180 19288
/proc/meminfo: memFree=30224668/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=237824 CPUtime=0.91 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 18552 0 0 0 89 2 0 0 25 0 4 0 520768084 243531776 13380 33554432000 4194304 4623224 140736804490496 18446744073709551615 4488817 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 59456 13380 336 105 0 54960 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 237824

[startup+0.700932 s]
/proc/loadavg: 7.51 7.98 7.99 5/180 19288
/proc/meminfo: memFree=30224668/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=239064 CPUtime=2.51 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 28672 0 0 0 248 3 0 0 25 0 4 0 520768084 244801536 13929 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510252 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 59766 13929 336 105 0 55270 0
Current children cumulated CPU time (s) 2.51
Current children cumulated vsize (KiB) 239064

[startup+1.50079 s]
/proc/loadavg: 7.51 7.98 7.99 9/184 19292
/proc/meminfo: memFree=30167232/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=241740 CPUtime=5.71 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 46737 0 0 0 565 6 0 0 25 0 4 0 520768084 247541760 14863 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 60435 14863 336 105 0 55939 0
[pid=19288/tid=19290] ppid=19286 vsize=241740 CPUtime=1.4 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 1126 0 0 0 140 0 0 0 19 0 4 0 520768093 247541760 14863 33554432000 4194304 4623224 140736804490496 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=241740 CPUtime=1.4 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 1068 0 0 0 140 0 0 0 25 0 4 0 520768093 247541760 14863 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=241740 CPUtime=1.39 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 28218 0 0 0 135 4 0 0 25 0 4 0 520768093 247541760 14863 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.71
Current children cumulated vsize (KiB) 241740

[startup+3.10049 s]
/proc/loadavg: 7.51 7.98 7.99 9/184 19292
/proc/meminfo: memFree=30160908/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=251336 CPUtime=12.09 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 80886 0 0 0 1199 10 0 0 25 0 4 0 520768084 257368064 16070 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 62834 16070 337 105 0 58338 0
[pid=19288/tid=19290] ppid=19286 vsize=251336 CPUtime=3 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 2821 0 0 0 300 0 0 0 25 0 4 0 520768093 257368064 16070 33554432000 4194304 4623224 140736804490496 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=251336 CPUtime=2.99 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 2728 0 0 0 299 0 0 0 25 0 4 0 520768093 257368064 16070 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=251336 CPUtime=2.99 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 58855 0 0 0 291 8 0 0 25 0 4 0 520768093 257368064 16070 33554432000 4194304 4623224 140736804490496 18446744073709551615 4278419 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.09
Current children cumulated vsize (KiB) 251336

[startup+6.30091 s]
/proc/loadavg: 7.55 7.98 7.99 9/184 19292
/proc/meminfo: memFree=30137644/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=253140 CPUtime=24.88 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 124798 0 0 0 2471 17 0 0 25 0 4 0 520768084 259215360 19602 33554432000 4194304 4623224 140736804490496 18446744073709551615 4385677 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 63285 19602 341 105 0 58789 0
[pid=19288/tid=19290] ppid=19286 vsize=253140 CPUtime=6.2 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 3212 0 0 0 620 0 0 0 25 0 4 0 520768093 259215360 19602 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376904 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=253140 CPUtime=6.19 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 3186 0 0 0 619 0 0 0 25 0 4 0 520768093 259215360 19602 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=253140 CPUtime=6.16 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 101731 0 0 0 603 13 0 0 25 0 4 0 520768093 259215360 19602 33554432000 4194304 4623224 140736804490496 18446744073709551615 4545407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.88
Current children cumulated vsize (KiB) 253140

[startup+12.7007 s]
/proc/loadavg: 7.67 8.00 7.99 9/184 19292
/proc/meminfo: memFree=30092940/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=265356 CPUtime=50.44 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 229541 0 0 0 5013 31 0 0 25 0 4 0 520768084 271724544 26584 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 66339 26584 341 105 0 61843 0
[pid=19288/tid=19290] ppid=19286 vsize=265356 CPUtime=12.59 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 6213 0 0 0 1259 0 0 0 25 0 4 0 520768093 271724544 26584 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=265356 CPUtime=12.6 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 6088 0 0 0 1259 1 0 0 25 0 4 0 520768093 271724544 26584 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376829 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=265356 CPUtime=12.53 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 199161 0 0 0 1226 27 0 0 25 0 4 0 520768093 271724544 26584 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.44
Current children cumulated vsize (KiB) 265356

[startup+25.5004 s]
/proc/loadavg: 7.74 8.00 7.99 9/184 19293
/proc/meminfo: memFree=30002272/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=286900 CPUtime=101.57 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 359226 0 0 0 10108 49 0 0 25 0 4 0 520768084 293785600 37537 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510627 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 71725 37537 341 105 0 67229 0
[pid=19288/tid=19290] ppid=19286 vsize=286900 CPUtime=25.39 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 11769 0 0 0 2538 1 0 0 25 0 4 0 520768093 293785600 37537 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=286900 CPUtime=25.4 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 10878 0 0 0 2538 2 0 0 25 0 4 0 520768093 293785600 37537 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=286900 CPUtime=25.26 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 316972 0 0 0 2483 43 0 0 25 0 4 0 520768093 293785600 37537 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364687 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.57
Current children cumulated vsize (KiB) 286900

[startup+51.1007 s]
/proc/loadavg: 7.83 8.00 7.99 9/184 19293
/proc/meminfo: memFree=29870024/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=319720 CPUtime=203.84 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 654311 0 0 0 20290 94 0 0 25 0 4 0 520768084 327393280 55718 33554432000 4194304 4623224 140736804490496 18446744073709551615 4516488 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 79930 55718 341 105 0 75434 0
[pid=19288/tid=19290] ppid=19286 vsize=319720 CPUtime=51 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 18465 0 0 0 5097 3 0 0 25 0 4 0 520768093 327393280 55718 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=319720 CPUtime=51 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 17602 0 0 0 5097 3 0 0 25 0 4 0 520768093 327393280 55718 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=319720 CPUtime=50.72 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 592957 0 0 0 4989 83 0 0 25 0 4 0 520768093 327393280 55718 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.84
Current children cumulated vsize (KiB) 319720

[startup+102.306 s]
/proc/loadavg: 7.97 8.01 8.00 9/184 19295
/proc/meminfo: memFree=29645936/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=498616 CPUtime=408.38 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 979287 0 0 0 40694 144 0 0 25 0 4 0 520768084 510582784 83399 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510340 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 124654 83399 351 105 0 120158 0
[pid=19288/tid=19290] ppid=19286 vsize=498616 CPUtime=102.2 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 27428 0 0 0 10216 4 0 0 25 0 4 0 520768093 510582784 83399 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=498616 CPUtime=102.21 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 29896 0 0 0 10216 5 0 0 25 0 4 0 520768093 510582784 83399 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376895 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=498616 CPUtime=101.65 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 881883 0 0 0 10038 127 0 0 25 0 4 0 520768093 510582784 83399 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.38
Current children cumulated vsize (KiB) 498616

[startup+162.3 s]
/proc/loadavg: 7.99 8.00 8.00 9/184 19296
/proc/meminfo: memFree=29397784/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=653336 CPUtime=648.04 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 1333493 0 0 0 64604 200 0 0 25 0 4 0 520768084 669016064 109966 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510142 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 163334 109966 422 105 0 158838 0
[pid=19288/tid=19290] ppid=19286 vsize=653336 CPUtime=162.2 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 31876 0 0 0 16215 5 0 0 25 0 4 0 520768093 669016064 109966 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=653336 CPUtime=162.2 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 32513 0 0 0 16214 6 0 0 25 0 4 0 520768093 669016064 109966 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=653336 CPUtime=161.32 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 1214123 0 0 0 15954 178 0 0 25 0 4 0 520768093 669016064 109966 33554432000 4194304 4623224 140736804490496 18446744073709551615 253640556647 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 648.04
Current children cumulated vsize (KiB) 653336

[startup+222.3 s]
/proc/loadavg: 7.99 8.00 8.00 9/184 19298
/proc/meminfo: memFree=29181260/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=734032 CPUtime=887.72 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 1868369 0 0 0 88490 282 0 0 25 0 4 0 520768084 751648768 135123 33554432000 4194304 4623224 140736804490496 18446744073709551615 4394133 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 183508 135123 382 105 0 179012 0
[pid=19288/tid=19290] ppid=19286 vsize=734032 CPUtime=222.2 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 46165 0 0 0 22213 7 0 0 25 0 4 0 520768093 751648768 135123 33554432000 4194304 4623224 140736804490496 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=734032 CPUtime=222.2 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 45879 0 0 0 22212 8 0 0 25 0 4 0 520768093 751648768 135123 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=734032 CPUtime=220.98 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 1711513 0 0 0 21845 253 0 0 25 0 4 0 520768093 751648768 135123 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 887.72
Current children cumulated vsize (KiB) 734032

[startup+282.3 s]

################
# More data... #
################

[pid=19288] ppid=19286 vsize=1208432 CPUtime=2805.16 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 5332767 0 0 0 279687 829 0 0 25 0 4 0 520768084 1237434368 242631 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 302108 242631 347 105 0 297612 0
[pid=19288/tid=19290] ppid=19286 vsize=1208432 CPUtime=702.22 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 77233 0 0 0 70208 14 0 0 25 0 4 0 520768093 1237434368 242631 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1208432 CPUtime=702.22 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 78215 0 0 0 70205 17 0 0 25 0 4 0 520768093 1237434368 242631 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1208432 CPUtime=698.39 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 5053003 0 0 0 69064 775 0 0 25 0 4 0 520768093 1237434368 242631 33554432000 4194304 4623224 140736804490496 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2805.16
Current children cumulated vsize (KiB) 1208432

[startup+762.307 s]
/proc/loadavg: 8.21 8.14 8.05 9/184 19312
/proc/meminfo: memFree=28314428/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1249608 CPUtime=3044.85 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 5757369 0 0 0 303592 893 0 0 25 0 4 0 520768084 1279598592 251528 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 312402 251528 347 105 0 307906 0
[pid=19288/tid=19290] ppid=19286 vsize=1249608 CPUtime=762.23 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 77966 0 0 0 76209 14 0 0 25 0 4 0 520768093 1279598592 251528 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1249608 CPUtime=762.22 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 79332 0 0 0 76205 17 0 0 25 0 4 0 520768093 1279598592 251528 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1249608 CPUtime=758.06 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 5459533 0 0 0 74970 836 0 0 25 0 4 0 520768093 1279598592 251528 33554432000 4194304 4623224 140736804490496 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.85
Current children cumulated vsize (KiB) 1249608

[startup+822.301 s]
/proc/loadavg: 8.19 8.14 8.06 9/184 19314
/proc/meminfo: memFree=28238768/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1307708 CPUtime=3284.51 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 6154181 0 0 0 327496 955 0 0 25 0 4 0 520768084 1339092992 265698 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 326927 265698 345 105 0 322431 0
[pid=19288/tid=19290] ppid=19286 vsize=1307708 CPUtime=822.22 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 78448 0 0 0 82208 14 0 0 25 0 4 0 520768093 1339092992 265698 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1307708 CPUtime=822.22 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 107273 0 0 0 82201 21 0 0 25 0 4 0 520768093 1339092992 265698 33554432000 4194304 4623224 140736804490496 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1307708 CPUtime=817.73 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 5826621 0 0 0 80880 893 0 0 25 0 4 0 520768093 1339092992 265698 33554432000 4194304 4623224 140736804490496 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.51
Current children cumulated vsize (KiB) 1307708

[startup+882.301 s]
/proc/loadavg: 8.17 8.15 8.06 9/184 19316
/proc/meminfo: memFree=28164340/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1380524 CPUtime=3524.19 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 6638300 0 0 0 351388 1031 0 0 25 0 4 0 520768084 1413656576 273834 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 345131 273834 341 105 0 340635 0
[pid=19288/tid=19290] ppid=19286 vsize=1380524 CPUtime=882.22 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 79215 0 0 0 88208 14 0 0 25 0 4 0 520768093 1413656576 273834 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1380524 CPUtime=882.22 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 108242 0 0 0 88200 22 0 0 25 0 4 0 520768093 1413656576 273834 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1380524 CPUtime=877.41 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 6307419 0 0 0 86772 969 0 0 25 0 4 0 520768093 1413656576 273834 33554432000 4194304 4623224 140736804490496 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.19
Current children cumulated vsize (KiB) 1380524

[startup+942.301 s]
/proc/loadavg: 8.16 8.15 8.07 9/184 19317
/proc/meminfo: memFree=28094760/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1392248 CPUtime=3763.87 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 6978194 0 0 0 375308 1079 0 0 25 0 4 0 520768084 1425661952 284510 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 348062 284510 341 105 0 343566 0
[pid=19288/tid=19290] ppid=19286 vsize=1392248 CPUtime=942.23 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 79889 0 0 0 94208 15 0 0 25 0 4 0 520768093 1425661952 284510 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1392248 CPUtime=942.22 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 109054 0 0 0 94200 22 0 0 25 0 4 0 520768093 1425661952 284510 33554432000 4194304 4623224 140736804490496 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1392248 CPUtime=937.09 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 6643905 0 0 0 92693 1016 0 0 25 0 4 0 520768093 1425661952 284510 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364923 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3763.87
Current children cumulated vsize (KiB) 1392248

[startup+1002.3 s]
/proc/loadavg: 8.19 8.16 8.08 9/184 19319
/proc/meminfo: memFree=28035096/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1399692 CPUtime=4003.56 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 7323648 0 0 0 399221 1135 0 0 25 0 4 0 520768084 1433284608 295274 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 349923 295274 347 105 0 345427 0
[pid=19288/tid=19290] ppid=19286 vsize=1399692 CPUtime=1002.23 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 80654 0 0 0 100208 15 0 0 25 0 4 0 520768093 1433284608 295274 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1399692 CPUtime=1002.23 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 110113 0 0 0 100200 23 0 0 25 0 4 0 520768093 1433284608 295274 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1399692 CPUtime=996.76 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 6985568 0 0 0 98606 1070 0 0 25 0 4 0 520768093 1433284608 295274 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376858 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.56
Current children cumulated vsize (KiB) 1399692

[startup+1062.3 s]
/proc/loadavg: 8.16 8.16 8.08 9/184 19320
/proc/meminfo: memFree=27942688/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1506088 CPUtime=4243.23 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 7677157 0 0 0 423136 1187 0 0 25 0 4 0 520768084 1542234112 307800 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 376522 307800 341 105 0 372026 0
[pid=19288/tid=19290] ppid=19286 vsize=1506088 CPUtime=1062.23 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 81342 0 0 0 106208 15 0 0 25 0 4 0 520768093 1542234112 307800 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376917 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1506088 CPUtime=1062.22 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 111495 0 0 0 106199 23 0 0 25 0 4 0 520768093 1542234112 307800 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1506088 CPUtime=1056.44 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 7334263 0 0 0 104523 1121 0 0 25 0 4 0 520768093 1542234112 307800 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.23
Current children cumulated vsize (KiB) 1506088

[startup+1122.3 s]
/proc/loadavg: 8.14 8.16 8.09 9/184 19322
/proc/meminfo: memFree=27875208/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1611712 CPUtime=4482.91 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 8063792 0 0 0 447038 1253 0 0 25 0 4 0 520768084 1650393088 323160 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 402928 323160 352 105 0 398432 0
[pid=19288/tid=19290] ppid=19286 vsize=1611712 CPUtime=1122.23 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 107159 0 0 0 112204 19 0 0 25 0 4 0 520768093 1650393088 323160 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1611712 CPUtime=1122.23 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 112625 0 0 0 112199 24 0 0 25 0 4 0 520768093 1650393088 323160 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1611712 CPUtime=1116.11 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 7665452 0 0 0 110432 1179 0 0 25 0 4 0 520768093 1650393088 323160 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4482.91
Current children cumulated vsize (KiB) 1611712

[startup+1182.3 s]
/proc/loadavg: 8.08 8.14 8.09 9/184 19324
/proc/meminfo: memFree=27790500/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1621800 CPUtime=4722.6 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 8444116 0 0 0 470946 1314 0 0 25 0 4 0 520768084 1660723200 330492 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 405450 330492 347 105 0 400954 0
[pid=19288/tid=19290] ppid=19286 vsize=1621800 CPUtime=1182.24 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 107476 0 0 0 118205 19 0 0 25 0 4 0 520768093 1660723200 330492 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1621800 CPUtime=1182.23 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 113251 0 0 0 118199 24 0 0 25 0 4 0 520768093 1660723200 330492 33554432000 4194304 4623224 140736804490496 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1621800 CPUtime=1175.78 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 8043527 0 0 0 116339 1239 0 0 25 0 4 0 520768093 1660723200 330492 33554432000 4194304 4623224 140736804490496 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.6
Current children cumulated vsize (KiB) 1621800



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 7.51 8.01 8.05 5/175 19351
/proc/meminfo: memFree=29028180/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1624576 CPUtime=4800.08 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 8540191 0 0 0 478679 1329 0 0 25 0 4 0 520768084 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 406144 331361 341 105 0 401648 0
[pid=19288/tid=19290] ppid=19286 vsize=1624576 CPUtime=1201.64 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 107548 0 0 0 120145 19 0 0 25 0 4 0 520768093 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1624576 CPUtime=1201.62 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 113587 0 0 0 120138 24 0 0 25 0 4 0 520768093 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4462966 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1624576 CPUtime=1195.07 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 8138361 0 0 0 118253 1254 0 0 25 0 4 0 520768093 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 1624576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 7.51 8.01 8.05 5/175 19351
/proc/meminfo: memFree=29028180/32951124 swapFree=67111364/67111528
[pid=19288] ppid=19286 vsize=1624576 CPUtime=4800.08 cores=1,3,5,7
/proc/19288/stat : 19288 (SArTagnan) R 19286 19288 18837 0 -1 4202496 8540191 0 0 0 478679 1329 0 0 25 0 4 0 520768084 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19288/statm: 406144 331361 341 105 0 401648 0
[pid=19288/tid=19290] ppid=19286 vsize=1624576 CPUtime=1201.64 cores=1,3,5,7
/proc/19288/task/19290/stat : 19290 (SArTagnan) R 19286 19288 18837 0 -1 4202560 107548 0 0 0 120145 19 0 0 25 0 4 0 520768093 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19288/tid=19291] ppid=19286 vsize=1624576 CPUtime=1201.62 cores=1,3,5,7
/proc/19288/task/19291/stat : 19291 (SArTagnan) R 19286 19288 18837 0 -1 4202560 113587 0 0 0 120138 24 0 0 25 0 4 0 520768093 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4462966 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19288/tid=19292] ppid=19286 vsize=1624576 CPUtime=1195.07 cores=1,3,5,7
/proc/19288/task/19292/stat : 19292 (SArTagnan) R 19286 19288 18837 0 -1 4202560 8138361 0 0 0 118253 1254 0 0 25 0 4 0 520768093 1663565824 331361 33554432000 4194304 4623224 140736804490496 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 1624576

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.76
CPU time (s): 4800.17
CPU user time (s): 4786.82
CPU system time (s): 13.35
CPU usage (%): 399.427
Max. virtual memory (cumulated for all children) (KiB): 1634888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4786.82
system time used= 13.35
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8540191
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 304
involuntary context switches= 31923

runsolver used 1.74673 second user time and 4.81627 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-29 17:41:17
IDJOB=3250166
IDBENCH=83245
IDSOLVER=1656
FILE ID=node106/3250166-1304091677
RUNJOBID= node106-1304089256-18856
PBS_JOBID= 13170570
Free space on /tmp= 72152 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-3-6_2072.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250166-1304091677/watcher-3250166-1304091677 -o /tmp/evaluation-result-3250166-1304091677/solver-3250166-1304091677 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3250166-1304091677.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2ef996f95bbf68a3c980c797dfdc364
RANDOM SEED=1341152601

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30224824 kB
Buffers:        249620 kB
Cached:        2074328 kB
SwapCached:         88 kB
Active:         912616 kB
Inactive:      1601932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30224824 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            7768 kB
Writeback:           0 kB
AnonPages:      189720 kB
Mapped:          15388 kB
Slab:           146776 kB
PageTables:       4640 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   391284 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72156 MiB
End job on node106 at 2011-04-29 18:01:21