Trace number 3386114

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.29 1203.99

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1375c111739g4.cnf
MD5SUMb2f1edd9e4045a375bcfedb2d5e5bd0e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark51.2682
Satisfiable
(Un)Satisfiability was proved
Number of variables1375
Number of clauses111739
Sum of the clauses size224743
Maximum clause length25
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2111684
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 555

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386114-1305578381/watcher-3386114-1305578381 -o /tmp/evaluation-result-3386114-1305578381/solver-3386114-1305578381 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386114-1305578381.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.20 7.98 5.88 1/379 4817
/proc/meminfo: memFree=12422608/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=21620 CPUtime=0 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 570 0 0 0 0 0 0 0 25 0 1 0 669436842 22138880 508 33554432000 4194304 4625164 140734236528272 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/4817/statm: 5405 508 296 106 0 908 0

[startup+0.0400301 s]
/proc/loadavg: 8.20 7.98 5.88 1/379 4817
/proc/meminfo: memFree=12422608/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=190888 CPUtime=0.04 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 2821 0 0 0 4 0 0 0 25 0 4 0 669436842 195469312 1929 33554432000 4194304 4625164 140734236528272 18446744073709551615 47235806500786 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/4817/statm: 47722 1931 324 106 0 43225 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 190888

[startup+0.110711 s]
/proc/loadavg: 8.20 7.98 5.88 1/379 4817
/proc/meminfo: memFree=12422608/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=262720 CPUtime=0.29 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 6456 0 0 0 29 0 0 0 25 0 4 0 669436842 269025280 4538 33554432000 4194304 4625164 140734236528272 18446744073709551615 4513489 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 65680 4538 338 106 0 61183 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 262720

[startup+0.301011 s]
/proc/loadavg: 8.20 7.98 5.88 1/379 4817
/proc/meminfo: memFree=12422608/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=263400 CPUtime=1.06 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 7584 0 0 0 105 1 0 0 25 0 4 0 669436842 269721600 5543 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 65850 5543 345 106 0 61353 0
Current children cumulated CPU time (s) 1.06
Current children cumulated vsize (KiB) 263400

[startup+0.700919 s]
/proc/loadavg: 8.20 7.98 5.88 1/379 4817
/proc/meminfo: memFree=12422608/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=263936 CPUtime=2.66 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 9863 0 0 0 265 1 0 0 25 0 4 0 669436842 270270464 7822 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 65984 7822 345 106 0 61487 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 263936

[startup+1.50078 s]
/proc/loadavg: 8.20 7.98 5.88 5/383 4821
/proc/meminfo: memFree=12384672/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=272228 CPUtime=5.85 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 14268 0 0 0 583 2 0 0 25 0 4 0 669436842 278761472 11095 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 68057 11095 346 106 0 63560 0
[pid=4817/tid=4819] ppid=4815 vsize=272228 CPUtime=1.45 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 2491 0 0 0 145 0 0 0 25 0 4 0 669436845 278761472 11095 33554432000 4194304 4625164 140734236528272 18446744073709551615 4464428 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=272228 CPUtime=1.45 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 2830 0 0 0 145 0 0 0 25 0 4 0 669436845 278761472 11096 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=272228 CPUtime=1.45 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 1573 0 0 0 145 0 0 0 25 0 4 0 669436845 278761472 11096 33554432000 4194304 4625164 140734236528272 18446744073709551615 4288796 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 272228

[startup+3.1005 s]
/proc/loadavg: 8.19 7.98 5.89 9/388 4851
/proc/meminfo: memFree=12362596/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=277380 CPUtime=12.23 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 28621 0 0 0 1219 4 0 0 25 0 4 0 669436842 284037120 15910 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512029 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 69345 15910 346 106 0 64848 0
[pid=4817/tid=4819] ppid=4815 vsize=277380 CPUtime=3.06 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 3949 0 0 0 305 1 0 0 25 0 4 0 669436845 284037120 15910 33554432000 4194304 4625164 140734236528272 18446744073709551615 4486934 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=277380 CPUtime=3.05 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5181 0 0 0 304 1 0 0 25 0 4 0 669436845 284037120 15910 33554432000 4194304 4625164 140734236528272 18446744073709551615 235594525101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=277380 CPUtime=3.03 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 11256 0 0 0 303 0 0 0 25 0 4 0 669436845 284037120 15910 33554432000 4194304 4625164 140734236528272 18446744073709551615 4288743 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.23
Current children cumulated vsize (KiB) 277380

[startup+6.30093 s]
/proc/loadavg: 8.19 7.98 5.89 9/388 4851
/proc/meminfo: memFree=12305112/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=293204 CPUtime=24.99 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 49450 0 0 0 2491 8 0 0 25 0 4 0 669436842 300240896 21039 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511982 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 73301 21039 346 106 0 68804 0
[pid=4817/tid=4819] ppid=4815 vsize=293204 CPUtime=6.26 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 6013 0 0 0 624 2 0 0 25 0 4 0 669436845 300240896 21039 33554432000 4194304 4625164 140734236528272 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=293204 CPUtime=6.25 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 8478 0 0 0 624 1 0 0 25 0 4 0 669436845 300240896 21039 33554432000 4194304 4625164 140734236528272 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=293204 CPUtime=6.19 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 25218 0 0 0 617 2 0 0 25 0 4 0 669436845 300240896 21039 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.99
Current children cumulated vsize (KiB) 293204

[startup+12.7008 s]
/proc/loadavg: 8.16 7.98 5.91 9/388 4851
/proc/meminfo: memFree=12232000/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=306100 CPUtime=50.51 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 100572 0 0 0 5034 17 0 0 25 0 4 0 669436842 313446400 30764 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 76525 30764 346 106 0 72028 0
[pid=4817/tid=4819] ppid=4815 vsize=306100 CPUtime=12.66 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 10766 0 0 0 1262 4 0 0 25 0 4 0 669436845 313446400 30764 33554432000 4194304 4625164 140734236528272 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=306100 CPUtime=12.65 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 13051 0 0 0 1263 2 0 0 25 0 4 0 669436845 313446400 30764 33554432000 4194304 4625164 140734236528272 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=306100 CPUtime=12.51 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 65496 0 0 0 1243 8 0 0 25 0 4 0 669436845 313446400 30764 33554432000 4194304 4625164 140734236528272 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.51
Current children cumulated vsize (KiB) 306100

[startup+25.5006 s]
/proc/loadavg: 8.13 7.98 5.93 9/388 4852
/proc/meminfo: memFree=12126448/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=334896 CPUtime=101.53 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 202698 0 0 0 10117 36 0 0 25 0 4 0 669436842 342933504 45827 33554432000 4194304 4625164 140734236528272 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 83724 45827 346 106 0 79227 0
[pid=4817/tid=4819] ppid=4815 vsize=334896 CPUtime=25.46 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 16988 0 0 0 2538 8 0 0 25 0 4 0 669436845 342933504 45827 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=334896 CPUtime=25.45 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 19721 0 0 0 2540 5 0 0 25 0 4 0 669436845 342933504 45827 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=334896 CPUtime=25.15 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 147870 0 0 0 2495 20 0 0 25 0 4 0 669436845 342933504 45827 33554432000 4194304 4625164 140734236528272 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.53
Current children cumulated vsize (KiB) 334896

[startup+51.1011 s]
/proc/loadavg: 8.15 8.00 5.99 9/388 4852
/proc/meminfo: memFree=11967288/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=448060 CPUtime=203.62 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 354280 0 0 0 20302 60 0 0 25 0 4 0 669436842 458813440 65747 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 112015 65747 346 106 0 107518 0
[pid=4817/tid=4819] ppid=4815 vsize=448060 CPUtime=51.05 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 22954 0 0 0 5096 9 0 0 25 0 4 0 669436845 458813440 65747 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=448060 CPUtime=51.06 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 25177 0 0 0 5098 8 0 0 25 0 4 0 669436845 458813440 65747 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=448060 CPUtime=50.42 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 253970 0 0 0 5008 34 0 0 25 0 4 0 669436845 458813440 65747 33554432000 4194304 4625164 140734236528272 18446744073709551615 235594910055 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.62
Current children cumulated vsize (KiB) 448060

[startup+102.314 s]
/proc/loadavg: 8.16 8.03 6.11 9/388 4854
/proc/meminfo: memFree=11657884/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=567652 CPUtime=407.81 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 503615 0 0 0 40682 99 0 0 25 0 4 0 669436842 581275648 109203 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512736 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 141913 109203 346 106 0 137416 0
[pid=4817/tid=4819] ppid=4815 vsize=567652 CPUtime=102.26 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 35953 0 0 0 10208 18 0 0 25 0 4 0 669436845 581275648 109203 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=567652 CPUtime=102.26 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 36812 0 0 0 10208 18 0 0 25 0 4 0 669436845 581275648 109203 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=567652 CPUtime=100.98 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 319342 0 0 0 10053 45 0 0 25 0 4 0 669436845 581275648 109203 33554432000 4194304 4625164 140734236528272 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.81
Current children cumulated vsize (KiB) 567652

[startup+162.3 s]
/proc/loadavg: 8.17 8.05 6.23 9/388 4855
/proc/meminfo: memFree=11406744/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=836192 CPUtime=647 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 921365 0 0 0 64534 166 0 0 25 0 4 0 669436842 856260608 143778 33554432000 4194304 4625164 140734236528272 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 209048 143778 607 106 0 204551 0
[pid=4817/tid=4819] ppid=4815 vsize=836192 CPUtime=162.25 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 45669 0 0 0 16205 20 0 0 25 0 4 0 669436845 856260608 143778 33554432000 4194304 4625164 140734236528272 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=836192 CPUtime=162.25 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 46601 0 0 0 16201 24 0 0 25 0 4 0 669436845 856260608 143778 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=836192 CPUtime=160.21 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 667489 0 0 0 15922 99 0 0 25 0 4 0 669436845 856260608 143778 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647
Current children cumulated vsize (KiB) 836192

[startup+222.301 s]
/proc/loadavg: 8.21 8.08 6.36 9/388 4857
/proc/meminfo: memFree=11258396/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=856220 CPUtime=886.23 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 1468115 0 0 0 88362 261 0 0 25 0 4 0 669436842 876769280 158799 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 214055 158799 607 106 0 209558 0
[pid=4817/tid=4819] ppid=4815 vsize=856220 CPUtime=222.25 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 58479 0 0 0 22203 22 0 0 25 0 4 0 669436845 876769280 158799 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=856220 CPUtime=222.25 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 54583 0 0 0 22192 33 0 0 25 0 4 0 669436845 876769280 158799 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=856220 CPUtime=219.44 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 1190371 0 0 0 21763 181 0 0 25 0 4 0 669436845 876769280 158799 33554432000 4194304 4625164 140734236528272 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 886.23
Current children cumulated vsize (KiB) 856220

[startup+282.3 s]

################
# More data... #
################

[pid=4817] ppid=4815 vsize=1727696 CPUtime=2800.12 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 4916385 0 0 0 279180 832 0 0 25 0 4 0 669436842 1769160704 343632 33554432000 4194304 4625164 140734236528272 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 431924 343632 346 106 0 427427 0
[pid=4817/tid=4819] ppid=4815 vsize=1727696 CPUtime=702.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 91309 0 0 0 70188 36 0 0 25 0 4 0 669436845 1769160704 343632 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=1727696 CPUtime=702.25 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 85353 0 0 0 70160 65 0 0 25 0 4 0 669436845 1769160704 343632 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=1727696 CPUtime=693.31 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 4202828 0 0 0 68681 650 0 0 25 0 4 0 669436845 1769160704 343632 33554432000 4194304 4625164 140734236528272 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2800.12
Current children cumulated vsize (KiB) 1727696

[startup+762.315 s]
/proc/loadavg: 8.13 8.07 7.09 9/388 4871
/proc/meminfo: memFree=9817032/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=1796940 CPUtime=3039.41 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 5370140 0 0 0 303038 903 0 0 25 0 4 0 669436842 1840066560 357507 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512475 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 449235 357507 346 106 0 444738 0
[pid=4817/tid=4819] ppid=4815 vsize=1796940 CPUtime=762.25 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 91731 0 0 0 76189 36 0 0 25 0 4 0 669436845 1840066560 357507 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=1796940 CPUtime=762.28 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 86238 0 0 0 76162 66 0 0 25 0 4 0 669436845 1840066560 357507 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=1796940 CPUtime=752.56 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 4619332 0 0 0 74541 715 0 0 25 0 4 0 669436845 1840066560 357507 33554432000 4194304 4625164 140734236528272 18446744073709551615 4327715 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3039.41
Current children cumulated vsize (KiB) 1796940

[startup+822.3 s]
/proc/loadavg: 8.04 8.05 7.15 9/388 4873
/proc/meminfo: memFree=9717544/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=1820720 CPUtime=3278.6 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 5906185 0 0 0 326865 995 0 0 25 0 4 0 669436842 1864417280 371838 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 455180 371838 346 106 0 450683 0
[pid=4817/tid=4819] ppid=4815 vsize=1820720 CPUtime=822.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 92087 0 0 0 82188 36 0 0 25 0 4 0 669436845 1864417280 371838 33554432000 4194304 4625164 140734236528272 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=1820720 CPUtime=822.26 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 98711 0 0 0 82159 67 0 0 25 0 4 0 669436845 1864417280 371838 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=1820720 CPUtime=811.79 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5083835 0 0 0 80386 793 0 0 25 0 4 0 669436845 1864417280 371838 33554432000 4194304 4625164 140734236528272 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3278.6
Current children cumulated vsize (KiB) 1820720

[startup+882.301 s]
/proc/loadavg: 8.05 8.05 7.20 9/388 4875
/proc/meminfo: memFree=9615064/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=1859224 CPUtime=3517.84 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 6434487 0 0 0 350700 1084 0 0 25 0 4 0 669436842 1903845376 384146 33554432000 4194304 4625164 140734236528272 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 464806 384146 346 106 0 460309 0
[pid=4817/tid=4819] ppid=4815 vsize=1859224 CPUtime=882.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 92475 0 0 0 88188 36 0 0 25 0 4 0 669436845 1903845376 384146 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=1859224 CPUtime=882.26 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 99957 0 0 0 88158 68 0 0 25 0 4 0 669436845 1903845376 384146 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=1859224 CPUtime=871.02 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5545333 0 0 0 86234 868 0 0 25 0 4 0 669436845 1903845376 384146 33554432000 4194304 4625164 140734236528272 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3517.84
Current children cumulated vsize (KiB) 1859224

[startup+942.301 s]
/proc/loadavg: 8.13 8.07 7.26 9/388 4876
/proc/meminfo: memFree=9500812/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=1865588 CPUtime=3757.09 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 6901762 0 0 0 374547 1162 0 0 25 0 4 0 669436842 1910362112 396681 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 466397 396681 346 106 0 461900 0
[pid=4817/tid=4819] ppid=4815 vsize=1865588 CPUtime=942.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 92904 0 0 0 94187 37 0 0 25 0 4 0 669436845 1910362112 396681 33554432000 4194304 4625164 140734236528272 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=1865588 CPUtime=942.27 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 101382 0 0 0 94158 69 0 0 25 0 4 0 669436845 1910362112 396681 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=1865588 CPUtime=930.27 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5960913 0 0 0 92093 934 0 0 25 0 4 0 669436845 1910362112 396681 33554432000 4194304 4625164 140734236528272 18446744073709551615 4579601 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3757.09
Current children cumulated vsize (KiB) 1865588

[startup+1002.3 s]
/proc/loadavg: 8.17 8.10 7.32 9/388 4878
/proc/meminfo: memFree=9411736/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=1938020 CPUtime=3996.32 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 6953538 0 0 0 398451 1181 0 0 25 0 4 0 669436842 1984532480 409351 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 484505 409351 346 106 0 480008 0
[pid=4817/tid=4819] ppid=4815 vsize=1938020 CPUtime=1002.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 93293 0 0 0 100187 37 0 0 25 0 4 0 669436845 1984532480 409351 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=1938020 CPUtime=1002.27 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 106064 0 0 0 100150 77 0 0 25 0 4 0 669436845 1984532480 409351 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=1938020 CPUtime=989.5 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5962080 0 0 0 98015 935 0 0 25 0 4 0 669436845 1984532480 409351 33554432000 4194304 4625164 140734236528272 18446744073709551615 4291963 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3996.32
Current children cumulated vsize (KiB) 1938020

[startup+1062.3 s]
/proc/loadavg: 8.17 8.11 7.37 9/388 4879
/proc/meminfo: memFree=9232260/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=2324924 CPUtime=4235.55 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 7192137 0 0 0 422341 1214 0 0 25 0 4 0 669436842 2380722176 445515 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 581231 445515 346 106 0 576734 0
[pid=4817/tid=4819] ppid=4815 vsize=2324924 CPUtime=1062.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 99593 0 0 0 106186 38 0 0 25 0 4 0 669436845 2380722176 445515 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=2324924 CPUtime=1062.27 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 106352 0 0 0 106150 77 0 0 25 0 4 0 669436845 2380722176 445515 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=2324924 CPUtime=1048.73 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5966038 0 0 0 103937 936 0 0 25 0 4 0 669436845 2380722176 445515 33554432000 4194304 4625164 140734236528272 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4235.55
Current children cumulated vsize (KiB) 2324924

[startup+1122.3 s]
/proc/loadavg: 8.22 8.13 7.42 9/388 4881
/proc/meminfo: memFree=9131528/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=2343492 CPUtime=4474.78 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 7245716 0 0 0 446251 1227 0 0 25 0 4 0 669436842 2399735808 453764 33554432000 4194304 4625164 140734236528272 18446744073709551615 4329225 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 585873 453765 346 106 0 581376 0
[pid=4817/tid=4819] ppid=4815 vsize=2343492 CPUtime=1122.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 99869 0 0 0 112186 38 0 0 25 0 4 0 669436845 2399735808 453766 33554432000 4194304 4625164 140734236528272 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=2343492 CPUtime=1122.27 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 106598 0 0 0 112150 77 0 0 25 0 4 0 669436845 2399735808 453766 33554432000 4194304 4625164 140734236528272 18446744073709551615 4295440 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=2343492 CPUtime=1107.96 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5970683 0 0 0 109858 938 0 0 25 0 4 0 669436845 2399735808 453767 33554432000 4194304 4625164 140734236528272 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4474.78
Current children cumulated vsize (KiB) 2343492

[startup+1182.3 s]
/proc/loadavg: 8.22 8.14 7.46 9/388 4883
/proc/meminfo: memFree=9067756/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=2363276 CPUtime=4714.03 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 7301325 0 0 0 470163 1240 0 0 25 0 4 0 669436842 2419994624 462899 33554432000 4194304 4625164 140734236528272 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 590819 462899 346 106 0 586322 0
[pid=4817/tid=4819] ppid=4815 vsize=2363276 CPUtime=1182.24 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 100142 0 0 0 118186 38 0 0 25 0 4 0 669436845 2419994624 462899 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=2363276 CPUtime=1182.27 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 106887 0 0 0 118150 77 0 0 25 0 4 0 669436845 2419994624 462899 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=2363276 CPUtime=1167.2 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5975622 0 0 0 115781 939 0 0 25 0 4 0 669436845 2419994624 462899 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4714.03
Current children cumulated vsize (KiB) 2363276



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 8.14 8.13 7.48 9/388 4883
/proc/meminfo: memFree=9045420/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=2369016 CPUtime=4800.18 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 7322382 0 0 0 478774 1244 0 0 25 0 4 0 669436842 2425872384 466046 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 592254 466046 346 106 0 587757 0
[pid=4817/tid=4819] ppid=4815 vsize=2369016 CPUtime=1203.85 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 100363 0 0 0 120347 38 0 0 25 0 4 0 669436845 2425872384 466047 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=2369016 CPUtime=1203.89 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 106924 0 0 0 120312 77 0 0 25 0 4 0 669436845 2425872384 466047 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=2369016 CPUtime=1188.53 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5977096 0 0 0 117913 940 0 0 25 0 4 0 669436845 2425872384 466047 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 2369016

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.9 s]
/proc/loadavg: 8.14 8.13 7.48 9/388 4883
/proc/meminfo: memFree=9045420/32950928 swapFree=54713420/67111528
[pid=4817] ppid=4815 vsize=2369016 CPUtime=4800.18 cores=1,3,5,7
/proc/4817/stat : 4817 (SArTagnan) R 4815 4817 4682 0 -1 4202496 7322382 0 0 0 478774 1244 0 0 25 0 4 0 669436842 2425872384 466046 33554432000 4194304 4625164 140734236528272 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4817/statm: 592254 466046 346 106 0 587757 0
[pid=4817/tid=4819] ppid=4815 vsize=2369016 CPUtime=1203.85 cores=1,3,5,7
/proc/4817/task/4819/stat : 4819 (SArTagnan) R 4815 4817 4682 0 -1 4202560 100363 0 0 0 120347 38 0 0 25 0 4 0 669436845 2425872384 466047 33554432000 4194304 4625164 140734236528272 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4817/tid=4820] ppid=4815 vsize=2369016 CPUtime=1203.89 cores=1,3,5,7
/proc/4817/task/4820/stat : 4820 (SArTagnan) R 4815 4817 4682 0 -1 4202560 106924 0 0 0 120312 77 0 0 25 0 4 0 669436845 2425872384 466047 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4817/tid=4821] ppid=4815 vsize=2369016 CPUtime=1188.53 cores=1,3,5,7
/proc/4817/task/4821/stat : 4821 (SArTagnan) R 4815 4817 4682 0 -1 4202560 5977096 0 0 0 117913 940 0 0 25 0 4 0 669436845 2425872384 466047 33554432000 4194304 4625164 140734236528272 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 2369016

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.99
CPU time (s): 4800.29
CPU user time (s): 4787.78
CPU system time (s): 12.5101
CPU usage (%): 398.698
Max. virtual memory (cumulated for all children) (KiB): 2967720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4787.78
system time used= 12.5101
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7322541
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1513
involuntary context switches= 20358

runsolver used 4.17736 second user time and 11.1563 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-16 22:39:41
IDJOB=3386114
IDBENCH=71317
IDSOLVER=1871
FILE ID=node120/3386114-1305578381
RUNJOBID= node120-1305577174-4701
PBS_JOBID= 13350219
Free space on /tmp= 73484 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1375c111739g4.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386114-1305578381/watcher-3386114-1305578381 -o /tmp/evaluation-result-3386114-1305578381/solver-3386114-1305578381 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386114-1305578381.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b2f1edd9e4045a375bcfedb2d5e5bd0e
RANDOM SEED=165069136

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12422764 kB
Buffers:        133100 kB
Cached:        1481336 kB
SwapCached:      32608 kB
Active:        7133276 kB
Inactive:     13151816 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12422764 kB
SwapTotal:    67111528 kB
SwapFree:     54713420 kB
Dirty:            1604 kB
Writeback:           0 kB
AnonPages:    18643692 kB
Mapped:          21924 kB
Slab:            94048 kB
PageTables:      81484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 78744212 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73496 MiB
End job on node120 at 2011-05-16 22:59:47