Trace number 3249902

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.19 1201.76

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/crn_20_361_s.cnf
MD5SUM6e5ac2b9425e98989eedf4cf638bde54
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark170.249
Satisfiable
(Un)Satisfiability was proved
Number of variables7942
Number of clauses14991
Sum of the clauses size44382
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2591
Number of clauses of size 314400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249902-1304089718/watcher-3249902-1304089718 -o /tmp/evaluation-result-3249902-1304089718/solver-3249902-1304089718 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3249902-1304089718.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.58 5.53 6.90 5/180 1469
/proc/meminfo: memFree=30882280/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=19608 CPUtime=0 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 625 0 0 0 0 0 0 0 25 0 1 0 501387683 20078592 562 33554432000 4194304 4623224 140733320056976 18446744073709551615 4388779 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/1469/statm: 4902 562 296 105 0 406 0

[startup+0.0154209 s]
/proc/loadavg: 4.58 5.53 6.90 5/180 1469
/proc/meminfo: memFree=30882280/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=55384 CPUtime=0.01 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 2115 0 0 0 1 0 0 0 25 0 4 0 501387683 56713216 1743 33554432000 4194304 4623224 140733320056976 18446744073709551615 47460919068584 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 13846 1743 302 105 0 9350 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 55384

[startup+0.100381 s]
/proc/loadavg: 4.58 5.53 6.90 5/180 1469
/proc/meminfo: memFree=30882280/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=271676 CPUtime=0.35 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 14097 0 0 0 33 2 0 0 25 0 4 0 501387683 278196224 6848 33554432000 4194304 4623224 140733320056976 18446744073709551615 4360117 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 67919 6848 342 105 0 63423 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 271676

[startup+0.300341 s]
/proc/loadavg: 4.58 5.53 6.90 5/180 1469
/proc/meminfo: memFree=30882280/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=273036 CPUtime=1.15 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 16752 0 0 0 113 2 0 0 25 0 4 0 501387683 279588864 7394 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 68259 7394 344 105 0 63763 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 273036

[startup+0.700267 s]
/proc/loadavg: 4.58 5.53 6.90 5/180 1469
/proc/meminfo: memFree=30882280/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=276412 CPUtime=2.74 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 22256 0 0 0 271 3 0 0 25 0 4 0 501387683 283045888 8828 33554432000 4194304 4623224 140733320056976 18446744073709551615 4414846 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 69103 8828 344 105 0 64607 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 276412

[startup+1.50112 s]
/proc/loadavg: 4.58 5.53 6.90 9/184 1473
/proc/meminfo: memFree=30842204/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=285100 CPUtime=5.94 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 31502 0 0 0 590 4 0 0 25 0 4 0 501387683 291942400 11078 33554432000 4194304 4623224 140733320056976 18446744073709551615 4517450 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 71275 11078 344 105 0 66779 0
[pid=1469/tid=1471] ppid=1467 vsize=285100 CPUtime=1.47 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 5030 0 0 0 146 1 0 0 25 0 4 0 501387684 291942400 11078 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=285100 CPUtime=1.47 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 4925 0 0 0 147 0 0 0 25 0 4 0 501387684 291942400 11078 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=285100 CPUtime=1.47 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 12679 0 0 0 146 1 0 0 25 0 4 0 501387684 291942400 11078 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 285100

[startup+3.10083 s]
/proc/loadavg: 4.58 5.53 6.90 9/184 1473
/proc/meminfo: memFree=30826596/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=295656 CPUtime=12.33 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 55099 0 0 0 1225 8 0 0 25 0 4 0 501387683 302751744 14835 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 73914 14836 344 105 0 69418 0
[pid=1469/tid=1471] ppid=1467 vsize=295656 CPUtime=3.06 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 7227 0 0 0 305 1 0 0 25 0 4 0 501387684 302751744 14837 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=295656 CPUtime=3.08 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 7723 0 0 0 307 1 0 0 25 0 4 0 501387684 302751744 14837 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=295656 CPUtime=3.08 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 29581 0 0 0 304 4 0 0 25 0 4 0 501387684 302751744 14838 33554432000 4194304 4623224 140733320056976 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 295656

[startup+6.30023 s]
/proc/loadavg: 4.86 5.58 6.90 9/184 1473
/proc/meminfo: memFree=30801160/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=301288 CPUtime=25.12 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 101671 0 0 0 2496 16 0 0 25 0 4 0 501387683 308518912 19705 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 75322 19705 344 105 0 70826 0
[pid=1469/tid=1471] ppid=1467 vsize=301288 CPUtime=6.24 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 8529 0 0 0 623 1 0 0 25 0 4 0 501387684 308518912 19705 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=301288 CPUtime=6.27 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 11969 0 0 0 625 2 0 0 25 0 4 0 501387684 308518912 19705 33554432000 4194304 4623224 140733320056976 18446744073709551615 4357896 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=301288 CPUtime=6.28 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 66968 0 0 0 619 9 0 0 25 0 4 0 501387684 308518912 19705 33554432000 4194304 4623224 140733320056976 18446744073709551615 4550473 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 301288

[startup+12.7011 s]
/proc/loadavg: 5.11 5.62 6.91 9/184 1473
/proc/meminfo: memFree=30752560/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=323560 CPUtime=50.68 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 141346 0 0 0 5046 22 0 0 25 0 4 0 501387683 331325440 28616 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 80890 28616 370 105 0 76394 0
[pid=1469/tid=1471] ppid=1467 vsize=323560 CPUtime=12.61 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 12074 0 0 0 1259 2 0 0 25 0 4 0 501387684 331325440 28616 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=323560 CPUtime=12.67 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 17365 0 0 0 1264 3 0 0 25 0 4 0 501387684 331325440 28616 33554432000 4194304 4623224 140733320056976 18446744073709551615 4377018 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=323560 CPUtime=12.68 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 91445 0 0 0 1256 12 0 0 25 0 4 0 501387684 331325440 28616 33554432000 4194304 4623224 140733320056976 18446744073709551615 4550541 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 323560

[startup+25.5007 s]
/proc/loadavg: 5.75 5.73 6.93 9/184 1474
/proc/meminfo: memFree=30680156/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=345992 CPUtime=101.81 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 247872 0 0 0 10141 40 0 0 25 0 4 0 501387683 354295808 42104 33554432000 4194304 4623224 140733320056976 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 86498 42104 395 105 0 82002 0
[pid=1469/tid=1471] ppid=1467 vsize=345992 CPUtime=25.34 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 18854 0 0 0 2530 4 0 0 25 0 4 0 501387684 354295808 42104 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=345992 CPUtime=25.47 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 19784 0 0 0 2543 4 0 0 25 0 4 0 501387684 354295808 42104 33554432000 4194304 4623224 140733320056976 18446744073709551615 4463644 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=345992 CPUtime=25.48 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 180364 0 0 0 2522 26 0 0 25 0 4 0 501387684 354295808 42104 33554432000 4194304 4623224 140733320056976 18446744073709551615 4550481 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 345992

[startup+51.101 s]
/proc/loadavg: 6.52 5.91 6.95 10/184 1534
/proc/meminfo: memFree=30660040/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=404080 CPUtime=204.06 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 455400 0 0 0 20333 73 0 0 25 0 4 0 501387683 413777920 53766 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 101020 53766 388 105 0 96524 0
[pid=1469/tid=1471] ppid=1467 vsize=404080 CPUtime=50.79 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 27209 0 0 0 5074 5 0 0 25 0 4 0 501387684 413777920 53766 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=404080 CPUtime=51.07 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 28345 0 0 0 5102 5 0 0 25 0 4 0 501387684 413777920 53766 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=404080 CPUtime=51.08 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 359956 0 0 0 5054 54 0 0 25 0 4 0 501387684 413777920 53766 33554432000 4194304 4623224 140733320056976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 404080

[startup+102.307 s]
/proc/loadavg: 7.47 6.26 7.02 10/184 1536
/proc/meminfo: memFree=30471764/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=495664 CPUtime=408.6 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 1074908 0 0 0 40692 168 0 0 25 0 4 0 501387683 507559936 82959 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 123916 82959 607 105 0 119420 0
[pid=1469/tid=1471] ppid=1467 vsize=495664 CPUtime=101.72 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 40432 0 0 0 10163 9 0 0 25 0 4 0 501387684 507559936 82959 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=495664 CPUtime=102.28 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 44957 0 0 0 10218 10 0 0 25 0 4 0 501387684 507559936 82959 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376697 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=495664 CPUtime=102.28 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 931434 0 0 0 10089 139 0 0 25 0 4 0 501387684 507559936 82959 33554432000 4194304 4623224 140733320056976 18446744073709551615 4364035 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.6
Current children cumulated vsize (KiB) 495664

[startup+162.3 s]
/proc/loadavg: 7.98 6.62 7.09 9/184 1567
/proc/meminfo: memFree=30382056/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=587504 CPUtime=648.26 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 1243683 0 0 0 64630 196 0 0 25 0 4 0 501387683 601604096 108626 33554432000 4194304 4623224 140733320056976 18446744073709551615 220815893041 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 146876 108627 1117 105 0 142380 0
[pid=1469/tid=1471] ppid=1467 vsize=587504 CPUtime=161.39 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 43259 0 0 0 16129 10 0 0 25 0 4 0 501387684 601604096 108627 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=587504 CPUtime=162.27 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 60038 0 0 0 16214 13 0 0 25 0 4 0 501387684 601604096 108629 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=587504 CPUtime=162.28 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 1053656 0 0 0 16071 157 0 0 25 0 4 0 501387684 601604096 108629 33554432000 4194304 4623224 140733320056976 18446744073709551615 4577678 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.26
Current children cumulated vsize (KiB) 587504

[startup+222.3 s]
/proc/loadavg: 8.13 6.92 7.16 9/184 1599
/proc/meminfo: memFree=30029164/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=676500 CPUtime=887.93 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 1884111 0 0 0 88506 287 0 0 25 0 4 0 501387683 692736000 122519 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510098 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 169125 122519 1020 105 0 164629 0
[pid=1469/tid=1471] ppid=1467 vsize=676500 CPUtime=221.07 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 58911 0 0 0 22094 13 0 0 25 0 4 0 501387684 692736000 122519 33554432000 4194304 4623224 140733320056976 18446744073709551615 4366446 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=676500 CPUtime=222.27 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 62921 0 0 0 22213 14 0 0 25 0 4 0 501387684 692736000 122519 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=676500 CPUtime=222.28 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 1669987 0 0 0 21985 243 0 0 25 0 4 0 501387684 692736000 122519 33554432000 4194304 4623224 140733320056976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.93
Current children cumulated vsize (KiB) 676500

[startup+282.3 s]

################
# More data... #
################

[pid=1469] ppid=1467 vsize=1244624 CPUtime=2805.31 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 5398830 0 0 0 279730 801 0 0 25 0 4 0 501387683 1274494976 223667 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 311156 223667 345 105 0 306660 0
[pid=1469/tid=1471] ppid=1467 vsize=1244624 CPUtime=698.45 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 94777 0 0 0 69823 22 0 0 25 0 4 0 501387684 1274494976 223667 33554432000 4194304 4623224 140733320056976 18446744073709551615 4485126 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1244624 CPUtime=702.28 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 131173 0 0 0 70202 26 0 0 25 0 4 0 501387684 1274494976 223667 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1244624 CPUtime=702.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 4976045 0 0 0 69511 718 0 0 25 0 4 0 501387684 1274494976 223667 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.31
Current children cumulated vsize (KiB) 1244624

[startup+762.307 s]
/proc/loadavg: 8.11 7.87 7.54 9/184 1613
/proc/meminfo: memFree=28593708/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1249888 CPUtime=3045.01 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 5820860 0 0 0 303638 863 0 0 25 0 4 0 501387683 1279885312 230551 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 312472 230551 345 105 0 307976 0
[pid=1469/tid=1471] ppid=1467 vsize=1249888 CPUtime=758.13 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 96718 0 0 0 75790 23 0 0 25 0 4 0 501387684 1279885312 230551 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1249888 CPUtime=762.29 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 133024 0 0 0 76203 26 0 0 25 0 4 0 501387684 1279885312 230551 33554432000 4194304 4623224 140733320056976 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1249888 CPUtime=762.3 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 5391091 0 0 0 75453 777 0 0 25 0 4 0 501387684 1279885312 230551 33554432000 4194304 4623224 140733320056976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3045.01
Current children cumulated vsize (KiB) 1249888

[startup+822.301 s]
/proc/loadavg: 8.04 7.89 7.57 9/184 1615
/proc/meminfo: memFree=28466336/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1314888 CPUtime=3284.67 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 6027238 0 0 0 327574 893 0 0 25 0 4 0 501387683 1346445312 247632 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 328722 247632 345 105 0 324226 0
[pid=1469/tid=1471] ppid=1467 vsize=1314888 CPUtime=817.8 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 126751 0 0 0 81752 28 0 0 25 0 4 0 501387684 1346445312 247632 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1314888 CPUtime=822.28 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 135780 0 0 0 82201 27 0 0 25 0 4 0 501387684 1346445312 247632 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1314888 CPUtime=822.28 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 5560994 0 0 0 81429 799 0 0 25 0 4 0 501387684 1346445312 247632 33554432000 4194304 4623224 140733320056976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.67
Current children cumulated vsize (KiB) 1314888

[startup+882.301 s]
/proc/loadavg: 8.01 7.90 7.59 9/184 1616
/proc/meminfo: memFree=28361400/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1328052 CPUtime=3524.34 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 6092238 0 0 0 351528 906 0 0 25 0 4 0 501387683 1359925248 253903 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 332013 253903 345 105 0 327517 0
[pid=1469/tid=1471] ppid=1467 vsize=1328052 CPUtime=877.47 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 129528 0 0 0 87718 29 0 0 25 0 4 0 501387684 1359925248 253903 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1328052 CPUtime=882.29 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 137009 0 0 0 88201 28 0 0 25 0 4 0 501387684 1359925248 253903 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1328052 CPUtime=882.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 5619883 0 0 0 87420 809 0 0 25 0 4 0 501387684 1359925248 253903 33554432000 4194304 4623224 140733320056976 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.34
Current children cumulated vsize (KiB) 1328052

[startup+942.301 s]
/proc/loadavg: 8.00 7.92 7.61 9/184 1618
/proc/meminfo: memFree=28257336/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1330428 CPUtime=3764.02 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 6822003 0 0 0 375392 1010 0 0 25 0 4 0 501387683 1362358272 263139 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 332607 263139 345 105 0 328111 0
[pid=1469/tid=1471] ppid=1467 vsize=1330428 CPUtime=937.15 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 130761 0 0 0 93685 30 0 0 25 0 4 0 501387684 1362358272 263139 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1330428 CPUtime=942.28 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 139763 0 0 0 94199 29 0 0 25 0 4 0 501387684 1362358272 263139 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1330428 CPUtime=942.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 6343237 0 0 0 93319 910 0 0 25 0 4 0 501387684 1362358272 263139 33554432000 4194304 4623224 140733320056976 18446744073709551615 4545903 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.02
Current children cumulated vsize (KiB) 1330428

[startup+1002.3 s]
/proc/loadavg: 8.29 8.00 7.66 10/185 1623
/proc/meminfo: memFree=28108776/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1347284 CPUtime=4003.7 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 7363323 0 0 0 399281 1089 0 0 25 0 4 0 501387683 1379618816 277115 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 336821 277115 345 105 0 332325 0
[pid=1469/tid=1471] ppid=1467 vsize=1347284 CPUtime=996.82 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 132849 0 0 0 99651 31 0 0 25 0 4 0 501387684 1379618816 277115 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1347284 CPUtime=1002.28 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 140744 0 0 0 100199 29 0 0 25 0 4 0 501387684 1379618816 277115 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1347284 CPUtime=1002.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 6878542 0 0 0 99243 986 0 0 25 0 4 0 501387684 1379618816 277115 33554432000 4194304 4623224 140733320056976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.7
Current children cumulated vsize (KiB) 1347284

[startup+1062.3 s]
/proc/loadavg: 8.18 8.02 7.69 9/184 1624
/proc/meminfo: memFree=28019564/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1413412 CPUtime=4243.38 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 8105167 0 0 0 423150 1188 0 0 25 0 4 0 501387683 1447333888 290450 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 353353 290450 346 105 0 348857 0
[pid=1469/tid=1471] ppid=1467 vsize=1413412 CPUtime=1056.49 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 134174 0 0 0 105618 31 0 0 25 0 4 0 501387684 1447333888 290450 33554432000 4194304 4623224 140733320056976 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1413412 CPUtime=1062.29 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 141832 0 0 0 106199 30 0 0 25 0 4 0 501387684 1447333888 290450 33554432000 4194304 4623224 140733320056976 18446744073709551615 4464977 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1413412 CPUtime=1062.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 7614745 0 0 0 105146 1083 0 0 25 0 4 0 501387684 1447333888 290450 33554432000 4194304 4623224 140733320056976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.38
Current children cumulated vsize (KiB) 1413412

[startup+1122.3 s]
/proc/loadavg: 8.07 8.02 7.70 9/184 1626
/proc/meminfo: memFree=27973148/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1492576 CPUtime=4483.05 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 8959517 0 0 0 447001 1304 0 0 25 0 4 0 501387683 1528397824 299364 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1469/statm: 373144 299364 347 105 0 368648 0
[pid=1469/tid=1471] ppid=1467 vsize=1492576 CPUtime=1116.17 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 136387 0 0 0 111583 34 0 0 25 0 4 0 501387684 1528397824 299364 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1492576 CPUtime=1122.29 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 142695 0 0 0 112199 30 0 0 25 0 4 0 501387684 1528397824 299364 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1492576 CPUtime=1122.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 8423484 0 0 0 111038 1191 0 0 25 0 4 0 501387684 1528397824 299364 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 1492576

[startup+1182.3 s]
/proc/loadavg: 8.02 8.01 7.72 9/184 1627
/proc/meminfo: memFree=27836712/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1492576 CPUtime=4722.6 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 9572448 0 0 0 470866 1394 0 0 25 0 4 0 501387683 1528397824 308529 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1469/statm: 373144 308529 350 105 0 368648 0
[pid=1469/tid=1471] ppid=1467 vsize=1492576 CPUtime=1175.88 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 138550 0 0 0 117553 35 0 0 25 0 4 0 501387684 1528397824 308529 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1492576 CPUtime=1182.29 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 143731 0 0 0 118198 31 0 0 25 0 4 0 501387684 1528397824 308529 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1492576 CPUtime=1182.29 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 9031629 0 0 0 116951 1278 0 0 25 0 4 0 501387684 1528397824 308529 33554432000 4194304 4623224 140733320056976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.6
Current children cumulated vsize (KiB) 1492576



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.02 8.01 7.73 9/184 1628
/proc/meminfo: memFree=27837936/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1492576 CPUtime=4800.1 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 9787694 0 0 0 478583 1427 0 0 25 0 4 0 501387683 1528397824 310000 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1469/statm: 373144 310000 356 105 0 368648 0
[pid=1469/tid=1471] ppid=1467 vsize=1492576 CPUtime=1195.3 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 138848 0 0 0 119494 36 0 0 25 0 4 0 501387684 1528397824 310001 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1492576 CPUtime=1201.69 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 144145 0 0 0 120138 31 0 0 25 0 4 0 501387684 1528397824 310001 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1492576 CPUtime=1201.69 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 9246149 0 0 0 118859 1310 0 0 25 0 4 0 501387684 1528397824 310001 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 1492576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.02 8.01 7.73 9/184 1628
/proc/meminfo: memFree=27837936/32951124 swapFree=67105204/67111528
[pid=1469] ppid=1467 vsize=1492576 CPUtime=4800.1 cores=1,3,5,7
/proc/1469/stat : 1469 (SArTagnan) R 1467 1469 32751 0 -1 4202496 9787694 0 0 0 478583 1427 0 0 25 0 4 0 501387683 1528397824 310000 33554432000 4194304 4623224 140733320056976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1469/statm: 373144 310000 356 105 0 368648 0
[pid=1469/tid=1471] ppid=1467 vsize=1492576 CPUtime=1195.3 cores=1,3,5,7
/proc/1469/task/1471/stat : 1471 (SArTagnan) R 1467 1469 32751 0 -1 4202560 138848 0 0 0 119494 36 0 0 25 0 4 0 501387684 1528397824 310001 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1469/tid=1472] ppid=1467 vsize=1492576 CPUtime=1201.69 cores=1,3,5,7
/proc/1469/task/1472/stat : 1472 (SArTagnan) R 1467 1469 32751 0 -1 4202560 144145 0 0 0 120138 31 0 0 25 0 4 0 501387684 1528397824 310001 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1469/tid=1473] ppid=1467 vsize=1492576 CPUtime=1201.69 cores=1,3,5,7
/proc/1469/task/1473/stat : 1473 (SArTagnan) R 1467 1469 32751 0 -1 4202560 9246149 0 0 0 118859 1310 0 0 25 0 4 0 501387684 1528397824 310001 33554432000 4194304 4623224 140733320056976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 1492576

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.76
CPU time (s): 4800.19
CPU user time (s): 4785.87
CPU system time (s): 14.3248
CPU usage (%): 399.43
Max. virtual memory (cumulated for all children) (KiB): 1650792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4785.87
system time used= 14.3248
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9787700
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1196
involuntary context switches= 29949

runsolver used 1.9657 second user time and 4.5973 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 17:08:38
IDJOB=3249902
IDBENCH=83194
IDSOLVER=1656
FILE ID=node147/3249902-1304089718
RUNJOBID= node147-1304089710-1417
PBS_JOBID= 13170522
Free space on /tmp= 72660 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_20_361_s.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249902-1304089718/watcher-3249902-1304089718 -o /tmp/evaluation-result-3249902-1304089718/solver-3249902-1304089718 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3249902-1304089718.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6e5ac2b9425e98989eedf4cf638bde54
RANDOM SEED=1737699864

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30882560 kB
Buffers:        272192 kB
Cached:        1364576 kB
SwapCached:       2936 kB
Active:         172088 kB
Inactive:      1573124 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30882560 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:            1336 kB
Writeback:           0 kB
AnonPages:      105992 kB
Mapped:          15296 kB
Slab:           260692 kB
PageTables:       5076 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   291908 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node147 at 2011-04-29 17:28:42