Trace number 3284023

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.3 1201.99

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_19_UNKNOWN.cnf
MD5SUM4cf2a693df1b6e5a084b88e84ec5f2af
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark14.5608
Satisfiable
(Un)Satisfiability was proved
Number of variables4020
Number of clauses466486
Sum of the clauses size1393798
Maximum clause length20
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 26187
Number of clauses of size 3460268
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3284023-1304050212/watcher-3284023-1304050212 -o /tmp/evaluation-result-3284023-1304050212/solver-3284023-1304050212 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3284023-1304050212.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.05 7.45 6/180 21653
/proc/meminfo: memFree=21680436/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=30188 CPUtime=0 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 631 0 0 0 0 0 0 0 22 0 1 0 516618285 30912512 568 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476694784 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21653/statm: 7547 569 297 105 0 3051 0

[startup+0.04113 s]
/proc/loadavg: 8.12 8.05 7.45 6/180 21653
/proc/meminfo: memFree=21680436/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=36360 CPUtime=0.03 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 4067 0 0 0 3 0 0 0 22 0 1 0 516618285 37232640 2395 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476694784 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21653/statm: 9090 2400 297 105 0 4594 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 36360

[startup+0.101122 s]
/proc/loadavg: 8.12 8.05 7.45 6/180 21653
/proc/meminfo: memFree=21680436/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=46768 CPUtime=0.09 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 10180 0 0 0 8 1 0 0 22 0 1 0 516618285 47890432 5381 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476355781 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21653/statm: 11692 5382 297 105 0 7196 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 46768

[startup+0.301006 s]
/proc/loadavg: 8.12 8.05 7.45 6/180 21653
/proc/meminfo: memFree=21680436/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=360052 CPUtime=0.39 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 38790 0 0 0 35 4 0 0 24 0 4 0 516618285 368693248 27753 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476350933 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 90013 27753 462 105 0 85517 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 360052

[startup+0.70093 s]
/proc/loadavg: 8.12 8.05 7.45 6/180 21653
/proc/meminfo: memFree=21680436/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=426056 CPUtime=1.99 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 60574 0 0 0 192 7 0 0 25 0 4 0 516618285 436281344 35892 33554432000 4194304 4623224 140735723489824 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 106514 35892 340 105 0 102018 0
Current children cumulated CPU time (s) 1.99
Current children cumulated vsize (KiB) 426056

[startup+1.50078 s]
/proc/loadavg: 7.87 8.00 7.44 9/184 21657
/proc/meminfo: memFree=21531984/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=426056 CPUtime=5.19 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 83738 0 0 0 508 11 0 0 25 0 4 0 516618285 436281344 38427 33554432000 4194304 4623224 140735723489824 18446744073709551615 4511646 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 106514 38427 340 105 0 102018 0
[pid=21653/tid=21655] ppid=21651 vsize=426056 CPUtime=1.22 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 5203 0 0 0 122 0 0 0 25 0 4 0 516618312 436281344 38427 33554432000 4194304 4623224 140735723489824 18446744073709551615 4463039 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=426056 CPUtime=1.22 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 6117 0 0 0 121 1 0 0 25 0 4 0 516618312 436281344 38427 33554432000 4194304 4623224 140735723489824 18446744073709551615 4365976 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=426056 CPUtime=1.22 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 31679 0 0 0 118 4 0 0 25 0 4 0 516618312 436281344 38427 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476362202 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.19
Current children cumulated vsize (KiB) 426056

[startup+3.10047 s]
/proc/loadavg: 7.87 8.00 7.44 9/184 21657
/proc/meminfo: memFree=21521072/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=426056 CPUtime=11.58 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 111915 0 0 0 1143 15 0 0 25 0 4 0 516618285 436281344 41349 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510327 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 106514 41350 340 105 0 102018 0
[pid=21653/tid=21655] ppid=21651 vsize=426056 CPUtime=2.82 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 5559 0 0 0 282 0 0 0 25 0 4 0 516618312 436281344 41350 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476350305 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=426056 CPUtime=2.81 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 8040 0 0 0 279 2 0 0 25 0 4 0 516618312 436281344 41350 33554432000 4194304 4623224 140735723489824 18446744073709551615 4466124 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=426056 CPUtime=2.83 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 57467 0 0 0 276 7 0 0 25 0 4 0 516618312 436281344 41350 33554432000 4194304 4623224 140735723489824 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.58
Current children cumulated vsize (KiB) 426056

[startup+6.30086 s]
/proc/loadavg: 7.88 8.00 7.44 9/184 21657
/proc/meminfo: memFree=21496768/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=434684 CPUtime=24.36 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 170543 0 0 0 2412 24 0 0 25 0 4 0 516618285 445116416 45769 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 108671 45769 340 105 0 104175 0
[pid=21653/tid=21655] ppid=21651 vsize=434684 CPUtime=6.02 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 10633 0 0 0 601 1 0 0 25 0 4 0 516618312 445116416 45769 33554432000 4194304 4623224 140735723489824 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=434684 CPUtime=5.99 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 11635 0 0 0 595 4 0 0 25 0 4 0 516618312 445116416 45769 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=434684 CPUtime=6.02 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 107373 0 0 0 590 12 0 0 25 0 4 0 516618312 445116416 45769 33554432000 4194304 4623224 140735723489824 18446744073709551615 4364003 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.36
Current children cumulated vsize (KiB) 434684

[startup+12.7006 s]
/proc/loadavg: 7.89 8.00 7.45 9/184 21658
/proc/meminfo: memFree=21445460/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=458432 CPUtime=49.91 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 275241 0 0 0 4948 43 0 0 25 0 4 0 516618285 469434368 57886 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510262 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 114608 57886 340 105 0 110112 0
[pid=21653/tid=21655] ppid=21651 vsize=458432 CPUtime=12.42 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 14108 0 0 0 1238 4 0 0 25 0 4 0 516618312 469434368 57886 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=458432 CPUtime=12.36 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 22409 0 0 0 1228 8 0 0 25 0 4 0 516618312 469434368 57886 33554432000 4194304 4623224 140735723489824 18446744073709551615 4468477 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=458432 CPUtime=12.42 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 197647 0 0 0 1216 26 0 0 25 0 4 0 516618312 469434368 57886 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.91
Current children cumulated vsize (KiB) 458432

[startup+25.5012 s]
/proc/loadavg: 7.98 8.02 7.46 9/184 21658
/proc/meminfo: memFree=21345888/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=455552 CPUtime=101.04 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 494217 0 0 0 10022 82 0 0 25 0 4 0 516618285 466485248 80383 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 113888 80384 340 105 0 109392 0
[pid=21653/tid=21655] ppid=21651 vsize=455552 CPUtime=25.22 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 26640 0 0 0 2514 8 0 0 25 0 4 0 516618312 466485248 80384 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=455552 CPUtime=25.08 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 34700 0 0 0 2493 15 0 0 25 0 4 0 516618312 466485248 80384 33554432000 4194304 4623224 140735723489824 18446744073709551615 4466062 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=455552 CPUtime=25.22 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 391198 0 0 0 2470 52 0 0 25 0 4 0 516618312 466485248 80384 33554432000 4194304 4623224 140735723489824 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.04
Current children cumulated vsize (KiB) 455552

[startup+51.1003 s]
/proc/loadavg: 8.06 8.03 7.48 9/184 21659
/proc/meminfo: memFree=21146324/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=701596 CPUtime=203.28 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 858778 0 0 0 20175 153 0 0 25 0 4 0 516618285 718434304 123787 33554432000 4194304 4623224 140735723489824 18446744073709551615 4355947 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 175399 123787 342 105 0 170903 0
[pid=21653/tid=21655] ppid=21651 vsize=701596 CPUtime=50.82 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 39631 0 0 0 5065 17 0 0 25 0 4 0 516618312 718434304 123787 33554432000 4194304 4623224 140735723489824 18446744073709551615 4462443 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=701596 CPUtime=50.53 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 62371 0 0 0 5024 29 0 0 25 0 4 0 516618312 718434304 123787 33554432000 4194304 4623224 140735723489824 18446744073709551615 4366460 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=701596 CPUtime=50.82 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 703718 0 0 0 4982 100 0 0 25 0 4 0 516618312 718434304 123787 33554432000 4194304 4623224 140735723489824 18446744073709551615 4363928 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.28
Current children cumulated vsize (KiB) 701596

[startup+102.306 s]
/proc/loadavg: 8.03 8.02 7.50 9/184 21660
/proc/meminfo: memFree=20812268/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1023368 CPUtime=407.78 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 1674909 0 0 0 40474 304 0 0 25 0 4 0 516618285 1047928832 194502 33554432000 4194304 4623224 140735723489824 18446744073709551615 4359009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 255842 194502 532 105 0 251346 0
[pid=21653/tid=21655] ppid=21651 vsize=1023368 CPUtime=102 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 82960 0 0 0 10157 43 0 0 25 0 4 0 516618312 1047928832 194502 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476350916 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1023368 CPUtime=101.44 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 99233 0 0 0 10096 48 0 0 25 0 4 0 516618312 1047928832 194502 33554432000 4194304 4623224 140735723489824 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1023368 CPUtime=102 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 1435216 0 0 0 9996 204 0 0 25 0 4 0 516618312 1047928832 194502 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476362242 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.78
Current children cumulated vsize (KiB) 1023368

[startup+162.301 s]
/proc/loadavg: 8.01 8.02 7.53 9/184 21662
/proc/meminfo: memFree=20587584/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1155520 CPUtime=647.41 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 2497161 0 0 0 64293 448 0 0 25 0 4 0 516618285 1183252480 235263 33554432000 4194304 4623224 140735723489824 18446744073709551615 4384347 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 288880 235263 895 105 0 284384 0
[pid=21653/tid=21655] ppid=21651 vsize=1155520 CPUtime=162.01 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 87184 0 0 0 16155 46 0 0 25 0 4 0 516618312 1183252480 235263 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1155520 CPUtime=161.1 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 138559 0 0 0 16032 78 0 0 25 0 4 0 516618312 1183252480 235264 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1155520 CPUtime=161.99 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 2205084 0 0 0 15885 314 0 0 25 0 4 0 516618312 1183252480 235264 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 647.41
Current children cumulated vsize (KiB) 1155520

[startup+222.3 s]
/proc/loadavg: 8.11 8.04 7.57 9/184 21663
/proc/meminfo: memFree=20403688/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1356004 CPUtime=887.07 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 3177212 0 0 0 88146 561 0 0 25 0 4 0 516618285 1388548096 270933 33554432000 4194304 4623224 140735723489824 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 339001 270933 346 105 0 334505 0
[pid=21653/tid=21655] ppid=21651 vsize=1356004 CPUtime=222.01 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 110706 0 0 0 22145 56 0 0 25 0 4 0 516618312 1388548096 270933 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1356004 CPUtime=220.77 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 151367 0 0 0 21991 86 0 0 25 0 4 0 516618312 1388548096 270933 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1356004 CPUtime=221.99 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 2833508 0 0 0 21792 407 0 0 25 0 4 0 516618312 1388548096 270933 33554432000 4194304 4623224 140735723489824 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.07
Current children cumulated vsize (KiB) 1356004

[startup+282.301 s]

################
# More data... #
################

[pid=21653] ppid=21651 vsize=1740484 CPUtime=2804.48 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 6646755 0 0 0 279264 1184 0 0 25 0 4 0 516618285 1782255616 368241 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 435121 368241 345 105 0 430625 0
[pid=21653/tid=21655] ppid=21651 vsize=1740484 CPUtime=702.02 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158209 0 0 0 70127 75 0 0 25 0 4 0 516618312 1782255616 368241 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1740484 CPUtime=698.17 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 155735 0 0 0 69731 86 0 0 25 0 4 0 516618312 1782255616 368241 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1740484 CPUtime=702 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 6102103 0 0 0 69222 978 0 0 25 0 4 0 516618312 1782255616 368241 33554432000 4194304 4623224 140735723489824 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2804.48
Current children cumulated vsize (KiB) 1740484

[startup+762.307 s]
/proc/loadavg: 8.02 8.04 7.77 9/184 21709
/proc/meminfo: memFree=20760764/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1769460 CPUtime=3044.17 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 7243904 0 0 0 303126 1291 0 0 25 0 4 0 516618285 1811927040 378796 33554432000 4194304 4623224 140735723489824 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 442365 378796 345 105 0 437869 0
[pid=21653/tid=21655] ppid=21651 vsize=1769460 CPUtime=762.03 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158446 0 0 0 76128 75 0 0 25 0 4 0 516618312 1811927040 378796 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1769460 CPUtime=757.85 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 155815 0 0 0 75699 86 0 0 25 0 4 0 516618312 1811927040 378796 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1769460 CPUtime=762.01 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 6670807 0 0 0 75121 1080 0 0 25 0 4 0 516618312 1811927040 378796 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3044.17
Current children cumulated vsize (KiB) 1769460

[startup+822.301 s]
/proc/loadavg: 8.01 8.03 7.78 9/184 21710
/proc/meminfo: memFree=20585928/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1865940 CPUtime=3283.83 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 7801198 0 0 0 326985 1398 0 0 25 0 4 0 516618285 1910722560 391779 33554432000 4194304 4623224 140735723489824 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 466485 391779 353 105 0 461989 0
[pid=21653/tid=21655] ppid=21651 vsize=1865940 CPUtime=822.02 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158695 0 0 0 82127 75 0 0 25 0 4 0 516618312 1910722560 391779 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1865940 CPUtime=817.53 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 155887 0 0 0 81666 87 0 0 25 0 4 0 516618312 1910722560 391779 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1865940 CPUtime=822.01 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 7171304 0 0 0 81023 1178 0 0 25 0 4 0 516618312 1910722560 391779 33554432000 4194304 4623224 140735723489824 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3283.83
Current children cumulated vsize (KiB) 1865940

[startup+882.301 s]
/proc/loadavg: 8.00 8.02 7.79 9/184 21712
/proc/meminfo: memFree=20438868/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1931476 CPUtime=3523.5 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 8565851 0 0 0 350812 1538 0 0 25 0 4 0 516618285 1977831424 395377 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510192 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 482869 395377 346 105 0 478373 0
[pid=21653/tid=21655] ppid=21651 vsize=1931476 CPUtime=882.03 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158772 0 0 0 88128 75 0 0 25 0 4 0 516618312 1977831424 395377 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1931476 CPUtime=877.2 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 155979 0 0 0 87633 87 0 0 25 0 4 0 516618312 1977831424 395377 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1931476 CPUtime=882.01 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 7931903 0 0 0 86884 1317 0 0 25 0 4 0 516618312 1977831424 395377 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3523.5
Current children cumulated vsize (KiB) 1931476

[startup+942.301 s]
/proc/loadavg: 8.00 8.02 7.81 9/184 21713
/proc/meminfo: memFree=20335568/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1931476 CPUtime=3763.18 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 9178463 0 0 0 374672 1646 0 0 25 0 4 0 516618285 1977831424 402532 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 482869 402532 345 105 0 478373 0
[pid=21653/tid=21655] ppid=21651 vsize=1931476 CPUtime=942.03 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158822 0 0 0 94128 75 0 0 25 0 4 0 516618312 1977831424 402532 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1931476 CPUtime=936.88 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156065 0 0 0 93601 87 0 0 25 0 4 0 516618312 1977831424 402532 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1931476 CPUtime=942.01 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 8537706 0 0 0 92779 1422 0 0 25 0 4 0 516618312 1977831424 402532 33554432000 4194304 4623224 140735723489824 18446744073709551615 4560307 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.18
Current children cumulated vsize (KiB) 1931476

[startup+1002.3 s]
/proc/loadavg: 8.11 8.04 7.83 9/184 21715
/proc/meminfo: memFree=20250008/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1931476 CPUtime=4002.86 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 9732736 0 0 0 398542 1744 0 0 25 0 4 0 516618285 1977831424 408578 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 482869 408578 345 105 0 478373 0
[pid=21653/tid=21655] ppid=21651 vsize=1931476 CPUtime=1002.03 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158896 0 0 0 100128 75 0 0 25 0 4 0 516618312 1977831424 408578 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486260 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1931476 CPUtime=996.55 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156174 0 0 0 99568 87 0 0 25 0 4 0 516618312 1977831424 408578 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486248 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1931476 CPUtime=1002.02 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 9082038 0 0 0 98684 1518 0 0 25 0 4 0 516618312 1977831424 408578 33554432000 4194304 4623224 140735723489824 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4002.86
Current children cumulated vsize (KiB) 1931476

[startup+1062.3 s]
/proc/loadavg: 8.16 8.06 7.84 9/184 21716
/proc/meminfo: memFree=20187008/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1960428 CPUtime=4242.52 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 10395270 0 0 0 422391 1861 0 0 25 0 4 0 516618285 2007478272 415635 33554432000 4194304 4623224 140735723489824 18446744073709551615 239476356129 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 490107 415636 353 105 0 485611 0
[pid=21653/tid=21655] ppid=21651 vsize=1960428 CPUtime=1062.03 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158947 0 0 0 106128 75 0 0 25 0 4 0 516618312 2007478272 415636 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1960428 CPUtime=1056.23 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156224 0 0 0 105536 87 0 0 25 0 4 0 516618312 2007478272 415636 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357403 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1960428 CPUtime=1062.01 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 9732059 0 0 0 104569 1632 0 0 25 0 4 0 516618312 2007478272 415636 33554432000 4194304 4623224 140735723489824 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4242.52
Current children cumulated vsize (KiB) 1960428

[startup+1122.3 s]
/proc/loadavg: 8.17 8.08 7.86 9/184 21718
/proc/meminfo: memFree=20096608/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1965168 CPUtime=4482.2 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 10858008 0 0 0 446279 1941 0 0 25 0 4 0 516618285 2012332032 419310 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 491292 419310 345 105 0 486796 0
[pid=21653/tid=21655] ppid=21651 vsize=1965168 CPUtime=1122.04 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 158997 0 0 0 112129 75 0 0 25 0 4 0 516618312 2012332032 419310 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1965168 CPUtime=1115.9 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156267 0 0 0 111503 87 0 0 25 0 4 0 516618312 2012332032 419310 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1965168 CPUtime=1122.02 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 10178009 0 0 0 110494 1708 0 0 25 0 4 0 516618312 2012332032 419310 33554432000 4194304 4623224 140735723489824 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.2
Current children cumulated vsize (KiB) 1965168

[startup+1182.3 s]
/proc/loadavg: 8.18 8.09 7.88 9/184 21720
/proc/meminfo: memFree=20040420/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1971464 CPUtime=4721.88 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 10863323 0 0 0 470246 1942 0 0 25 0 4 0 516618285 2018779136 422020 33554432000 4194304 4623224 140735723489824 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 492866 422020 345 105 0 488370 0
[pid=21653/tid=21655] ppid=21651 vsize=1971464 CPUtime=1182.05 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 159044 0 0 0 118129 76 0 0 25 0 4 0 516618312 2018779136 422020 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1971464 CPUtime=1175.58 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156309 0 0 0 117471 87 0 0 25 0 4 0 516618312 2018779136 422020 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1971464 CPUtime=1182.02 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 10180264 0 0 0 116494 1708 0 0 25 0 4 0 516618312 2018779136 422020 33554432000 4194304 4623224 140735723489824 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4721.88
Current children cumulated vsize (KiB) 1971464



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.20 8.10 7.88 9/184 21720
/proc/meminfo: memFree=20015248/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1975660 CPUtime=4800.19 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 10865458 0 0 0 478076 1943 0 0 25 0 4 0 516618285 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 493915 423503 345 105 0 489419 0
[pid=21653/tid=21655] ppid=21651 vsize=1975660 CPUtime=1201.65 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 159062 0 0 0 120089 76 0 0 25 0 4 0 516618312 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1975660 CPUtime=1195.07 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156328 0 0 0 119420 87 0 0 25 0 4 0 516618312 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1975660 CPUtime=1201.63 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 10181473 0 0 0 118454 1709 0 0 25 0 4 0 516618312 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1975660

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 8.20 8.10 7.88 9/184 21720
/proc/meminfo: memFree=20015248/32950928 swapFree=67087032/67111528
[pid=21653] ppid=21651 vsize=1975660 CPUtime=4800.19 cores=1,3,5,7
/proc/21653/stat : 21653 (SArTagnan) R 21651 21653 21387 0 -1 4202496 10865458 0 0 0 478076 1943 0 0 25 0 4 0 516618285 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/21653/statm: 493915 423503 345 105 0 489419 0
[pid=21653/tid=21655] ppid=21651 vsize=1975660 CPUtime=1201.65 cores=1,3,5,7
/proc/21653/task/21655/stat : 21655 (SArTagnan) R 21651 21653 21387 0 -1 4202560 159062 0 0 0 120089 76 0 0 25 0 4 0 516618312 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=21653/tid=21656] ppid=21651 vsize=1975660 CPUtime=1195.07 cores=1,3,5,7
/proc/21653/task/21656/stat : 21656 (SArTagnan) R 21651 21653 21387 0 -1 4202560 156328 0 0 0 119420 87 0 0 25 0 4 0 516618312 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4357576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=21653/tid=21657] ppid=21651 vsize=1975660 CPUtime=1201.63 cores=1,3,5,7
/proc/21653/task/21657/stat : 21657 (SArTagnan) R 21651 21653 21387 0 -1 4202560 10181473 0 0 0 118454 1709 0 0 25 0 4 0 516618312 2023075840 423503 33554432000 4194304 4623224 140735723489824 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1975660

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.99
CPU time (s): 4800.3
CPU user time (s): 4780.78
CPU system time (s): 19.514
CPU usage (%): 399.362
Max. virtual memory (cumulated for all children) (KiB): 2121200

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4780.78
system time used= 19.514
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10865458
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8386
involuntary context switches= 19231

runsolver used 1.86772 second user time and 4.69529 second system time

The end

Launcher Data 

Begin job on node148 at 2011-04-29 06:10:12
IDJOB=3284023
IDBENCH=71095
IDSOLVER=1656
FILE ID=node148/3284023-1304050212
RUNJOBID= node148-1304049005-21406
PBS_JOBID= 13170411
Free space on /tmp= 71424 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_19_UNKNOWN.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3284023-1304050212/watcher-3284023-1304050212 -o /tmp/evaluation-result-3284023-1304050212/solver-3284023-1304050212 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3284023-1304050212.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4cf2a693df1b6e5a084b88e84ec5f2af
RANDOM SEED=2011258204

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      21680840 kB
Buffers:       2016900 kB
Cached:        7716184 kB
SwapCached:       3548 kB
Active:        2672112 kB
Inactive:      8034724 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      21680840 kB
SwapTotal:    67111528 kB
SwapFree:     67087032 kB
Dirty:            8296 kB
Writeback:           0 kB
AnonPages:      972116 kB
Mapped:          14468 kB
Slab:           498480 kB
PageTables:       6516 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1323932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71424 MiB
End job on node148 at 2011-04-29 06:30:16