Trace number 3251486

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.19 1201.79

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m42-q663-n40-p15-s72490337.cnf
MD5SUMab8e40d31c79e7a71114e3126a46874f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.38479
Satisfiable
(Un)Satisfiability was proved
Number of variables1649
Number of clauses256038
Sum of the clauses size513645
Maximum clause length42
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2255998
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251486-1304123677/watcher-3251486-1304123677 -o /tmp/evaluation-result-3251486-1304123677/solver-3251486-1304123677 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3251486-1304123677.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.43 4.51 6.13 6/180 22696
/proc/meminfo: memFree=30579040/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=24952 CPUtime=0 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 639 0 0 0 0 0 0 0 22 0 1 0 523970116 25550848 483 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/22696/statm: 6238 483 297 105 0 1742 0

[startup+0.0647279 s]
/proc/loadavg: 3.43 4.51 6.13 6/180 22696
/proc/meminfo: memFree=30579040/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=68764 CPUtime=0.05 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 5321 0 0 0 5 0 0 0 22 0 4 0 523970116 70414336 3669 33554432000 4194304 4623224 140733224161392 18446744073709551615 47742697232306 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 17191 3669 302 105 0 12695 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 68764

[startup+0.100683 s]
/proc/loadavg: 3.43 4.51 6.13 6/180 22696
/proc/meminfo: memFree=30579040/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=205584 CPUtime=0.19 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 8105 0 0 0 18 1 0 0 24 0 4 0 523970116 210518016 5883 33554432000 4194304 4623224 140733224161392 18446744073709551615 4354590 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 51396 5883 335 105 0 46900 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 205584

[startup+0.300647 s]
/proc/loadavg: 3.43 4.51 6.13 6/180 22696
/proc/meminfo: memFree=30579040/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=278016 CPUtime=0.99 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 13240 0 0 0 97 2 0 0 25 0 4 0 523970116 284688384 8871 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510627 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 69504 8871 346 105 0 65008 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 278016

[startup+0.70057 s]
/proc/loadavg: 3.43 4.51 6.13 6/180 22696
/proc/meminfo: memFree=30579040/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=279256 CPUtime=2.59 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 16936 0 0 0 256 3 0 0 25 0 4 0 523970116 285958144 12564 33554432000 4194304 4623224 140733224161392 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 69814 12564 344 105 0 65318 0
Current children cumulated CPU time (s) 2.59
Current children cumulated vsize (KiB) 279256

[startup+1.50042 s]
/proc/loadavg: 3.43 4.51 6.13 10/184 22700
/proc/meminfo: memFree=30485396/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=284776 CPUtime=5.79 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 24579 0 0 0 574 5 0 0 25 0 4 0 523970116 291610624 17195 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510077 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 71194 17195 344 105 0 66698 0
[pid=22696/tid=22698] ppid=22694 vsize=284776 CPUtime=1.43 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 3273 0 0 0 142 1 0 0 25 0 4 0 523970122 291610624 17195 33554432000 4194304 4623224 140733224161392 18446744073709551615 4467820 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=284776 CPUtime=1.42 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 4637 0 0 0 141 1 0 0 25 0 4 0 523970122 291610624 17195 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=284776 CPUtime=1.43 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 2367 0 0 0 143 0 0 0 25 0 4 0 523970122 291610624 17195 33554432000 4194304 4623224 140733224161392 18446744073709551615 4559140 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 284776

[startup+3.10112 s]
/proc/loadavg: 3.43 4.51 6.13 10/184 22700
/proc/meminfo: memFree=30443980/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=284776 CPUtime=12.18 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 36880 0 0 0 1210 8 0 0 25 0 4 0 523970116 291610624 25821 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510621 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 71194 25821 386 105 0 66698 0
[pid=22696/tid=22698] ppid=22694 vsize=284776 CPUtime=3.02 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 6494 0 0 0 301 1 0 0 25 0 4 0 523970122 291610624 25821 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=284776 CPUtime=3.02 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 8167 0 0 0 300 2 0 0 25 0 4 0 523970122 291610624 25821 33554432000 4194304 4623224 140733224161392 18446744073709551615 4377466 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=284776 CPUtime=3.02 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 7466 0 0 0 301 1 0 0 25 0 4 0 523970122 291610624 25821 33554432000 4194304 4623224 140733224161392 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.18
Current children cumulated vsize (KiB) 284776

[startup+6.30051 s]
/proc/loadavg: 3.87 4.59 6.15 10/184 22700
/proc/meminfo: memFree=30359704/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=307452 CPUtime=24.96 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 49723 0 0 0 2484 12 0 0 25 0 4 0 523970116 314830848 35175 33554432000 4194304 4623224 140733224161392 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 76863 35175 463 105 0 72367 0
[pid=22696/tid=22698] ppid=22694 vsize=307452 CPUtime=6.22 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 9173 0 0 0 620 2 0 0 25 0 4 0 523970122 314830848 35178 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366665 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=307452 CPUtime=6.19 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 12445 0 0 0 616 3 0 0 25 0 4 0 523970122 314830848 35178 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=307452 CPUtime=6.23 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 12088 0 0 0 620 3 0 0 25 0 4 0 523970122 314830848 35179 33554432000 4194304 4623224 140733224161392 18446744073709551615 4364012 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.96
Current children cumulated vsize (KiB) 307452

[startup+12.7003 s]
/proc/loadavg: 4.20 4.64 6.16 9/184 22700
/proc/meminfo: memFree=30255844/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=330888 CPUtime=50.52 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 74224 0 0 0 5035 17 0 0 25 0 4 0 523970116 338829312 43921 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 82722 43921 403 105 0 78226 0
[pid=22696/tid=22698] ppid=22694 vsize=330888 CPUtime=12.62 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 14639 0 0 0 1258 4 0 0 25 0 4 0 523970122 338829312 43921 33554432000 4194304 4623224 140733224161392 18446744073709551615 4461225 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=330888 CPUtime=12.56 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 18389 0 0 0 1251 5 0 0 25 0 4 0 523970122 338829312 43921 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=330888 CPUtime=12.63 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 22038 0 0 0 1259 4 0 0 25 0 4 0 523970122 338829312 43921 33554432000 4194304 4623224 140733224161392 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.52
Current children cumulated vsize (KiB) 330888

[startup+25.5009 s]
/proc/loadavg: 5.11 4.82 6.19 9/184 22701
/proc/meminfo: memFree=30101200/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=370464 CPUtime=101.66 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 159853 0 0 0 10133 33 0 0 25 0 4 0 523970116 379355136 61079 33554432000 4194304 4623224 140733224161392 18446744073709551615 4416552 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 92616 61079 344 105 0 88120 0
[pid=22696/tid=22698] ppid=22694 vsize=370464 CPUtime=25.42 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 24677 0 0 0 2535 7 0 0 25 0 4 0 523970122 379355136 61079 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=370464 CPUtime=25.29 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 28986 0 0 0 2521 8 0 0 25 0 4 0 523970122 379355136 61079 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=370464 CPUtime=25.42 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 86661 0 0 0 2530 12 0 0 25 0 4 0 523970122 379355136 61079 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.66
Current children cumulated vsize (KiB) 370464

[startup+51.101 s]
/proc/loadavg: 6.10 5.08 6.24 9/184 22702
/proc/meminfo: memFree=29770344/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=601084 CPUtime=203.92 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 368437 0 0 0 20323 69 0 0 25 0 4 0 523970116 615510016 101204 33554432000 4194304 4623224 140733224161392 18446744073709551615 4414880 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 150271 101204 361 105 0 145775 0
[pid=22696/tid=22698] ppid=22694 vsize=601084 CPUtime=51.02 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 36885 0 0 0 5089 13 0 0 25 0 4 0 523970122 615510016 101204 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=601084 CPUtime=50.75 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 43015 0 0 0 5064 11 0 0 25 0 4 0 523970122 615510016 101204 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=601084 CPUtime=51.03 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 217199 0 0 0 5071 32 0 0 25 0 4 0 523970122 615510016 101204 33554432000 4194304 4623224 140733224161392 18446744073709551615 4363777 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.92
Current children cumulated vsize (KiB) 601084

[startup+102.306 s]
/proc/loadavg: 7.26 5.55 6.34 9/184 22703
/proc/meminfo: memFree=29236140/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=851724 CPUtime=408.45 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 969597 0 0 0 40685 160 0 0 25 0 4 0 523970116 872165376 167661 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 212931 167661 476 105 0 208435 0
[pid=22696/tid=22698] ppid=22694 vsize=851724 CPUtime=102.22 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 55473 0 0 0 10202 20 0 0 25 0 4 0 523970122 872165376 167661 33554432000 4194304 4623224 140733224161392 18446744073709551615 212435675559 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=851724 CPUtime=101.68 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 60772 0 0 0 10152 16 0 0 25 0 4 0 523970122 872165376 167661 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=851724 CPUtime=102.23 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 691807 0 0 0 10123 100 0 0 25 0 4 0 523970122 872165376 167661 33554432000 4194304 4623224 140733224161392 18446744073709551615 4363762 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.45
Current children cumulated vsize (KiB) 851724

[startup+162.301 s]
/proc/loadavg: 7.77 6.01 6.45 9/184 22704
/proc/meminfo: memFree=28735156/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=1213104 CPUtime=648.09 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 1372905 0 0 0 64586 223 0 0 25 0 4 0 523970116 1242218496 224801 33554432000 4194304 4623224 140733224161392 18446744073709551615 4509468 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 303276 224801 443 105 0 298780 0
[pid=22696/tid=22698] ppid=22694 vsize=1213104 CPUtime=162.2 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 79958 0 0 0 16194 26 0 0 25 0 4 0 523970122 1242218496 224801 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=1213104 CPUtime=161.35 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 86467 0 0 0 16111 24 0 0 25 0 4 0 523970122 1242218496 224801 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=1213104 CPUtime=162.22 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 966983 0 0 0 16084 138 0 0 25 0 4 0 523970122 1242218496 224801 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376946 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.09
Current children cumulated vsize (KiB) 1213104

[startup+222.3 s]
/proc/loadavg: 7.95 6.38 6.55 9/184 22706
/proc/meminfo: memFree=28309684/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=1438884 CPUtime=887.76 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 1629982 0 0 0 88507 269 0 0 25 0 4 0 523970116 1473417216 279289 33554432000 4194304 4623224 140733224161392 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 359721 279289 542 105 0 355225 0
[pid=22696/tid=22698] ppid=22694 vsize=1438884 CPUtime=222.19 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 86565 0 0 0 22188 31 0 0 25 0 4 0 523970122 1473417216 279290 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=1438884 CPUtime=221.02 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 95477 0 0 0 22072 30 0 0 25 0 4 0 523970122 1473417216 279290 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=1438884 CPUtime=222.22 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 1102967 0 0 0 22064 158 0 0 25 0 4 0 523970122 1473417216 279291 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 887.76
Current children cumulated vsize (KiB) 1438884

[startup+282.301 s]

################
# More data... #
################

[pid=22696] ppid=22694 vsize=1973692 CPUtime=2805.17 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 6190960 0 0 0 279490 1027 0 0 25 0 4 0 523970116 2021060608 419946 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 493423 419946 344 105 0 488927 0
[pid=22696/tid=22698] ppid=22694 vsize=1973692 CPUtime=702.16 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 92066 0 0 0 70183 33 0 0 25 0 4 0 523970122 2021060608 419946 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=1973692 CPUtime=698.43 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 130949 0 0 0 69805 38 0 0 25 0 4 0 523970122 2021060608 419946 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=1973692 CPUtime=702.24 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 5088089 0 0 0 69414 810 0 0 25 0 4 0 523970122 2021060608 419946 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2805.17
Current children cumulated vsize (KiB) 1973692

[startup+762.307 s]
/proc/loadavg: 8.19 7.85 7.22 10/184 22721
/proc/meminfo: memFree=27180576/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2083976 CPUtime=3044.86 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 6727591 0 0 0 303355 1131 0 0 25 0 4 0 523970116 2133991424 433983 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 520994 433983 344 105 0 516498 0
[pid=22696/tid=22698] ppid=22694 vsize=2083976 CPUtime=762.16 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 112065 0 0 0 76181 35 0 0 25 0 4 0 523970122 2133991424 433983 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2083976 CPUtime=758.1 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 131380 0 0 0 75772 38 0 0 25 0 4 0 523970122 2133991424 433983 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2083976 CPUtime=762.24 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 5527100 0 0 0 75331 893 0 0 25 0 4 0 523970122 2133991424 433983 33554432000 4194304 4623224 140733224161392 18446744073709551615 4363742 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.86
Current children cumulated vsize (KiB) 2083976

[startup+822.301 s]
/proc/loadavg: 8.18 7.91 7.28 9/184 22722
/proc/meminfo: memFree=27037832/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2411708 CPUtime=3284.52 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 7431144 0 0 0 327199 1253 0 0 25 0 4 0 523970116 2469588992 463794 33554432000 4194304 4623224 140733224161392 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 602927 463794 344 105 0 598431 0
[pid=22696/tid=22698] ppid=22694 vsize=2411708 CPUtime=822.16 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 112276 0 0 0 82180 36 0 0 25 0 4 0 523970122 2469588992 463794 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2411708 CPUtime=817.78 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 131772 0 0 0 81739 39 0 0 25 0 4 0 523970122 2469588992 463794 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2411708 CPUtime=822.24 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 5950870 0 0 0 81254 970 0 0 25 0 4 0 523970122 2469588992 463794 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.52
Current children cumulated vsize (KiB) 2411708

[startup+882.301 s]
/proc/loadavg: 8.17 7.95 7.33 9/184 22724
/proc/meminfo: memFree=26971564/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2437804 CPUtime=3524.2 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 8036471 0 0 0 351053 1367 0 0 25 0 4 0 523970116 2496311296 471520 33554432000 4194304 4623224 140733224161392 18446744073709551615 4517574 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 609451 471520 344 105 0 604955 0
[pid=22696/tid=22698] ppid=22694 vsize=2437804 CPUtime=882.15 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 112458 0 0 0 88179 36 0 0 25 0 4 0 523970122 2496311296 471520 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357984 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2437804 CPUtime=877.45 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 132411 0 0 0 87706 39 0 0 25 0 4 0 523970122 2496311296 471520 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2437804 CPUtime=882.24 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 6469617 0 0 0 87157 1067 0 0 25 0 4 0 523970122 2496311296 471520 33554432000 4194304 4623224 140733224161392 18446744073709551615 4355414 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.2
Current children cumulated vsize (KiB) 2437804

[startup+942.3 s]
/proc/loadavg: 8.16 7.99 7.38 9/184 22725
/proc/meminfo: memFree=26887488/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2437804 CPUtime=3763.87 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 8642242 0 0 0 374914 1473 0 0 25 0 4 0 523970116 2496311296 481056 33554432000 4194304 4623224 140733224161392 18446744073709551615 4415016 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 609451 481057 344 105 0 604955 0
[pid=22696/tid=22698] ppid=22694 vsize=2437804 CPUtime=942.15 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 112805 0 0 0 94179 36 0 0 25 0 4 0 523970122 2496311296 481058 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2437804 CPUtime=937.12 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 132693 0 0 0 93673 39 0 0 25 0 4 0 523970122 2496311296 481058 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2437804 CPUtime=942.24 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 6981684 0 0 0 93069 1155 0 0 25 0 4 0 523970122 2496311296 481058 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.87
Current children cumulated vsize (KiB) 2437804

[startup+1002.3 s]
/proc/loadavg: 8.15 8.02 7.43 9/184 22727
/proc/meminfo: memFree=26820132/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2606284 CPUtime=4003.54 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 9220080 0 0 0 398772 1582 0 0 25 0 4 0 523970116 2668834816 490542 33554432000 4194304 4623224 140733224161392 18446744073709551615 4414974 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 651571 490542 345 105 0 647075 0
[pid=22696/tid=22698] ppid=22694 vsize=2606284 CPUtime=1002.14 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 113057 0 0 0 100178 36 0 0 25 0 4 0 523970122 2668834816 490542 33554432000 4194304 4623224 140733224161392 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2606284 CPUtime=996.8 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 132946 0 0 0 99640 40 0 0 25 0 4 0 523970122 2668834816 490542 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2606284 CPUtime=1002.25 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 7436471 0 0 0 98983 1242 0 0 25 0 4 0 523970122 2668834816 490542 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.54
Current children cumulated vsize (KiB) 2606284

[startup+1062.3 s]
/proc/loadavg: 8.13 8.04 7.47 10/184 22728
/proc/meminfo: memFree=26661644/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2606284 CPUtime=4243.23 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 9810545 0 0 0 422640 1683 0 0 25 0 4 0 523970116 2668834816 497268 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 651571 497268 344 105 0 647075 0
[pid=22696/tid=22698] ppid=22694 vsize=2606284 CPUtime=1062.14 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 113194 0 0 0 106178 36 0 0 25 0 4 0 523970122 2668834816 497268 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2606284 CPUtime=1056.48 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 133253 0 0 0 105608 40 0 0 25 0 4 0 523970122 2668834816 497268 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2606284 CPUtime=1062.25 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 7936992 0 0 0 104901 1324 0 0 25 0 4 0 523970122 2668834816 497268 33554432000 4194304 4623224 140733224161392 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.23
Current children cumulated vsize (KiB) 2606284

[startup+1122.3 s]
/proc/loadavg: 8.12 8.06 7.51 10/184 22730
/proc/meminfo: memFree=26564772/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2606284 CPUtime=4482.89 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 10381021 0 0 0 446513 1776 0 0 25 0 4 0 523970116 2668834816 504978 33554432000 4194304 4623224 140733224161392 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 651571 504978 344 105 0 647075 0
[pid=22696/tid=22698] ppid=22694 vsize=2606284 CPUtime=1122.13 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 113301 0 0 0 112177 36 0 0 25 0 4 0 523970122 2668834816 504978 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357593 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2606284 CPUtime=1116.15 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 133473 0 0 0 111575 40 0 0 25 0 4 0 523970122 2668834816 504978 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2606284 CPUtime=1122.25 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 8416733 0 0 0 110825 1400 0 0 25 0 4 0 523970122 2668834816 504978 33554432000 4194304 4623224 140733224161392 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.89
Current children cumulated vsize (KiB) 2606284

[startup+1182.3 s]
/proc/loadavg: 8.08 8.06 7.54 9/184 22732
/proc/meminfo: memFree=26448196/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2606284 CPUtime=4722.57 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 10961786 0 0 0 470386 1871 0 0 25 0 4 0 523970116 2668834816 512447 33554432000 4194304 4623224 140733224161392 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 651571 512447 344 105 0 647075 0
[pid=22696/tid=22698] ppid=22694 vsize=2606284 CPUtime=1182.13 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 113427 0 0 0 118177 36 0 0 25 0 4 0 523970122 2668834816 512447 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2606284 CPUtime=1175.83 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 133778 0 0 0 117543 40 0 0 25 0 4 0 523970122 2668834816 512447 33554432000 4194304 4623224 140733224161392 18446744073709551615 4357692 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2606284 CPUtime=1182.25 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 8909820 0 0 0 116745 1480 0 0 25 0 4 0 523970122 2668834816 512447 33554432000 4194304 4623224 140733224161392 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.57
Current children cumulated vsize (KiB) 2606284



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.12 8.07 7.56 6/183 22733
/proc/meminfo: memFree=27659660/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2606284 CPUtime=4800.09 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 11172988 0 0 0 478105 1904 0 0 25 0 4 0 523970116 2668834816 514963 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 651571 514964 344 105 0 647075 0
[pid=22696/tid=22698] ppid=22694 vsize=2606284 CPUtime=1201.53 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 113473 0 0 0 120117 36 0 0 25 0 4 0 523970122 2668834816 514964 33554432000 4194304 4623224 140733224161392 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2606284 CPUtime=1195.12 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 133861 0 0 0 119472 40 0 0 25 0 4 0 523970122 2668834816 514965 33554432000 4194304 4623224 140733224161392 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2606284 CPUtime=1201.66 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 9081953 0 0 0 118659 1507 0 0 25 0 4 0 523970122 2668834816 514966 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 2606284

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.12 8.07 7.56 6/183 22733
/proc/meminfo: memFree=27659660/32951124 swapFree=67111416/67111528
[pid=22696] ppid=22694 vsize=2606284 CPUtime=4800.09 cores=1,3,5,7
/proc/22696/stat : 22696 (SArTagnan) R 22694 22696 22284 0 -1 4202496 11172988 0 0 0 478105 1904 0 0 25 0 4 0 523970116 2668834816 514963 33554432000 4194304 4623224 140733224161392 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22696/statm: 651571 514964 344 105 0 647075 0
[pid=22696/tid=22698] ppid=22694 vsize=2606284 CPUtime=1201.53 cores=1,3,5,7
/proc/22696/task/22698/stat : 22698 (SArTagnan) R 22694 22696 22284 0 -1 4202560 113473 0 0 0 120117 36 0 0 25 0 4 0 523970122 2668834816 514964 33554432000 4194304 4623224 140733224161392 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22696/tid=22699] ppid=22694 vsize=2606284 CPUtime=1195.12 cores=1,3,5,7
/proc/22696/task/22699/stat : 22699 (SArTagnan) R 22694 22696 22284 0 -1 4202560 133861 0 0 0 119472 40 0 0 25 0 4 0 523970122 2668834816 514965 33554432000 4194304 4623224 140733224161392 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22696/tid=22700] ppid=22694 vsize=2606284 CPUtime=1201.66 cores=1,3,5,7
/proc/22696/task/22700/stat : 22700 (SArTagnan) R 22694 22696 22284 0 -1 4202560 9081953 0 0 0 118659 1507 0 0 25 0 4 0 523970122 2668834816 514966 33554432000 4194304 4623224 140733224161392 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 2606284

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.79
CPU time (s): 4800.19
CPU user time (s): 4781.07
CPU system time (s): 19.1211
CPU usage (%): 399.419
Max. virtual memory (cumulated for all children) (KiB): 3066664

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4781.07
system time used= 19.1211
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11173037
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1567
involuntary context switches= 34412

runsolver used 1.71274 second user time and 4.85126 second system time

The end

Launcher Data

Begin job on node102 at 2011-04-30 02:34:38
IDJOB=3251486
IDBENCH=88223
IDSOLVER=1656
FILE ID=node102/3251486-1304123677
RUNJOBID= node102-1304123677-22674
PBS_JOBID= 13170726
Free space on /tmp= 71556 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m42-q663-n40-p15-s72490337.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251486-1304123677/watcher-3251486-1304123677 -o /tmp/evaluation-result-3251486-1304123677/solver-3251486-1304123677 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3251486-1304123677.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ab8e40d31c79e7a71114e3126a46874f
RANDOM SEED=393818957

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30579568 kB
Buffers:        606440 kB
Cached:        1273112 kB
SwapCached:          0 kB
Active:         159684 kB
Inactive:      1796800 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30579568 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:            6648 kB
Writeback:           0 kB
AnonPages:       75784 kB
Mapped:          14940 kB
Slab:           351948 kB
PageTables:       4672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   259340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71556 MiB
End job on node102 at 2011-04-30 02:54:41