Trace number 3439026

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001 5011.41

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-15-29-sat.cnf
MD5SUM89115b5a973735d51018fb3202154f32
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.022995
Satisfiable
(Un)Satisfiability was proved
Number of variables435
Number of clauses3270
Sum of the clauses size12615
Maximum clause length29
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23045
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5225

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439026-1306925188/watcher-3439026-1306925188 -o /tmp/evaluation-result-3439026-1306925188/solver-3439026-1306925188 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439026-1306925188.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 7.95 7.96 1/491 18411
/proc/meminfo: memFree=31408292/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=90912 CPUtime=0.03 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 583 0 0 0 3 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086770 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 22728 519 300 106 0 18231 0
[pid=18411/tid=18412] ppid=18409 vsize=90912 CPUtime=0.01 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086768 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=90912 CPUtime=0 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 270613167089 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=90912 CPUtime=0 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086774 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=90912 CPUtime=0.01 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=90912 CPUtime=0 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=90912 CPUtime=0 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086770 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=90912 CPUtime=0 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 804119781 93093888 519 33554432000 4194304 4625164 140734366181920 18446744073709551615 47722299086768 0 0 4096 2 0 0 0 -1 6 0 0 0

[startup+0.0488319 s]
/proc/loadavg: 7.48 7.95 7.96 1/491 18411
/proc/meminfo: memFree=31408292/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=485216 CPUtime=0.24 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 2011 0 0 0 23 1 0 0 25 0 8 0 804119781 496861184 1802 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393068 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 121304 1803 348 106 0 116807 0
[pid=18411/tid=18412] ppid=18409 vsize=485216 CPUtime=0.02 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 119 0 0 0 2 0 0 0 25 0 8 0 804119781 496861184 1805 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=485216 CPUtime=0.02 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 156 0 0 0 2 0 0 0 18 0 8 0 804119781 496861184 1807 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=485216 CPUtime=0.03 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 166 0 0 0 3 0 0 0 18 0 8 0 804119781 496861184 1808 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612777861 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=485216 CPUtime=0.03 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 213 0 0 0 3 0 0 0 18 0 8 0 804119781 496861184 1809 33554432000 4194304 4625164 140734366181920 18446744073709551615 4339600 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=485216 CPUtime=0.02 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 205 0 0 0 2 0 0 0 18 0 8 0 804119781 496861184 1809 33554432000 4194304 4625164 140734366181920 18446744073709551615 4349072 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=485216 CPUtime=0.02 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 81 0 0 0 2 0 0 0 18 0 8 0 804119781 496861184 1809 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351878 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=485216 CPUtime=0.01 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 159 0 0 0 1 0 0 0 25 0 8 0 804119781 496861184 1809 33554432000 4194304 4625164 140734366181920 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 485216

[startup+0.106662 s]
/proc/loadavg: 7.48 7.95 7.96 1/491 18411
/proc/meminfo: memFree=31408292/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=486500 CPUtime=0.63 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 4391 0 0 0 61 2 0 0 18 0 8 0 804119781 498176000 3912 33554432000 4194304 4625164 140734366181920 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 121625 3914 348 106 0 117128 0
[pid=18411/tid=18412] ppid=18409 vsize=486500 CPUtime=0.04 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 219 0 0 0 4 0 0 0 25 0 8 0 804119781 498176000 3914 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=486500 CPUtime=0.07 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 479 0 0 0 7 0 0 0 18 0 8 0 804119781 498176000 3914 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=486500 CPUtime=0.09 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 379 0 0 0 9 0 0 0 18 0 8 0 804119781 498176000 3914 33554432000 4194304 4625164 140734366181920 18446744073709551615 4334439 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=486500 CPUtime=0.09 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 520 0 0 0 9 0 0 0 18 0 8 0 804119781 498176000 3915 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=486500 CPUtime=0.07 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 546 0 0 0 7 0 0 0 18 0 8 0 804119781 498176000 3915 33554432000 4194304 4625164 140734366181920 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=486500 CPUtime=0.07 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 400 0 0 0 7 0 0 0 18 0 8 0 804119781 498176000 3916 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=486500 CPUtime=0.06 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 520 0 0 0 6 0 0 0 25 0 8 0 804119781 498176000 3916 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.63
Current children cumulated vsize (KiB) 486500

[startup+0.319251 s]
/proc/loadavg: 7.48 7.95 7.96 1/491 18411
/proc/meminfo: memFree=31408292/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=494576 CPUtime=3.19 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 15195 0 0 0 314 5 0 0 18 0 8 0 804119781 506445824 13263 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393118 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 123644 13309 348 106 0 119147 0
[pid=18411/tid=18412] ppid=18409 vsize=494576 CPUtime=0.36 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) D 18409 18411 18054 0 -1 4202560 1382 0 0 0 36 0 0 0 18 0 8 0 804119781 506445824 13309 33554432000 4194304 4625164 140734366181920 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=494576 CPUtime=0.39 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) D 18409 18411 18054 0 -1 4202560 1571 0 0 0 39 0 0 0 18 0 8 0 804119781 506445824 13309 33554432000 4194304 4625164 140734366181920 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=494576 CPUtime=0.41 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 1338 0 0 0 41 0 0 0 18 0 8 0 804119781 506445824 13309 33554432000 4194304 4625164 140734366181920 18446744073709551615 4547847 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=494576 CPUtime=0.4 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) D 18409 18411 18054 0 -1 4202560 1894 0 0 0 40 0 0 0 18 0 8 0 804119781 506445824 13309 33554432000 4194304 4625164 140734366181920 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=494576 CPUtime=0.39 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) D 18409 18411 18054 0 -1 4202560 2297 0 0 0 38 1 0 0 18 0 8 0 804119781 506445824 13310 33554432000 4194304 4625164 140734366181920 18446744073709551615 270613153882 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=494576 CPUtime=0.39 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 2065 0 0 0 39 0 0 0 18 0 8 0 804119781 506445824 13311 33554432000 4194304 4625164 140734366181920 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=560244 CPUtime=0.4 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 1664 0 0 0 40 0 0 0 18 0 8 0 804119781 573689856 13880 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.19
Current children cumulated vsize (KiB) 494576

[startup+1.10949 s]
/proc/loadavg: 7.48 7.95 7.96 1/491 18411
/proc/meminfo: memFree=31408292/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=575576 CPUtime=8.63 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 30721 0 0 0 853 10 0 0 18 0 8 0 804119781 589389824 27632 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 143894 27632 385 106 0 139397 0
[pid=18411/tid=18412] ppid=18409 vsize=575576 CPUtime=1.03 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 3509 0 0 0 103 0 0 0 19 0 8 0 804119781 589389824 27632 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=575576 CPUtime=1.07 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 4501 0 0 0 106 1 0 0 19 0 8 0 804119781 589389824 27632 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612771873 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=575576 CPUtime=1.09 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 1790 0 0 0 109 0 0 0 18 0 8 0 804119781 589389824 27632 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612759756 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=575576 CPUtime=1.08 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 3448 0 0 0 108 0 0 0 18 0 8 0 804119781 589389824 27632 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=575576 CPUtime=1.07 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 5565 0 0 0 104 3 0 0 19 0 8 0 804119781 589389824 27633 33554432000 4194304 4625164 140734366181920 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=575576 CPUtime=1.07 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 4872 0 0 0 106 1 0 0 19 0 8 0 804119781 589389824 27633 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351984 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=575576 CPUtime=1.06 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 3481 0 0 0 105 1 0 0 19 0 8 0 804119781 589389824 27633 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612771873 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 8.63
Current children cumulated vsize (KiB) 575576

[startup+1.50042 s]
/proc/loadavg: 7.48 7.95 7.96 1/491 18411
/proc/meminfo: memFree=31408292/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=585400 CPUtime=11.76 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 39242 0 0 0 1163 13 0 0 19 0 8 0 804119781 599449600 34344 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393051 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 146350 34347 376 106 0 141853 0
[pid=18411/tid=18412] ppid=18409 vsize=585400 CPUtime=1.43 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 4575 0 0 0 142 1 0 0 19 0 8 0 804119781 599449600 34347 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=585400 CPUtime=1.45 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 5955 0 0 0 144 1 0 0 19 0 8 0 804119781 599449600 34347 33554432000 4194304 4625164 140734366181920 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=585400 CPUtime=1.48 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 1827 0 0 0 148 0 0 0 19 0 8 0 804119781 599449600 34348 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=585400 CPUtime=1.48 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 4407 0 0 0 147 1 0 0 19 0 8 0 804119781 599449600 34348 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612771525 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=585400 CPUtime=1.46 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 7225 0 0 0 143 3 0 0 20 0 8 0 804119781 599449600 34348 33554432000 4194304 4625164 140734366181920 18446744073709551615 4348867 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=585400 CPUtime=1.47 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6553 0 0 0 145 2 0 0 20 0 8 0 804119781 599449600 34348 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612771873 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=585400 CPUtime=1.45 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 4158 0 0 0 144 1 0 0 19 0 8 0 804119781 599449600 34349 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.76
Current children cumulated vsize (KiB) 585400

[startup+3.10113 s]
/proc/loadavg: 7.48 7.95 7.96 9/499 18420
/proc/meminfo: memFree=31197296/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=610344 CPUtime=24.51 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 67796 0 0 0 2428 23 0 0 23 0 8 0 804119781 624992256 56552 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393091 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 152586 56552 407 106 0 148089 0
[pid=18411/tid=18412] ppid=18409 vsize=610344 CPUtime=2.99 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 7481 0 0 0 297 2 0 0 19 0 8 0 804119781 624992256 56553 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=610344 CPUtime=3.05 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 11673 0 0 0 302 3 0 0 24 0 8 0 804119781 624992256 56553 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=610344 CPUtime=3.08 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 2389 0 0 0 308 0 0 0 23 0 8 0 804119781 624992256 56555 33554432000 4194304 4625164 140734366181920 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=610344 CPUtime=3.06 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 8108 0 0 0 305 1 0 0 18 0 8 0 804119781 624992256 56556 33554432000 4194304 4625164 140734366181920 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=610344 CPUtime=3.06 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 13712 0 0 0 300 6 0 0 25 0 8 0 804119781 624992256 56556 33554432000 4194304 4625164 140734366181920 18446744073709551615 270612771873 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=610344 CPUtime=3.06 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 10386 0 0 0 303 3 0 0 25 0 8 0 804119781 624992256 56556 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=610344 CPUtime=3.05 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 7569 0 0 0 303 2 0 0 23 0 8 0 804119781 624992256 56556 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.51
Current children cumulated vsize (KiB) 610344

[startup+6.30057 s]
/proc/loadavg: 7.68 7.98 7.97 9/499 18420
/proc/meminfo: memFree=31058304/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=631296 CPUtime=50.03 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 111114 0 0 0 4966 37 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393121 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 157824 89021 438 106 0 153327 0
[pid=18411/tid=18412] ppid=18409 vsize=631296 CPUtime=6.13 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 12370 0 0 0 609 4 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=631296 CPUtime=6.25 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 17313 0 0 0 619 6 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=631296 CPUtime=6.28 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 5864 0 0 0 627 1 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=631296 CPUtime=6.26 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 15260 0 0 0 622 4 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=631296 CPUtime=6.26 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 21570 0 0 0 618 8 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4437234 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=631296 CPUtime=6.26 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 15798 0 0 0 621 5 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=631296 CPUtime=6.24 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 13733 0 0 0 620 4 0 0 25 0 8 0 804119781 646447104 89021 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 4132116

[startup+4722.3 s]
/proc/loadavg: 8.14 8.11 8.03 9/499 18572
/proc/meminfo: memFree=27957988/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=4132116 CPUtime=37694.4 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 12008196 0 0 0 3766755 2680 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 1033029 859363 521 106 0 1028532 0
[pid=18411/tid=18412] ppid=18409 vsize=4132116 CPUtime=4640.98 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 161699 0 0 0 463998 100 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=4132116 CPUtime=4722.35 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 171955 0 0 0 472144 91 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=4132116 CPUtime=4722.34 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6259195 0 0 0 470928 1306 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4547847 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=4132116 CPUtime=4722.34 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 143022 0 0 0 472154 80 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=4132116 CPUtime=4721.66 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 145267 0 0 0 472114 52 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=4132116 CPUtime=4722.36 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 181748 0 0 0 472184 52 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=4132116 CPUtime=4720.21 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 114830 0 0 0 471955 66 0 0 25 0 8 0 804119781 4231286784 859363 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37694.4
Current children cumulated vsize (KiB) 4132116

[startup+4782.3 s]
/proc/loadavg: 8.11 8.10 8.02 9/499 18574
/proc/meminfo: memFree=27954124/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=4132116 CPUtime=38173.4 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 12231320 0 0 0 3814620 2721 0 0 25 0 8 0 804119781 4231286784 862129 33554432000 4194304 4625164 140734366181920 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 1033029 862129 467 106 0 1028532 0
[pid=18411/tid=18412] ppid=18409 vsize=4132116 CPUtime=4699.96 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 161920 0 0 0 469895 101 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=4132116 CPUtime=4782.37 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 172101 0 0 0 478145 92 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=4132116 CPUtime=4782.35 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6337662 0 0 0 476915 1320 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=4132116 CPUtime=4782.35 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 143251 0 0 0 478155 80 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=4132116 CPUtime=4781.67 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 145473 0 0 0 478115 52 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=4132116 CPUtime=4782.38 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 181809 0 0 0 478186 52 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=4132116 CPUtime=4780.21 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 114868 0 0 0 477955 66 0 0 25 0 8 0 804119781 4231286784 862296 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38173.4
Current children cumulated vsize (KiB) 4132116

[startup+4842.3 s]
/proc/loadavg: 8.04 8.08 8.02 9/499 18576
/proc/meminfo: memFree=27944184/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=4197652 CPUtime=38652.3 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 12413571 0 0 0 3862470 2757 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393068 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 1049413 865597 467 106 0 1044916 0
[pid=18411/tid=18412] ppid=18409 vsize=4197652 CPUtime=4758.92 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 162144 0 0 0 475791 101 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=4197652 CPUtime=4842.35 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 172273 0 0 0 484143 92 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=4197652 CPUtime=4842.34 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6361983 0 0 0 482909 1325 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=4197652 CPUtime=4842.33 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 143482 0 0 0 484153 80 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=4197652 CPUtime=4841.66 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 145670 0 0 0 484114 52 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=4197652 CPUtime=4842.37 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 181880 0 0 0 484185 52 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=4197652 CPUtime=4840.18 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 114898 0 0 0 483952 66 0 0 25 0 8 0 804119781 4298395648 865597 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38652.3
Current children cumulated vsize (KiB) 4197652

[startup+4902.32 s]
/proc/loadavg: 8.06 8.08 8.02 9/499 18577
/proc/meminfo: memFree=27936968/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=4132116 CPUtime=39131.4 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 12590678 0 0 0 3910344 2791 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 1033029 866356 351 106 0 1028532 0
[pid=18411/tid=18412] ppid=18409 vsize=4132116 CPUtime=4817.9 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 162366 0 0 0 481688 102 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=4132116 CPUtime=4902.37 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 172529 0 0 0 490145 92 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=4132116 CPUtime=4902.36 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6380330 0 0 0 488908 1328 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=4132116 CPUtime=4902.36 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 143695 0 0 0 490155 81 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=4132116 CPUtime=4901.67 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 145889 0 0 0 490115 52 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=4132116 CPUtime=4902.39 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 181953 0 0 0 490187 52 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=4132116 CPUtime=4900.17 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 114917 0 0 0 489951 66 0 0 25 0 8 0 804119781 4231286784 866356 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39131.4
Current children cumulated vsize (KiB) 4132116

[startup+4962.3 s]
/proc/loadavg: 8.02 8.07 8.01 9/499 18579
/proc/meminfo: memFree=27929884/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=4132116 CPUtime=39610.2 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 12750808 0 0 0 3958194 2824 0 0 25 0 8 0 804119781 4231286784 868098 33554432000 4194304 4625164 140734366181920 18446744073709551615 4329225 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 1033029 868099 351 106 0 1028532 0
[pid=18411/tid=18412] ppid=18409 vsize=4132116 CPUtime=4876.85 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 162577 0 0 0 487583 102 0 0 25 0 8 0 804119781 4231286784 868100 33554432000 4194304 4625164 140734366181920 18446744073709551615 4330968 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=4132116 CPUtime=4962.36 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 173211 0 0 0 496143 93 0 0 25 0 8 0 804119781 4231286784 868100 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488020 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=4132116 CPUtime=4962.34 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6380725 0 0 0 494905 1329 0 0 25 0 8 0 804119781 4231286784 868100 33554432000 4194304 4625164 140734366181920 18446744073709551615 4552377 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=4132116 CPUtime=4962.34 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 143917 0 0 0 496153 81 0 0 25 0 8 0 804119781 4231286784 868101 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=4132116 CPUtime=4961.66 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 146068 0 0 0 496113 53 0 0 25 0 8 0 804119781 4231286784 868101 33554432000 4194304 4625164 140734366181920 18446744073709551615 4329673 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=4132116 CPUtime=4962.37 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 181984 0 0 0 496185 52 0 0 25 0 8 0 804119781 4231286784 868102 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=4132116 CPUtime=4960.14 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 114944 0 0 0 495948 66 0 0 25 0 8 0 804119781 4231286784 868102 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39610.2
Current children cumulated vsize (KiB) 4132116



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.22 s]
/proc/loadavg: 8.07 8.07 8.01 9/499 18580
/proc/meminfo: memFree=27923916/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=4263188 CPUtime=40000.8 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) R 18409 18411 18054 0 -1 4202496 12900480 0 0 0 3997226 2851 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4393097 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 1065797 869698 351 106 0 1061300 0
[pid=18411/tid=18412] ppid=18409 vsize=4263188 CPUtime=4924.92 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4202560 162742 0 0 0 492389 103 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=18411/tid=18413] ppid=18409 vsize=4263188 CPUtime=5011.3 cores=0-7
/proc/18411/task/18413/stat : 18413 (SArTagnan) R 18409 18411 18054 0 -1 4202560 173491 0 0 0 501037 93 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=18411/tid=18414] ppid=18409 vsize=4263188 CPUtime=5011.28 cores=0-7
/proc/18411/task/18414/stat : 18414 (SArTagnan) R 18409 18411 18054 0 -1 4202560 6392708 0 0 0 499797 1331 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=18411/tid=18415] ppid=18409 vsize=4263188 CPUtime=5011.28 cores=0-7
/proc/18411/task/18415/stat : 18415 (SArTagnan) R 18409 18411 18054 0 -1 4202560 144098 0 0 0 501047 81 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=18411/tid=18416] ppid=18409 vsize=4263188 CPUtime=5010.6 cores=0-7
/proc/18411/task/18416/stat : 18416 (SArTagnan) R 18409 18411 18054 0 -1 4202560 146220 0 0 0 501007 53 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=18411/tid=18417] ppid=18409 vsize=4263188 CPUtime=5011.31 cores=0-7
/proc/18411/task/18417/stat : 18417 (SArTagnan) R 18409 18411 18054 0 -1 4202560 182023 0 0 0 501079 52 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331211 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=18411/tid=18418] ppid=18409 vsize=4263188 CPUtime=5009.06 cores=0-7
/proc/18411/task/18418/stat : 18418 (SArTagnan) R 18409 18411 18054 0 -1 4202560 114956 0 0 0 500840 66 0 0 25 0 8 0 804119781 4365504512 869698 33554432000 4194304 4625164 140734366181920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 4263188

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.33 s]
/proc/loadavg: 8.07 8.07 8.01 9/499 18580
/proc/meminfo: memFree=27923916/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=0 CPUtime=40000.9 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) Z 18409 18411 18054 0 -1 4203548 12900480 0 0 0 3997235 2859 0 0 25 0 2 0 804119781 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 0 0 0 0 0 0 0
[pid=18411/tid=18412] ppid=18409 vsize=0 CPUtime=4925.01 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4203588 162742 0 0 0 492390 111 0 0 25 0 2 0 804119781 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

[startup+5011.4 s]
/proc/loadavg: 8.07 8.07 8.01 9/499 18580
/proc/meminfo: memFree=27923916/32951124 swapFree=53876544/67111528
[pid=18411] ppid=18409 vsize=0 CPUtime=40001 cores=0-7
/proc/18411/stat : 18411 (SArTagnan) Z 18409 18411 18054 0 -1 4203548 12900480 0 0 0 3997235 2867 0 0 25 0 2 0 804119781 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18411/statm: 0 0 0 0 0 0 0
[pid=18411/tid=18412] ppid=18409 vsize=0 CPUtime=4925.08 cores=0-7
/proc/18411/task/18412/stat : 18412 (SArTagnan) R 18409 18411 18054 0 -1 4203588 162742 0 0 0 492390 118 0 0 25 0 2 0 804119781 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.41
CPU time (s): 40001
CPU user time (s): 39972.4
CPU system time (s): 28.6856
CPU usage (%): 798.199
Max. virtual memory (cumulated for all children) (KiB): 4423356

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39972.4
system time used= 28.6856
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 12900480
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11773
involuntary context switches= 173126

runsolver used 22.1946 second user time and 64.1612 second system time

The end

Launcher Data 

Begin job on node108 at 2011-06-01 12:46:28
IDJOB=3439026
IDBENCH=83238
IDSOLVER=1936
FILE ID=node108/3439026-1306925188
RUNJOBID= node108-1306920174-18068
PBS_JOBID= 13488545
Free space on /tmp= 73852 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-15-29-sat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439026-1306925188/watcher-3439026-1306925188 -o /tmp/evaluation-result-3439026-1306925188/solver-3439026-1306925188 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439026-1306925188.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 89115b5a973735d51018fb3202154f32
RANDOM SEED=272439815

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31408316 kB
Buffers:        166088 kB
Cached:         111004 kB
SwapCached:      13416 kB
Active:        1112148 kB
Inactive:       156436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31408316 kB
SwapTotal:    67111528 kB
SwapFree:     53876544 kB
Dirty:             428 kB
Writeback:           0 kB
AnonPages:      988332 kB
Mapped:          11824 kB
Slab:           135216 kB
PageTables:      65576 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 134538044 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73852 MiB
End job on node108 at 2011-06-01 14:10:02