Trace number 3386047

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 2418.83 1300.2

General information on the benchmark

NameSAT02/handmade/zhang-lintao/
xor-chain/x1_80.shuffled.cnf
MD5SUM53a7d1541ad9c0dde902ec3a505ae8fc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.001998
Satisfiable
(Un)Satisfiability was proved
Number of variables238
Number of clauses634
Sum of the clauses size1900
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22
Number of clauses of size 3632
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386047-1305583434/watcher-3386047-1305583434 -o /tmp/evaluation-result-3386047-1305583434/solver-3386047-1305583434 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386047-1305583434.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 14.58 14.92 13.35 10/344 19193
/proc/meminfo: memFree=10532320/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=18216 CPUtime=0 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4194304 279 0 0 0 0 0 0 0 25 0 1 0 669943152 18653184 219 33554432000 4194304 4625164 140736370842864 18446744073709551615 237290711672 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/19193/statm: 4554 219 182 106 0 57 0

[startup+0.193286 s]
/proc/loadavg: 14.58 14.92 13.35 10/344 19193
/proc/meminfo: memFree=10532320/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=184340 CPUtime=0.2 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 1927 0 0 0 20 0 0 0 25 0 4 0 669943152 188764160 1515 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278577109 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19193/statm: 46085 1515 343 106 0 41588 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 184340

[startup+0.200171 s]
/proc/loadavg: 14.58 14.92 13.35 10/344 19193
/proc/meminfo: memFree=10532320/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=184032 CPUtime=0.21 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 1993 0 0 0 21 0 0 0 25 0 4 0 669943152 188448768 1469 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519275 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 46008 1469 343 106 0 41511 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 184032

[startup+0.300155 s]
/proc/loadavg: 14.58 14.92 13.35 10/344 19193
/proc/meminfo: memFree=10532320/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=184740 CPUtime=0.3 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 2356 0 0 0 30 0 0 0 25 0 4 0 669943152 189173760 1832 33554432000 4194304 4625164 140736370842864 18446744073709551615 4329208 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 46185 1832 343 106 0 41688 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 184740

[startup+0.701084 s]
/proc/loadavg: 14.58 14.92 13.35 10/344 19193
/proc/meminfo: memFree=10532320/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=252984 CPUtime=0.7 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 3934 0 0 0 70 0 0 0 25 0 4 0 669943152 259055616 3054 33554432000 4194304 4625164 140736370842864 18446744073709551615 4338094 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 63246 3054 343 106 0 58749 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 252984

[startup+1.50094 s]
/proc/loadavg: 14.58 14.92 13.35 14/354 19222
/proc/meminfo: memFree=10500356/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=256712 CPUtime=1.64 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 7466 0 0 0 163 1 0 0 25 0 4 0 669943152 262873088 5391 33554432000 4194304 4625164 140736370842864 18446744073709551615 4338031 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19193/statm: 64178 5391 343 106 0 59681 0
[pid=19193/tid=19195] ppid=19191 vsize=256712 CPUtime=0.3 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 2201 0 0 0 30 0 0 0 25 0 4 0 669943153 262873088 5391 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278984686 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=256712 CPUtime=0.33 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 2378 0 0 0 33 0 0 0 25 0 4 0 669943153 262873088 5391 33554432000 4194304 4625164 140736370842864 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=256712 CPUtime=0.3 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 714 0 0 0 30 0 0 0 25 0 4 0 669943153 262873088 5391 33554432000 4194304 4625164 140736370842864 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.64
Current children cumulated vsize (KiB) 256712

[startup+3.10066 s]
/proc/loadavg: 14.58 14.92 13.35 16/354 19224
/proc/meminfo: memFree=10471968/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=268444 CPUtime=4.28 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 16102 0 0 0 426 2 0 0 25 0 4 0 669943152 274886656 10419 33554432000 4194304 4625164 140736370842864 18446744073709551615 4356595 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19193/statm: 67111 10419 344 106 0 62614 0
[pid=19193/tid=19195] ppid=19191 vsize=268444 CPUtime=0.87 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 5045 0 0 0 87 0 0 0 25 0 4 0 669943153 274886656 10419 33554432000 4194304 4625164 140736370842864 18446744073709551615 4295470 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=268444 CPUtime=1 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 6007 0 0 0 99 1 0 0 25 0 4 0 669943153 274886656 10419 33554432000 4194304 4625164 140736370842864 18446744073709551615 4467248 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=268444 CPUtime=0.99 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1355 0 0 0 99 0 0 0 25 0 4 0 669943153 274886656 10419 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.28
Current children cumulated vsize (KiB) 268444

[startup+6.30109 s]
/proc/loadavg: 14.70 14.94 13.37 16/354 19224
/proc/meminfo: memFree=10421608/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=289308 CPUtime=9.16 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 26430 0 0 0 913 3 0 0 25 0 4 0 669943152 296251392 17420 33554432000 4194304 4625164 140736370842864 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 72327 17420 428 106 0 67830 0
[pid=19193/tid=19195] ppid=19191 vsize=289308 CPUtime=2.16 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) D 19191 19193 19071 0 -1 4202560 8762 0 0 0 215 1 0 0 25 0 4 0 669943153 296251392 17420 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278922935 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=289308 CPUtime=2.11 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) D 19191 19193 19071 0 -1 4202560 9582 0 0 0 210 1 0 0 25 0 4 0 669943153 296251392 17420 33554432000 4194304 4625164 140736370842864 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=289308 CPUtime=2.12 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 2712 0 0 0 212 0 0 0 25 0 4 0 669943153 296251392 17420 33554432000 4194304 4625164 140736370842864 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9.16
Current children cumulated vsize (KiB) 289308

[startup+12.7009 s]
/proc/loadavg: 14.72 14.94 13.37 14/354 19224
/proc/meminfo: memFree=10366116/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=304116 CPUtime=22.71 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 41786 0 0 0 2264 7 0 0 25 0 4 0 669943152 311414784 25583 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519559 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 76029 25583 344 106 0 71532 0
[pid=19193/tid=19195] ppid=19191 vsize=304116 CPUtime=5.1 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 13143 0 0 0 507 3 0 0 23 0 4 0 669943153 311414784 25583 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=304116 CPUtime=5.09 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 14867 0 0 0 507 2 0 0 22 0 4 0 669943153 311414784 25583 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=304116 CPUtime=3.99 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 5631 0 0 0 399 0 0 0 25 0 4 0 669943153 311414784 25583 33554432000 4194304 4625164 140736370842864 18446744073709551615 4547365 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 22.71
Current children cumulated vsize (KiB) 304116

[startup+25.5007 s]
/proc/loadavg: 15.08 15.00 13.42 17/355 19225
/proc/meminfo: memFree=10222892/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=378816 CPUtime=53.82 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 83082 0 0 0 5369 13 0 0 25 0 4 0 669943152 387907584 47861 33554432000 4194304 4625164 140736370842864 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 94704 47861 796 106 0 90207 0
[pid=19193/tid=19195] ppid=19191 vsize=378816 CPUtime=11.4 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 18107 0 0 0 1136 4 0 0 25 0 4 0 669943153 387907584 47861 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=378816 CPUtime=11.19 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 22111 0 0 0 1115 4 0 0 25 0 4 0 669943153 387907584 47861 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=378816 CPUtime=10.49 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 19487 0 0 0 1047 2 0 0 25 0 4 0 669943153 387907584 47861 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 53.82
Current children cumulated vsize (KiB) 378816

[startup+51.1011 s]
/proc/loadavg: 15.20 15.03 13.47 16/354 19226
/proc/meminfo: memFree=10059440/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=431088 CPUtime=102.33 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 184702 0 0 0 10206 27 0 0 25 0 4 0 669943152 441434112 75893 33554432000 4194304 4625164 140736370842864 18446744073709551615 4392937 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19193/statm: 107772 75893 870 106 0 103275 0
[pid=19193/tid=19195] ppid=19191 vsize=431088 CPUtime=23.7 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 23288 0 0 0 2365 5 0 0 25 0 4 0 669943153 441434112 75893 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=431088 CPUtime=22.89 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 35407 0 0 0 2283 6 0 0 25 0 4 0 669943153 441434112 75893 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278537518 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=431088 CPUtime=22.33 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 71959 0 0 0 2224 9 0 0 25 0 4 0 669943153 441434112 75893 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552395 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 102.33
Current children cumulated vsize (KiB) 431088

[startup+102.301 s]
/proc/loadavg: 15.16 15.04 13.56 16/354 19227
/proc/meminfo: memFree=9838304/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=641468 CPUtime=183.24 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 254336 0 0 0 18284 40 0 0 25 0 4 0 669943152 656863232 107777 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 160367 107777 1014 106 0 155870 0
[pid=19193/tid=19195] ppid=19191 vsize=641468 CPUtime=41.21 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 34022 0 0 0 4113 8 0 0 20 0 4 0 669943153 656863232 107777 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=641468 CPUtime=39.44 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 50439 0 0 0 3933 11 0 0 20 0 4 0 669943153 656863232 107777 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=641468 CPUtime=45.18 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 84746 0 0 0 4507 11 0 0 20 0 4 0 669943153 656863232 107777 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 183.24
Current children cumulated vsize (KiB) 641468

[startup+162.3 s]
/proc/loadavg: 15.17 15.06 13.65 16/354 19229
/proc/meminfo: memFree=9590176/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=817616 CPUtime=305.59 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 564235 0 0 0 30477 82 0 0 25 0 4 0 669943152 837238784 149041 33554432000 4194304 4625164 140736370842864 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19193/statm: 204404 149041 601 106 0 199907 0
[pid=19193/tid=19195] ppid=19191 vsize=817616 CPUtime=76.99 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 49275 0 0 0 7687 12 0 0 19 0 4 0 669943153 837238784 149041 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=817616 CPUtime=67.12 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 69809 0 0 0 6696 16 0 0 19 0 4 0 669943153 837238784 149041 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=817616 CPUtime=69.78 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 164416 0 0 0 6958 20 0 0 25 0 4 0 669943153 837238784 149041 33554432000 4194304 4625164 140736370842864 18446744073709551615 4352102 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 305.59
Current children cumulated vsize (KiB) 817616

[startup+222.314 s]
/proc/loadavg: 15.32 15.11 13.76 16/354 19230
/proc/meminfo: memFree=9343780/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=1021472 CPUtime=421.89 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 713968 0 0 0 42085 104 0 0 25 0 4 0 669943152 1045987328 187072 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19193/statm: 255368 187072 431 106 0 250871 0
[pid=19193/tid=19195] ppid=19191 vsize=1021472 CPUtime=108.88 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 72398 0 0 0 10872 16 0 0 25 0 4 0 669943153 1045987328 187072 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=1021472 CPUtime=95.08 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 79239 0 0 0 9489 19 0 0 25 0 4 0 669943153 1045987328 187072 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=1021472 CPUtime=96.62 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 223993 0 0 0 9634 28 0 0 25 0 4 0 669943153 1045987328 187072 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 421.89
Current children cumulated vsize (KiB) 1021472

[startup+282.301 s]

################
# More data... #
################


[startup+762.301 s]
/proc/loadavg: 15.26 15.15 14.36 13/354 19275
/proc/meminfo: memFree=7761392/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=1967012 CPUtime=1373.24 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) D 19191 19193 19071 0 -1 4202496 1884158 0 0 0 137041 283 0 0 18 0 4 0 669943152 2014220288 392508 33554432000 4194304 4625164 140736370842864 18446744073709551615 4512190 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19193/statm: 491753 392508 415 106 0 487256 0
[pid=19193/tid=19195] ppid=19191 vsize=1967012 CPUtime=340.79 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) D 19191 19193 19071 0 -1 4202560 173297 0 0 0 34034 45 0 0 18 0 4 0 669943153 2014220288 392508 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278540485 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=1967012 CPUtime=326.66 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) D 19191 19193 19071 0 -1 4202560 232356 0 0 0 32611 55 0 0 18 0 4 0 669943153 2014220288 392508 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278922935 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=1967012 CPUtime=341.1 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 924955 0 0 0 33993 117 0 0 25 0 4 0 669943153 2014220288 392508 33554432000 4194304 4625164 140736370842864 18446744073709551615 237278577079 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1373.24
Current children cumulated vsize (KiB) 1967012

[startup+822.301 s]
/proc/loadavg: 15.31 15.18 14.42 16/354 19276
/proc/meminfo: memFree=7603656/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=1971500 CPUtime=1431.2 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 1916300 0 0 0 142832 288 0 0 25 0 4 0 669943152 2018816000 403213 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19193/statm: 492875 403213 928 106 0 488378 0
[pid=19193/tid=19195] ppid=19191 vsize=1971500 CPUtime=348.8 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 174593 0 0 0 34835 45 0 0 25 0 4 0 669943153 2018816000 403213 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=1971500 CPUtime=333.66 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 234238 0 0 0 33310 56 0 0 25 0 4 0 669943153 2018816000 403213 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=1971500 CPUtime=346.14 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 951937 0 0 0 34494 120 0 0 25 0 4 0 669943153 2018816000 403213 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1431.2
Current children cumulated vsize (KiB) 1971500

[startup+882.313 s]
/proc/loadavg: 15.33 15.21 14.47 16/354 19278
/proc/meminfo: memFree=7333936/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2009248 CPUtime=1568.26 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 2077821 0 0 0 156515 311 0 0 25 0 4 0 669943152 2057469952 415249 33554432000 4194304 4625164 140736370842864 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19193/statm: 502312 415249 344 106 0 497815 0
[pid=19193/tid=19195] ppid=19191 vsize=2009248 CPUtime=378.54 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 181126 0 0 0 37806 48 0 0 25 0 4 0 669943153 2057469952 415249 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2009248 CPUtime=363.74 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 238289 0 0 0 36316 58 0 0 25 0 4 0 669943153 2057469952 415249 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2009248 CPUtime=376.06 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1101616 0 0 0 37469 137 0 0 25 0 4 0 669943153 2057469952 415249 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1568.26
Current children cumulated vsize (KiB) 2009248

[startup+942.301 s]
/proc/loadavg: 15.12 15.17 14.50 16/354 19280
/proc/meminfo: memFree=7022936/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2033032 CPUtime=1688.03 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 2276545 0 0 0 168467 336 0 0 25 0 4 0 669943152 2081824768 430824 33554432000 4194304 4625164 140736370842864 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 508258 430824 344 106 0 503761 0
[pid=19193/tid=19195] ppid=19191 vsize=2033032 CPUtime=408.59 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 183828 0 0 0 40811 48 0 0 25 0 4 0 669943153 2081824768 430824 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2033032 CPUtime=393.65 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 242728 0 0 0 39306 59 0 0 25 0 4 0 669943153 2081824768 430824 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2033032 CPUtime=406.03 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1238972 0 0 0 40450 153 0 0 25 0 4 0 669943153 2081824768 430824 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1688.03
Current children cumulated vsize (KiB) 2033032

[startup+1002.3 s]
/proc/loadavg: 15.14 15.17 14.54 16/354 19281
/proc/meminfo: memFree=6781796/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2116556 CPUtime=1807.66 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 2635296 0 0 0 180380 386 0 0 25 0 4 0 669943152 2167353344 457093 33554432000 4194304 4625164 140736370842864 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19193/statm: 529139 457093 1127 106 0 524642 0
[pid=19193/tid=19195] ppid=19191 vsize=2116556 CPUtime=438.55 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 184305 0 0 0 43806 49 0 0 25 0 4 0 669943153 2167353344 457093 33554432000 4194304 4625164 140736370842864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2116556 CPUtime=423.7 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 247588 0 0 0 42309 61 0 0 25 0 4 0 669943153 2167353344 457093 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2116556 CPUtime=435.93 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1404539 0 0 0 43419 174 0 0 25 0 4 0 669943153 2167353344 457093 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1807.66
Current children cumulated vsize (KiB) 2116556

[startup+1062.3 s]
/proc/loadavg: 15.15 15.16 14.58 14/354 19283
/proc/meminfo: memFree=6662116/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2116556 CPUtime=1918.95 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 2918379 0 0 0 191470 425 0 0 25 0 4 0 669943152 2167353344 461780 33554432000 4194304 4625164 140736370842864 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19193/statm: 529139 461780 862 106 0 524642 0
[pid=19193/tid=19195] ppid=19191 vsize=2116556 CPUtime=476.63 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 184362 0 0 0 47614 49 0 0 25 0 4 0 669943153 2167353344 461780 33554432000 4194304 4625164 140736370842864 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2116556 CPUtime=448.48 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 252537 0 0 0 44785 63 0 0 18 0 4 0 669943153 2167353344 461780 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2116556 CPUtime=462.44 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1542851 0 0 0 46053 191 0 0 18 0 4 0 669943153 2167353344 461780 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1918.95
Current children cumulated vsize (KiB) 2116556

[startup+1122.3 s]
/proc/loadavg: 15.15 15.16 14.61 16/354 19284
/proc/meminfo: memFree=6489356/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2323116 CPUtime=2037.85 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 3269324 0 0 0 203312 473 0 0 25 0 4 0 669943152 2378870784 484241 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519341 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19193/statm: 580779 484241 1054 106 0 576282 0
[pid=19193/tid=19195] ppid=19191 vsize=2323116 CPUtime=507.32 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 184486 0 0 0 50683 49 0 0 25 0 4 0 669943153 2378870784 484241 33554432000 4194304 4625164 140736370842864 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2323116 CPUtime=478.22 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 317141 0 0 0 47750 72 0 0 25 0 4 0 669943153 2378870784 484241 33554432000 4194304 4625164 140736370842864 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2323116 CPUtime=492.61 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1694642 0 0 0 49050 211 0 0 25 0 4 0 669943153 2378870784 484241 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2037.85
Current children cumulated vsize (KiB) 2323116

[startup+1182.3 s]
/proc/loadavg: 15.18 15.17 14.65 15/354 19286
/proc/meminfo: memFree=6421352/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2415244 CPUtime=2172.05 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 3682921 0 0 0 216680 525 0 0 25 0 4 0 669943152 2473209856 488023 33554432000 4194304 4625164 140736370842864 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19193/statm: 603811 488023 344 106 0 599314 0
[pid=19193/tid=19195] ppid=19191 vsize=2415244 CPUtime=542.53 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 184563 0 0 0 54204 49 0 0 25 0 4 0 669943153 2473209856 488023 33554432000 4194304 4625164 140736370842864 18446744073709551615 4331104 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2415244 CPUtime=510.96 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 317359 0 0 0 51024 72 0 0 25 0 4 0 669943153 2473209856 488023 33554432000 4194304 4625164 140736370842864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2415244 CPUtime=526.71 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 1898286 0 0 0 52435 236 0 0 25 0 4 0 669943153 2473209856 488023 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2172.05
Current children cumulated vsize (KiB) 2415244

[startup+1242.3 s]
/proc/loadavg: 15.06 15.14 14.67 16/354 19288
/proc/meminfo: memFree=6288664/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2480780 CPUtime=2303.3 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 3982933 0 0 0 229762 568 0 0 25 0 4 0 669943152 2540318720 499361 33554432000 4194304 4625164 140736370842864 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19193/statm: 620195 499361 946 106 0 615698 0
[pid=19193/tid=19195] ppid=19191 vsize=2480780 CPUtime=577.41 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 184567 0 0 0 57692 49 0 0 25 0 4 0 669943153 2540318720 499361 33554432000 4194304 4625164 140736370842864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2480780 CPUtime=540.93 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 317362 0 0 0 54021 72 0 0 25 0 4 0 669943153 2540318720 499361 33554432000 4194304 4625164 140736370842864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2480780 CPUtime=557.53 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 2034786 0 0 0 55498 255 0 0 25 0 4 0 669943153 2540318720 499361 33554432000 4194304 4625164 140736370842864 18446744073709551615 4548692 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2303.3
Current children cumulated vsize (KiB) 2480780



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 15.09 15.13 14.69 16/354 19289
/proc/meminfo: memFree=6198508/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=2480780 CPUtime=2418.73 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) R 19191 19193 19071 0 -1 4202496 4261554 0 0 0 241264 609 0 0 25 0 4 0 669943152 2540318720 502436 33554432000 4194304 4625164 140736370842864 18446744073709551615 4393003 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19193/statm: 620195 502436 1079 106 0 615698 0
[pid=19193/tid=19195] ppid=19191 vsize=2480780 CPUtime=606.25 cores=0,2,4,6
/proc/19193/task/19195/stat : 19195 (SArTagnan) R 19191 19193 19071 0 -1 4202560 184571 0 0 0 60576 49 0 0 25 0 4 0 669943153 2540318720 502416 33554432000 4194304 4625164 140736370842864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19193/tid=19196] ppid=19191 vsize=2480780 CPUtime=569.8 cores=0,2,4,6
/proc/19193/task/19196/stat : 19196 (SArTagnan) R 19191 19193 19071 0 -1 4202560 317364 0 0 0 56908 72 0 0 25 0 4 0 669943153 2540318720 502416 33554432000 4194304 4625164 140736370842864 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=2480780 CPUtime=586.4 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4202560 2176156 0 0 0 58366 274 0 0 25 0 4 0 669943153 2540318720 502416 33554432000 4194304 4625164 140736370842864 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2418.73
Current children cumulated vsize (KiB) 2480780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.12 s]
/proc/loadavg: 15.09 15.13 14.69 16/354 19289
/proc/meminfo: memFree=6198508/32950904 swapFree=67057400/67111528
[pid=19193] ppid=19191 vsize=0 CPUtime=2418.81 cores=0,2,4,6
/proc/19193/stat : 19193 (SArTagnan) Z 19191 19193 19071 0 -1 4203548 4261554 0 0 0 241265 616 0 0 25 0 2 0 669943152 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19193/statm: 0 0 0 0 0 0 0
[pid=19193/tid=19197] ppid=19191 vsize=0 CPUtime=586.48 cores=0,2,4,6
/proc/19193/task/19197/stat : 19197 (SArTagnan) R 19191 19193 19071 0 -1 4203588 2176156 0 0 0 58366 282 0 0 25 0 2 0 669943153 0 0 33554432000 0 0 0 0 0 0 2147483391 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2418.81
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.2
CPU time (s): 2418.83
CPU user time (s): 2412.66
CPU system time (s): 6.16906
CPU usage (%): 186.035
Max. virtual memory (cumulated for all children) (KiB): 2618456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2412.66
system time used= 6.16906
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4261554
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15778
involuntary context switches= 30420

runsolver used 4.07938 second user time and 10.1455 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-17 00:03:54
IDJOB=3386047
IDBENCH=87811
IDSOLVER=1871
FILE ID=node121/3386047-1305583434
RUNJOBID= node121-1305582131-19089
PBS_JOBID= 13350299
Free space on /tmp= 73424 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT02/handmade/zhang-lintao/xor-chain/x1_80.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386047-1305583434/watcher-3386047-1305583434 -o /tmp/evaluation-result-3386047-1305583434/solver-3386047-1305583434 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386047-1305583434.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 53a7d1541ad9c0dde902ec3a505ae8fc
RANDOM SEED=412212672

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      10532848 kB
Buffers:        340544 kB
Cached:        7022348 kB
SwapCached:       7656 kB
Active:       16364380 kB
Inactive:      5672940 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      10532848 kB
SwapTotal:    67111528 kB
SwapFree:     67057400 kB
Dirty:             416 kB
Writeback:           0 kB
AnonPages:    14671832 kB
Mapped:          28772 kB
Slab:           267152 kB
PageTables:      49628 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 66521420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73424 MiB
End job on node121 at 2011-05-17 00:25:36