Trace number 3385850

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4353.33 1300.14

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf
MD5SUM002a4cb53ea02f66e0c3418dc8834f7c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.82957
Satisfiable
(Un)Satisfiability was proved
Number of variables2561
Number of clauses490309
Sum of the clauses size983079
Maximum clause length52
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2490259
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385850-1305583493/watcher-3385850-1305583493 -o /tmp/evaluation-result-3385850-1305583493/solver-3385850-1305583493 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385850-1305583493.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.80 9.99 8.22 8/332 20750
/proc/meminfo: memFree=24012924/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=31028 CPUtime=0 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 953 0 0 0 0 0 0 0 25 0 1 0 748579907 31772672 601 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020395776 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/20750/statm: 7757 601 296 106 0 3260 0

[startup+0.113671 s]
/proc/loadavg: 9.80 9.99 8.22 8/332 20750
/proc/meminfo: memFree=24012924/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=38508 CPUtime=0.1 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 6006 0 0 0 9 1 0 0 25 0 1 0 748579907 39432192 1915 33554432000 4194304 4625164 140734795247584 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/20750/statm: 9627 1915 296 106 0 5130 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 38508

[startup+0.200624 s]
/proc/loadavg: 9.80 9.99 8.22 8/332 20750
/proc/meminfo: memFree=24012924/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=160908 CPUtime=0.25 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 11301 0 0 0 24 1 0 0 25 0 4 0 748579907 164769792 7208 33554432000 4194304 4625164 140734795247584 18446744073709551615 4499444 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/20750/statm: 40227 7208 331 106 0 35730 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 160908

[startup+0.300606 s]
/proc/loadavg: 9.80 9.99 8.22 8/332 20750
/proc/meminfo: memFree=24012924/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=163324 CPUtime=0.45 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 13143 0 0 0 44 1 0 0 25 0 4 0 748579907 167243776 9049 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020500974 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20750/statm: 40831 9049 338 106 0 36334 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 163324

[startup+0.700532 s]
/proc/loadavg: 9.80 9.99 8.22 8/332 20750
/proc/meminfo: memFree=24012924/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=234800 CPUtime=1.25 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 17947 0 0 0 123 2 0 0 25 0 4 0 748579907 240435200 13853 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020093315 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/20750/statm: 58700 13853 341 106 0 54203 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 234800

[startup+1.50039 s]
/proc/loadavg: 9.80 9.99 8.22 11/336 20754
/proc/meminfo: memFree=23945560/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=252200 CPUtime=3.21 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 24319 0 0 0 318 3 0 0 25 0 4 0 748579907 258252800 20191 33554432000 4194304 4625164 140734795247584 18446744073709551615 4511795 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/20750/statm: 63050 20191 342 106 0 58553 0
[pid=20750/tid=20752] ppid=20748 vsize=252200 CPUtime=0.83 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 2291 0 0 0 83 0 0 0 25 0 4 0 748579920 258252800 20191 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020054278 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=252200 CPUtime=1.11 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 4263 0 0 0 111 0 0 0 25 0 4 0 748579920 258252800 20191 33554432000 4194304 4625164 140734795247584 18446744073709551615 4462579 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=252200 CPUtime=0.61 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1230 0 0 0 61 0 0 0 25 0 4 0 748579920 258252800 20191 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020500974 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.21
Current children cumulated vsize (KiB) 252200

[startup+3.10109 s]
/proc/loadavg: 9.80 9.99 8.22 11/336 20754
/proc/meminfo: memFree=23915052/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=329420 CPUtime=6.7 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 29597 0 0 0 666 4 0 0 18 0 4 0 748579907 337326080 25390 33554432000 4194304 4625164 140734795247584 18446744073709551615 4512032 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20750/statm: 82355 25390 343 106 0 77858 0
[pid=20750/tid=20752] ppid=20748 vsize=329420 CPUtime=1.4 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 3479 0 0 0 140 0 0 0 25 0 4 0 748579920 337326080 25390 33554432000 4194304 4625164 140734795247584 18446744073709551615 4288789 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=329420 CPUtime=1.93 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 6560 0 0 0 192 1 0 0 25 0 4 0 748579920 337326080 25390 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020439223 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=329420 CPUtime=1.5 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 2164 0 0 0 150 0 0 0 25 0 4 0 748579920 337326080 25390 33554432000 4194304 4625164 140734795247584 18446744073709551615 4375379 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.7
Current children cumulated vsize (KiB) 329420

[startup+6.30051 s]
/proc/loadavg: 9.81 9.99 8.23 11/336 20754
/proc/meminfo: memFree=23870292/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=333680 CPUtime=13.47 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 40562 0 0 0 1340 7 0 0 21 0 4 0 748579907 341688320 34142 33554432000 4194304 4625164 140734795247584 18446744073709551615 4512432 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20750/statm: 83420 34142 357 106 0 78923 0
[pid=20750/tid=20752] ppid=20748 vsize=333680 CPUtime=2.81 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 5564 0 0 0 280 1 0 0 25 0 4 0 748579920 341688320 34142 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352183 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=333680 CPUtime=3.9 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 11344 0 0 0 388 2 0 0 20 0 4 0 748579920 341688320 34142 33554432000 4194304 4625164 140734795247584 18446744073709551615 4464363 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=333680 CPUtime=2.6 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 3340 0 0 0 260 0 0 0 25 0 4 0 748579920 341688320 34142 33554432000 4194304 4625164 140734795247584 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13.47
Current children cumulated vsize (KiB) 333680

[startup+12.7003 s]
/proc/loadavg: 9.91 10.01 8.25 11/336 20754
/proc/meminfo: memFree=23798304/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=386724 CPUtime=32.14 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 72170 0 0 0 3201 13 0 0 25 0 4 0 748579907 396005376 50777 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393112 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20750/statm: 96681 50778 354 106 0 92184 0
[pid=20750/tid=20752] ppid=20748 vsize=386724 CPUtime=8.7 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 15214 0 0 0 867 3 0 0 25 0 4 0 748579920 396005376 50778 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=386724 CPUtime=7.11 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 16283 0 0 0 708 3 0 0 25 0 4 0 748579920 396005376 50778 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=386724 CPUtime=6.23 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 15426 0 0 0 621 2 0 0 25 0 4 0 748579920 396005376 50778 33554432000 4194304 4625164 140734795247584 18446744073709551615 4328819 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 32.14
Current children cumulated vsize (KiB) 386724

[startup+25.501 s]
/proc/loadavg: 10.00 10.02 8.28 11/336 20754
/proc/meminfo: memFree=23672564/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=486016 CPUtime=70.36 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 123450 0 0 0 7013 23 0 0 25 0 4 0 748579907 497680384 71570 33554432000 4194304 4625164 140734795247584 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20750/statm: 121504 71570 343 106 0 117007 0
[pid=20750/tid=20752] ppid=20748 vsize=486016 CPUtime=18.11 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 26533 0 0 0 1804 7 0 0 20 0 4 0 748579920 497680384 71570 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=486016 CPUtime=14.2 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 26540 0 0 0 1414 6 0 0 20 0 4 0 748579920 497680384 71570 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=486016 CPUtime=15.16 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 44225 0 0 0 1511 5 0 0 25 0 4 0 748579920 497680384 71570 33554432000 4194304 4625164 140734795247584 18446744073709551615 260020093099 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 70.36
Current children cumulated vsize (KiB) 486016

[startup+51.1013 s]
/proc/loadavg: 10.07 10.03 8.33 11/336 20755
/proc/meminfo: memFree=23412072/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=678840 CPUtime=146.86 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 316211 0 0 0 14633 53 0 0 25 0 4 0 748579907 695132160 125559 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20750/statm: 169710 125559 375 106 0 165213 0
[pid=20750/tid=20752] ppid=20748 vsize=678840 CPUtime=39.97 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 46573 0 0 0 3984 13 0 0 25 0 4 0 748579920 695132160 125559 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=678840 CPUtime=28.3 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 40018 0 0 0 2820 10 0 0 25 0 4 0 748579920 695132160 125559 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=678840 CPUtime=30.51 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 149847 0 0 0 3032 19 0 0 25 0 4 0 748579920 695132160 125559 33554432000 4194304 4625164 140734795247584 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 146.86
Current children cumulated vsize (KiB) 678840

[startup+102.301 s]
/proc/loadavg: 10.19 10.06 8.42 11/336 20756
/proc/meminfo: memFree=22965656/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=1139052 CPUtime=299.9 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 734373 0 0 0 29875 115 0 0 25 0 4 0 748579907 1166389248 217039 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/20750/statm: 284763 217039 530 106 0 280266 0
[pid=20750/tid=20752] ppid=20748 vsize=1139052 CPUtime=72.32 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 68940 0 0 0 7210 22 0 0 25 0 4 0 748579920 1166389248 217039 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=1139052 CPUtime=71.47 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 77911 0 0 0 7127 20 0 0 25 0 4 0 748579920 1166389248 217039 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=1139052 CPUtime=62.17 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 362172 0 0 0 6173 44 0 0 25 0 4 0 748579920 1166389248 217039 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 299.9
Current children cumulated vsize (KiB) 1139052

[startup+162.301 s]
/proc/loadavg: 10.07 10.05 8.52 11/336 20758
/proc/meminfo: memFree=22646428/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=1352792 CPUtime=479.23 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 1013494 0 0 0 47764 159 0 0 25 0 4 0 748579907 1385259008 275616 33554432000 4194304 4625164 140734795247584 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20750/statm: 338198 275616 343 106 0 333701 0
[pid=20750/tid=20752] ppid=20748 vsize=1352792 CPUtime=116.95 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 77731 0 0 0 11669 26 0 0 25 0 4 0 748579920 1385259008 275616 33554432000 4194304 4625164 140734795247584 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=1352792 CPUtime=109.49 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 93084 0 0 0 10923 26 0 0 25 0 4 0 748579920 1385259008 275616 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=1352792 CPUtime=104.49 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 501072 0 0 0 10387 62 0 0 25 0 4 0 748579920 1385259008 275616 33554432000 4194304 4625164 140734795247584 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 479.23
Current children cumulated vsize (KiB) 1352792

[startup+222.313 s]
/proc/loadavg: 10.02 10.04 8.61 11/336 20760
/proc/meminfo: memFree=22423292/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=1507092 CPUtime=658.63 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 1267934 0 0 0 65661 202 0 0 25 0 4 0 748579907 1543262208 303676 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393127 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20750/statm: 376773 303676 449 106 0 372276 0
[pid=20750/tid=20752] ppid=20748 vsize=1507092 CPUtime=167 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 77923 0 0 0 16674 26 0 0 25 0 4 0 748579920 1543262208 303676 33554432000 4194304 4625164 140734795247584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=1507092 CPUtime=151.5 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 112648 0 0 0 15118 32 0 0 25 0 4 0 748579920 1543262208 303676 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330879 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=1507092 CPUtime=135.94 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 694384 0 0 0 13502 92 0 0 25 0 4 0 748579920 1543262208 303676 33554432000 4194304 4625164 140734795247584 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 658.63
Current children cumulated vsize (KiB) 1507092

[startup+282.301 s]

################
# More data... #
################


[startup+762.301 s]
/proc/loadavg: 10.09 10.10 9.26 11/336 20774
/proc/meminfo: memFree=20992744/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=1988004 CPUtime=2273.15 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2017812 0 0 0 226991 324 0 0 25 0 4 0 748579907 2035716096 419344 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/20750/statm: 497001 419344 462 106 0 492504 0
[pid=20750/tid=20752] ppid=20748 vsize=1988004 CPUtime=486.88 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 93774 0 0 0 48660 28 0 0 25 0 4 0 748579920 2035716096 419344 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=1988004 CPUtime=637.65 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 118910 0 0 0 63729 36 0 0 25 0 4 0 748579920 2035716096 419344 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330621 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=1988004 CPUtime=527.06 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1164004 0 0 0 52538 168 0 0 25 0 4 0 748579920 2035716096 419344 33554432000 4194304 4625164 140734795247584 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2273.15
Current children cumulated vsize (KiB) 1988004

[startup+822.301 s]
/proc/loadavg: 10.03 10.08 9.30 11/336 20776
/proc/meminfo: memFree=20758924/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=2330156 CPUtime=2452.51 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2211541 0 0 0 244903 348 0 0 25 0 4 0 748579907 2386079744 450217 33554432000 4194304 4625164 140734795247584 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/20750/statm: 582539 450217 462 106 0 578042 0
[pid=20750/tid=20752] ppid=20748 vsize=2330156 CPUtime=527.52 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 94024 0 0 0 52724 28 0 0 25 0 4 0 748579920 2386079744 450217 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330590 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=2330156 CPUtime=697.03 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 119558 0 0 0 69666 37 0 0 25 0 4 0 748579920 2386079744 450217 33554432000 4194304 4625164 140734795247584 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=2330156 CPUtime=576.6 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1168874 0 0 0 57491 169 0 0 25 0 4 0 748579920 2386079744 450217 33554432000 4194304 4625164 140734795247584 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2452.51
Current children cumulated vsize (KiB) 2330156

[startup+882.313 s]
/proc/loadavg: 7.52 9.35 9.10 7/327 20794
/proc/meminfo: memFree=22257048/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=2373364 CPUtime=2686.64 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2233495 0 0 0 268311 353 0 0 25 0 4 0 748579907 2430324736 460596 33554432000 4194304 4625164 140734795247584 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 593341 460596 456 106 0 588844 0
[pid=20750/tid=20752] ppid=20748 vsize=2373364 CPUtime=587.53 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 94222 0 0 0 58725 28 0 0 25 0 4 0 748579920 2430324736 460596 33554432000 4194304 4625164 140734795247584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=2373364 CPUtime=756.44 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 120002 0 0 0 75606 38 0 0 25 0 4 0 748579920 2430324736 460596 33554432000 4194304 4625164 140734795247584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=2373364 CPUtime=633.92 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1186252 0 0 0 63220 172 0 0 25 0 4 0 748579920 2430324736 460596 33554432000 4194304 4625164 140734795247584 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2686.64
Current children cumulated vsize (KiB) 2373364

[startup+942.301 s]
/proc/loadavg: 6.56 8.74 8.90 7/327 20796
/proc/meminfo: memFree=22209508/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=2413736 CPUtime=2926.01 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2255704 0 0 0 292242 359 0 0 25 0 4 0 748579907 2471665664 471342 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 603434 471342 440 106 0 598937 0
[pid=20750/tid=20752] ppid=20748 vsize=2413736 CPUtime=647.52 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 94402 0 0 0 64724 28 0 0 25 0 4 0 748579920 2471665664 471342 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330968 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=2413736 CPUtime=815.83 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 120481 0 0 0 81544 39 0 0 25 0 4 0 748579920 2471665664 471342 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=2413736 CPUtime=693.91 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1191124 0 0 0 69218 173 0 0 25 0 4 0 748579920 2471665664 471342 33554432000 4194304 4625164 140734795247584 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2926.01
Current children cumulated vsize (KiB) 2413736

[startup+1002.3 s]
/proc/loadavg: 6.23 8.25 8.72 7/327 20797
/proc/meminfo: memFree=22112652/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=2435412 CPUtime=3165.39 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2281299 0 0 0 316160 379 0 0 25 0 4 0 748579907 2493861888 493631 33554432000 4194304 4625164 140734795247584 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 608853 493631 347 106 0 604356 0
[pid=20750/tid=20752] ppid=20748 vsize=2435412 CPUtime=707.53 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 94997 0 0 0 70724 29 0 0 25 0 4 0 748579920 2493861888 493631 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=2435412 CPUtime=875.2 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 124690 0 0 0 87471 49 0 0 25 0 4 0 748579920 2493861888 493631 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=2435412 CPUtime=753.91 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1197048 0 0 0 75217 174 0 0 25 0 4 0 748579920 2493861888 493631 33554432000 4194304 4625164 140734795247584 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3165.39
Current children cumulated vsize (KiB) 2435412

[startup+1062.3 s]
/proc/loadavg: 6.16 7.85 8.56 7/327 20799
/proc/meminfo: memFree=21876916/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=2566484 CPUtime=3404.79 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2344322 0 0 0 340010 469 0 0 25 0 4 0 748579907 2628079616 550698 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393147 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 641621 550698 344 106 0 637124 0
[pid=20750/tid=20752] ppid=20748 vsize=2566484 CPUtime=767.52 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 95941 0 0 0 76723 29 0 0 25 0 4 0 748579920 2628079616 550698 33554432000 4194304 4625164 140734795247584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=2566484 CPUtime=934.62 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 154289 0 0 0 93343 119 0 0 25 0 4 0 748579920 2628079616 550698 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=2566484 CPUtime=813.91 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1198072 0 0 0 81216 175 0 0 25 0 4 0 748579920 2628079616 550698 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3404.79
Current children cumulated vsize (KiB) 2566484

[startup+1122.3 s]
/proc/loadavg: 6.12 7.53 8.40 7/327 20801
/proc/meminfo: memFree=21622836/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=3153948 CPUtime=3644.15 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 2669393 0 0 0 363879 536 0 0 25 0 4 0 748579907 3229642752 611195 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393089 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 788487 611195 344 106 0 783990 0
[pid=20750/tid=20752] ppid=20748 vsize=3153948 CPUtime=827.53 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 96898 0 0 0 82723 30 0 0 25 0 4 0 748579920 3229642752 611195 33554432000 4194304 4625164 140734795247584 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=3153948 CPUtime=993.98 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 181968 0 0 0 99254 144 0 0 25 0 4 0 748579920 3229642752 611195 33554432000 4194304 4625164 140734795247584 18446744073709551615 4316865 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=3153948 CPUtime=873.91 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1200832 0 0 0 87216 175 0 0 25 0 4 0 748579920 3229642752 611195 33554432000 4194304 4625164 140734795247584 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3644.15
Current children cumulated vsize (KiB) 3153948

[startup+1182.3 s]
/proc/loadavg: 6.11 7.26 8.25 7/327 20802
/proc/meminfo: memFree=21441792/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=3291744 CPUtime=3883.54 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 3148491 0 0 0 387703 651 0 0 25 0 4 0 748579907 3370745856 655459 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393051 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 822936 655459 343 106 0 818439 0
[pid=20750/tid=20752] ppid=20748 vsize=3291744 CPUtime=887.53 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 97724 0 0 0 88723 30 0 0 25 0 4 0 748579920 3370745856 655459 33554432000 4194304 4625164 140734795247584 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=3291744 CPUtime=1053.38 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 198526 0 0 0 105150 188 0 0 25 0 4 0 748579920 3370745856 655459 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=3291744 CPUtime=933.89 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 1620423 0 0 0 93155 234 0 0 25 0 4 0 748579920 3370745856 655459 33554432000 4194304 4625164 140734795247584 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3883.54
Current children cumulated vsize (KiB) 3291744

[startup+1242.3 s]
/proc/loadavg: 6.09 7.05 8.11 7/327 20804
/proc/meminfo: memFree=21301044/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=3297412 CPUtime=4122.93 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 3742799 0 0 0 411524 769 0 0 25 0 4 0 748579907 3376549888 689230 33554432000 4194304 4625164 140734795247584 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 824353 689230 343 106 0 819856 0
[pid=20750/tid=20752] ppid=20748 vsize=3297412 CPUtime=947.53 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 98387 0 0 0 94723 30 0 0 25 0 4 0 748579920 3376549888 689230 33554432000 4194304 4625164 140734795247584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=3297412 CPUtime=1112.77 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 205419 0 0 0 111071 206 0 0 25 0 4 0 748579920 3376549888 689230 33554432000 4194304 4625164 140734795247584 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=3297412 CPUtime=993.88 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 2183857 0 0 0 99072 316 0 0 25 0 4 0 748579920 3376549888 689230 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4122.93
Current children cumulated vsize (KiB) 3297412



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 6.03 6.85 7.98 7/327 20805
/proc/meminfo: memFree=21140336/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=3393092 CPUtime=4353.17 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) R 20748 20750 20571 0 -1 4202496 4274784 0 0 0 434420 897 0 0 25 0 4 0 748579907 3474526208 726515 33554432000 4194304 4625164 140734795247584 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 848273 726515 343 106 0 843776 0
[pid=20750/tid=20752] ppid=20748 vsize=3393092 CPUtime=1005.25 cores=0,2,4,6
/proc/20750/task/20752/stat : 20752 (SArTagnan) R 20748 20750 20571 0 -1 4202560 115038 0 0 0 100493 32 0 0 25 0 4 0 748579920 3474526208 726517 33554432000 4194304 4625164 140734795247584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=3393092 CPUtime=1169.9 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4202560 221463 0 0 0 116737 253 0 0 25 0 4 0 748579920 3474526208 726517 33554432000 4194304 4625164 140734795247584 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20750/tid=20754] ppid=20748 vsize=3393092 CPUtime=1051.58 cores=0,2,4,6
/proc/20750/task/20754/stat : 20754 (SArTagnan) R 20748 20750 20571 0 -1 4202560 2662819 0 0 0 104776 382 0 0 25 0 4 0 748579920 3474526208 726517 33554432000 4194304 4625164 140734795247584 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4353.17
Current children cumulated vsize (KiB) 3393092

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.12 s]
/proc/loadavg: 6.03 6.85 7.98 7/327 20805
/proc/meminfo: memFree=21140336/32951124 swapFree=67083432/67111528
[pid=20750] ppid=20748 vsize=0 CPUtime=4353.3 cores=0,2,4,6
/proc/20750/stat : 20750 (SArTagnan) Z 20748 20750 20571 0 -1 4203548 4274857 0 0 0 434423 907 0 0 25 0 2 0 748579907 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20750/statm: 0 0 0 0 0 0 0
[pid=20750/tid=20753] ppid=20748 vsize=0 CPUtime=1170.01 cores=0,2,4,6
/proc/20750/task/20753/stat : 20753 (SArTagnan) R 20748 20750 20571 0 -1 4203588 221467 0 0 0 116738 263 0 0 25 0 2 0 748579920 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4353.3
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.14
CPU time (s): 4353.33
CPU user time (s): 4344.23
CPU system time (s): 9.09562
CPU usage (%): 334.835
Max. virtual memory (cumulated for all children) (KiB): 4126596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4344.23
system time used= 9.09562
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4274857
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8061
involuntary context switches= 35727

runsolver used 3.90141 second user time and 9.28259 second system time

The end

Launcher Data 

Begin job on node110 at 2011-05-17 00:04:53
IDJOB=3385850
IDBENCH=88207
IDSOLVER=1871
FILE ID=node110/3385850-1305583493
RUNJOBID= node110-1305582132-20589
PBS_JOBID= 13350306
Free space on /tmp= 73500 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385850-1305583493/watcher-3385850-1305583493 -o /tmp/evaluation-result-3385850-1305583493/solver-3385850-1305583493 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385850-1305583493.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 002a4cb53ea02f66e0c3418dc8834f7c
RANDOM SEED=305163811

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24013320 kB
Buffers:        290956 kB
Cached:        3231116 kB
SwapCached:       1416 kB
Active:        5446092 kB
Inactive:      3160932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24013320 kB
SwapTotal:    67111528 kB
SwapFree:     67083432 kB
Dirty:            6656 kB
Writeback:          24 kB
AnonPages:     5083172 kB
Mapped:          29100 kB
Slab:           236384 kB
PageTables:      30244 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77505796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73500 MiB
End job on node110 at 2011-05-17 00:26:35