Trace number 3386258

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3041.98 1300.14

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UCG-15-10p1.cnf
MD5SUM484dad50fb275faff8eff92c4d5447cb
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark250.24
Satisfiable
(Un)Satisfiability was proved
Number of variables200003
Number of clauses1019221
Sum of the clauses size2431032
Maximum clause length10
Minimum clause length1
Number of clauses of size 110249
Number of clauses of size 2759013
Number of clauses of size 3198999
Number of clauses of size 45660
Number of clauses of size 522640
Number of clauses of size over 522660

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386258-1305577761/watcher-3386258-1305577761 -o /tmp/evaluation-result-3386258-1305577761/solver-3386258-1305577761 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386258-1305577761.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.09 11.13 11.11 9/447 11756
/proc/meminfo: memFree=20747232/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=19916 CPUtime=0 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 782 0 0 0 0 0 0 0 20 0 1 0 650192032 20393984 721 33554432000 4194304 4625164 140733245683440 18446744073709551615 4296876 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11756/statm: 4979 721 291 106 0 482 0

[startup+0.117252 s]
/proc/loadavg: 11.09 11.13 11.11 9/447 11756
/proc/meminfo: memFree=20747232/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=66404 CPUtime=0.1 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 8228 0 0 0 9 1 0 0 20 0 1 0 650192032 67997696 5461 33554432000 4194304 4625164 140733245683440 18446744073709551615 4257204 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/11756/statm: 16601 5461 296 106 0 12104 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 66404

[startup+0.217234 s]
/proc/loadavg: 11.09 11.13 11.11 9/447 11756
/proc/meminfo: memFree=20747232/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=77944 CPUtime=0.19 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 12293 0 0 0 18 1 0 0 21 0 1 0 650192032 79814656 8139 33554432000 4194304 4625164 140733245683440 18446744073709551615 4360320 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/11756/statm: 19486 8139 296 106 0 14989 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 77944

[startup+0.300219 s]
/proc/loadavg: 11.09 11.13 11.11 9/447 11756
/proc/meminfo: memFree=20747232/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=81184 CPUtime=0.28 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 13684 0 0 0 26 2 0 0 21 0 1 0 650192032 83132416 9530 33554432000 4194304 4625164 140733245683440 18446744073709551615 4585936 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/11756/statm: 20296 9530 296 106 0 15799 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 81184

[startup+0.700152 s]
/proc/loadavg: 11.09 11.13 11.11 9/447 11756
/proc/meminfo: memFree=20747232/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=388376 CPUtime=0.85 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 51065 0 0 0 80 5 0 0 23 0 4 0 650192032 397697024 44829 33554432000 4194304 4625164 140733245683440 18446744073709551615 233509955846 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/11756/statm: 97094 44829 329 106 0 92597 0
Current children cumulated CPU time (s) 0.85
Current children cumulated vsize (KiB) 388376

[startup+1.50101 s]
/proc/loadavg: 11.09 11.13 11.11 12/451 11760
/proc/meminfo: memFree=20552156/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=410256 CPUtime=2.85 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 55500 0 0 0 280 5 0 0 25 0 4 0 650192032 420102144 48422 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390671 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/11756/statm: 102564 48422 330 106 0 98067 0
[pid=11756/tid=11758] ppid=11754 vsize=410256 CPUtime=0.47 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1098 0 0 0 47 0 0 0 25 0 4 0 650192083 420102144 48422 33554432000 4194304 4625164 140733245683440 18446744073709551615 4479584 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=410256 CPUtime=0.49 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 3589 0 0 0 49 0 0 0 25 0 4 0 650192083 420102144 48422 33554432000 4194304 4625164 140733245683440 18446744073709551615 4479607 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=410256 CPUtime=0.88 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1937 0 0 0 88 0 0 0 25 0 4 0 650192083 420102144 48422 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477951 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.85
Current children cumulated vsize (KiB) 410256

[startup+3.10072 s]
/proc/loadavg: 11.09 11.13 11.11 12/451 11760
/proc/meminfo: memFree=20554748/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=410256 CPUtime=6.84 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 61149 0 0 0 678 6 0 0 25 0 4 0 650192032 420102144 49502 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390540 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/11756/statm: 102564 49502 331 106 0 98067 0
[pid=11756/tid=11758] ppid=11754 vsize=410256 CPUtime=1.25 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1098 0 0 0 125 0 0 0 25 0 4 0 650192083 420102144 49502 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477961 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=410256 CPUtime=1.29 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 3625 0 0 0 129 0 0 0 25 0 4 0 650192083 420102144 49502 33554432000 4194304 4625164 140733245683440 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=410256 CPUtime=2.48 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 7472 0 0 0 248 0 0 0 25 0 4 0 650192083 420102144 49502 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.84
Current children cumulated vsize (KiB) 410256

[startup+6.30115 s]
/proc/loadavg: 11.08 11.13 11.11 12/451 11760
/proc/meminfo: memFree=20543532/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=410256 CPUtime=14.79 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 74555 0 0 0 1471 8 0 0 25 0 4 0 650192032 420102144 50379 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390603 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/11756/statm: 102564 50379 335 106 0 98067 0
[pid=11756/tid=11758] ppid=11754 vsize=410256 CPUtime=2.8 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1676 0 0 0 280 0 0 0 25 0 4 0 650192083 420102144 50379 33554432000 4194304 4625164 140733245683440 18446744073709551615 4486934 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=410256 CPUtime=2.89 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 4041 0 0 0 289 0 0 0 25 0 4 0 650192083 420102144 50379 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317551 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=410256 CPUtime=5.68 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 19812 0 0 0 567 1 0 0 25 0 4 0 650192083 420102144 50379 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 14.79
Current children cumulated vsize (KiB) 410256

[startup+12.701 s]
/proc/loadavg: 11.16 11.14 11.11 11/451 11760
/proc/meminfo: memFree=20526836/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=427440 CPUtime=32.17 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 93573 0 0 0 3206 11 0 0 25 0 4 0 650192032 437698560 56116 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/11756/statm: 106860 56116 336 106 0 102363 0
[pid=11756/tid=11758] ppid=11754 vsize=427440 CPUtime=7.59 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 4001 0 0 0 759 0 0 0 25 0 4 0 650192083 437698560 56116 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=427440 CPUtime=6.32 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 7810 0 0 0 631 1 0 0 25 0 4 0 650192083 437698560 56116 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=427440 CPUtime=11.79 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 26983 0 0 0 1177 2 0 0 25 0 4 0 650192083 437698560 56116 33554432000 4194304 4625164 140733245683440 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 32.17
Current children cumulated vsize (KiB) 427440

[startup+25.5007 s]
/proc/loadavg: 11.12 11.14 11.11 12/451 11761
/proc/meminfo: memFree=20479464/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=525392 CPUtime=58.66 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 149051 0 0 0 5849 17 0 0 25 0 4 0 650192032 538001408 65739 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/11756/statm: 131348 65739 337 106 0 126851 0
[pid=11756/tid=11758] ppid=11754 vsize=525392 CPUtime=14.24 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 7868 0 0 0 1423 1 0 0 25 0 4 0 650192083 538001408 65739 33554432000 4194304 4625164 140733245683440 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=525392 CPUtime=13.61 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 19563 0 0 0 1359 2 0 0 25 0 4 0 650192083 538001408 65739 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317256 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=525392 CPUtime=18.29 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 53137 0 0 0 1825 4 0 0 25 0 4 0 650192083 538001408 65739 33554432000 4194304 4625164 140733245683440 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 58.66
Current children cumulated vsize (KiB) 525392

[startup+51.1011 s]
/proc/loadavg: 11.16 11.14 11.11 12/451 11761
/proc/meminfo: memFree=20334336/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=649768 CPUtime=117.16 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 239971 0 0 0 11684 32 0 0 25 0 4 0 650192032 665362432 100363 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/11756/statm: 162442 100363 337 106 0 157945 0
[pid=11756/tid=11758] ppid=11754 vsize=649768 CPUtime=27.18 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 15235 0 0 0 2716 2 0 0 25 0 4 0 650192083 665362432 100363 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317339 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=649768 CPUtime=29.86 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 32791 0 0 0 2982 4 0 0 25 0 4 0 650192083 665362432 100363 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317225 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=649768 CPUtime=35.2 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 70741 0 0 0 3513 7 0 0 25 0 4 0 650192083 665362432 100363 33554432000 4194304 4625164 140733245683440 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 117.16
Current children cumulated vsize (KiB) 649768

[startup+102.301 s]
/proc/loadavg: 11.16 11.15 11.11 12/451 11763
/proc/meminfo: memFree=20179304/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=730252 CPUtime=229.22 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 407476 0 0 0 22865 57 0 0 25 0 4 0 650192032 747778048 135130 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/11756/statm: 182563 135130 406 106 0 178066 0
[pid=11756/tid=11758] ppid=11754 vsize=730252 CPUtime=52.95 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 21853 0 0 0 5292 3 0 0 25 0 4 0 650192083 747778048 135130 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288925 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=730252 CPUtime=64.48 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 71163 0 0 0 6438 10 0 0 25 0 4 0 650192083 747778048 135130 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317256 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=730252 CPUtime=60.38 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 151179 0 0 0 6019 19 0 0 25 0 4 0 650192083 747778048 135130 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288925 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 229.22
Current children cumulated vsize (KiB) 730252

[startup+162.301 s]
/proc/loadavg: 11.10 11.13 11.10 12/451 11764
/proc/meminfo: memFree=20041720/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=858280 CPUtime=348.32 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 517338 0 0 0 34756 76 0 0 25 0 4 0 650192032 878878720 164585 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390664 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/11756/statm: 214570 164585 337 106 0 210073 0
[pid=11756/tid=11758] ppid=11754 vsize=858280 CPUtime=82.3 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 30093 0 0 0 8225 5 0 0 25 0 4 0 650192083 878878720 164585 33554432000 4194304 4625164 140733245683440 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=858280 CPUtime=94.23 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 92857 0 0 0 9408 15 0 0 25 0 4 0 650192083 878878720 164585 33554432000 4194304 4625164 140733245683440 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=858280 CPUtime=90.47 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 215985 0 0 0 9018 29 0 0 25 0 4 0 650192083 878878720 164585 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 348.32
Current children cumulated vsize (KiB) 858280

[startup+222.316 s]
/proc/loadavg: 11.16 11.15 11.11 12/451 11766
/proc/meminfo: memFree=19871380/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=1024128 CPUtime=467.48 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 661096 0 0 0 46647 101 0 0 25 0 4 0 650192032 1048707072 201389 33554432000 4194304 4625164 140733245683440 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/11756/statm: 256032 201389 397 106 0 251535 0
[pid=11756/tid=11758] ppid=11754 vsize=1024128 CPUtime=112.88 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 43282 0 0 0 11280 8 0 0 25 0 4 0 650192083 1048707072 201389 33554432000 4194304 4625164 140733245683440 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=1024128 CPUtime=123.57 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 110373 0 0 0 12337 20 0 0 25 0 4 0 650192083 1048707072 201389 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317237 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=1024128 CPUtime=120.27 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 283174 0 0 0 11987 40 0 0 25 0 4 0 650192083 1048707072 201389 33554432000 4194304 4625164 140733245683440 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 467.48
Current children cumulated vsize (KiB) 1024128

[startup+282.301 s]

################
# More data... #
################


[startup+762.301 s]
/proc/loadavg: 11.05 11.14 11.10 12/451 11780
/proc/meminfo: memFree=18269196/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=2740140 CPUtime=1638.87 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2012150 0 0 0 163589 298 0 0 25 0 4 0 650192032 2805903360 537977 33554432000 4194304 4625164 140733245683440 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 685035 537977 464 106 0 680538 0
[pid=11756/tid=11758] ppid=11754 vsize=2740140 CPUtime=431.73 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 85077 0 0 0 43157 16 0 0 25 0 4 0 650192083 2805903360 537977 33554432000 4194304 4625164 140733245683440 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=2740140 CPUtime=412.33 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 174460 0 0 0 41201 32 0 0 25 0 4 0 650192083 2805903360 537977 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317281 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=2740140 CPUtime=411.31 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 846969 0 0 0 41012 119 0 0 25 0 4 0 650192083 2805903360 537977 33554432000 4194304 4625164 140733245683440 18446744073709551615 4339128 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1638.87
Current children cumulated vsize (KiB) 2740140

[startup+822.3 s]
/proc/loadavg: 11.07 11.12 11.09 12/451 11782
/proc/meminfo: memFree=18110272/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=2783488 CPUtime=1760.75 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2137223 0 0 0 175759 316 0 0 25 0 4 0 650192032 2850291712 568093 33554432000 4194304 4625164 140733245683440 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 695872 568093 464 106 0 691375 0
[pid=11756/tid=11758] ppid=11754 vsize=2783488 CPUtime=462.72 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 85611 0 0 0 46256 16 0 0 25 0 4 0 650192083 2850291712 568093 33554432000 4194304 4625164 140733245683440 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=2783488 CPUtime=442.04 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 176903 0 0 0 44171 33 0 0 25 0 4 0 650192083 2850291712 568093 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=2783488 CPUtime=440.84 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 922813 0 0 0 43955 129 0 0 25 0 4 0 650192083 2850291712 568093 33554432000 4194304 4625164 140733245683440 18446744073709551615 4469320 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1760.75
Current children cumulated vsize (KiB) 2783488

[startup+882.317 s]
/proc/loadavg: 11.12 11.13 11.09 12/451 11784
/proc/meminfo: memFree=17946768/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=2863092 CPUtime=1883.07 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2222657 0 0 0 187978 329 0 0 25 0 4 0 650192032 2931806208 593777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 715773 593777 447 106 0 711276 0
[pid=11756/tid=11758] ppid=11754 vsize=2863092 CPUtime=495.64 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 86088 0 0 0 49548 16 0 0 25 0 4 0 650192083 2931806208 593777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=2863092 CPUtime=471.72 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 188442 0 0 0 47138 34 0 0 25 0 4 0 650192083 2931806208 593777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=2863092 CPUtime=470.7 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 977070 0 0 0 46933 137 0 0 25 0 4 0 650192083 2931806208 593777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1883.07
Current children cumulated vsize (KiB) 2863092

[startup+942.301 s]
/proc/loadavg: 11.09 11.12 11.09 12/451 11785
/proc/meminfo: memFree=17873792/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=2894924 CPUtime=2007.4 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2330547 0 0 0 200394 346 0 0 25 0 4 0 650192032 2964402176 608479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 723731 608479 344 106 0 719234 0
[pid=11756/tid=11758] ppid=11754 vsize=2894924 CPUtime=530.62 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 93952 0 0 0 53044 18 0 0 25 0 4 0 650192083 2964402176 608479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4330590 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=2894924 CPUtime=501.6 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 192703 0 0 0 50125 35 0 0 25 0 4 0 650192083 2964402176 608479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=2894924 CPUtime=500.14 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1062543 0 0 0 49865 149 0 0 25 0 4 0 650192083 2964402176 608479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2007.4
Current children cumulated vsize (KiB) 2894924

[startup+1002.3 s]
/proc/loadavg: 11.08 11.11 11.09 13/451 11818
/proc/meminfo: memFree=18299704/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=2974388 CPUtime=2153.27 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2415835 0 0 0 214969 358 0 0 25 0 4 0 650192032 3045773312 622603 33554432000 4194304 4625164 140733245683440 18446744073709551615 4519673 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 743597 622603 344 106 0 739100 0
[pid=11756/tid=11758] ppid=11754 vsize=2974388 CPUtime=577.68 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 94693 0 0 0 57750 18 0 0 25 0 4 0 650192083 3045773312 622603 33554432000 4194304 4625164 140733245683440 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=2974388 CPUtime=531.56 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 196954 0 0 0 53120 36 0 0 25 0 4 0 650192083 3045773312 622603 33554432000 4194304 4625164 140733245683440 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=2974388 CPUtime=531.71 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1133708 0 0 0 53012 159 0 0 25 0 4 0 650192083 3045773312 622603 33554432000 4194304 4625164 140733245683440 18446744073709551615 4554706 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2153.27
Current children cumulated vsize (KiB) 2974388

[startup+1062.3 s]
/proc/loadavg: 11.10 11.11 11.09 13/451 11819
/proc/meminfo: memFree=17945996/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=3191928 CPUtime=2332.35 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2508606 0 0 0 232864 371 0 0 25 0 4 0 650192032 3268534272 677202 33554432000 4194304 4625164 140733245683440 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 797982 677202 347 106 0 793485 0
[pid=11756/tid=11758] ppid=11754 vsize=3191928 CPUtime=636.78 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 94716 0 0 0 63660 18 0 0 25 0 4 0 650192083 3268534272 677202 33554432000 4194304 4625164 140733245683440 18446744073709551615 4482053 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=3191928 CPUtime=582.38 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 197587 0 0 0 58202 36 0 0 25 0 4 0 650192083 3268534272 677202 33554432000 4194304 4625164 140733245683440 18446744073709551615 4479607 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=3191928 CPUtime=561.96 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1160328 0 0 0 56034 162 0 0 25 0 4 0 650192083 3268534272 677202 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477965 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2332.35
Current children cumulated vsize (KiB) 3191928

[startup+1122.3 s]
/proc/loadavg: 11.42 11.18 11.11 13/451 11821
/proc/meminfo: memFree=17860008/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=3191928 CPUtime=2511.41 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2510181 0 0 0 250770 371 0 0 25 0 4 0 650192032 3268534272 678777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 797982 678777 347 106 0 793485 0
[pid=11756/tid=11758] ppid=11754 vsize=3191928 CPUtime=695.85 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 94716 0 0 0 69567 18 0 0 25 0 4 0 650192083 3268534272 678777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477982 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=3191928 CPUtime=642.37 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 197587 0 0 0 64201 36 0 0 25 0 4 0 650192083 3268534272 678777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477982 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=3191928 CPUtime=591.96 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1160328 0 0 0 59034 162 0 0 25 0 4 0 650192083 3268534272 678777 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477885 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2511.41
Current children cumulated vsize (KiB) 3191928

[startup+1182.3 s]
/proc/loadavg: 11.33 11.20 11.12 13/451 11822
/proc/meminfo: memFree=17792984/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=3191928 CPUtime=2690.5 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2511863 0 0 0 268678 372 0 0 25 0 4 0 650192032 3268534272 680459 33554432000 4194304 4625164 140733245683440 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 797982 680459 347 106 0 793485 0
[pid=11756/tid=11758] ppid=11754 vsize=3191928 CPUtime=754.95 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 94746 0 0 0 75477 18 0 0 25 0 4 0 650192083 3268534272 680459 33554432000 4194304 4625164 140733245683440 18446744073709551615 4479607 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=3191928 CPUtime=702.36 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 197587 0 0 0 70200 36 0 0 25 0 4 0 650192083 3268534272 680459 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477913 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=3191928 CPUtime=621.97 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1160328 0 0 0 62035 162 0 0 25 0 4 0 650192083 3268534272 680459 33554432000 4194304 4625164 140733245683440 18446744073709551615 4278657 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2690.5
Current children cumulated vsize (KiB) 3191928

[startup+1242.3 s]
/proc/loadavg: 11.15 11.17 11.11 13/451 11824
/proc/meminfo: memFree=17671156/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=3296968 CPUtime=2869.57 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2564776 0 0 0 286578 379 0 0 25 0 4 0 650192032 3376095232 696479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4511950 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 824242 696479 347 106 0 819745 0
[pid=11756/tid=11758] ppid=11754 vsize=3296968 CPUtime=814.04 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 113495 0 0 0 81383 21 0 0 25 0 4 0 650192083 3376095232 696479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477965 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=3296968 CPUtime=762.35 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 214167 0 0 0 76196 39 0 0 25 0 4 0 650192083 3376095232 696479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477913 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=3296968 CPUtime=651.98 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1160328 0 0 0 65036 162 0 0 25 0 4 0 650192083 3376095232 696479 33554432000 4194304 4625164 140733245683440 18446744073709551615 4477913 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2869.57
Current children cumulated vsize (KiB) 3296968



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 11.05 11.14 11.10 12/451 11826
/proc/meminfo: memFree=17562868/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=3360296 CPUtime=3041.82 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) R 11754 11756 11674 0 -1 4202496 2616656 0 0 0 303795 387 0 0 25 0 4 0 650192032 3440943104 716657 33554432000 4194304 4625164 140733245683440 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 840074 716657 347 106 0 835577 0
[pid=11756/tid=11758] ppid=11754 vsize=3360296 CPUtime=847.56 cores=0,2,4,6
/proc/11756/task/11758/stat : 11758 (SArTagnan) R 11754 11756 11674 0 -1 4202560 137867 0 0 0 84732 24 0 0 25 0 4 0 650192083 3440943104 716657 33554432000 4194304 4625164 140733245683440 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11759] ppid=11754 vsize=3360296 CPUtime=798.01 cores=0,2,4,6
/proc/11756/task/11759/stat : 11759 (SArTagnan) R 11754 11756 11674 0 -1 4202560 238720 0 0 0 79759 42 0 0 25 0 4 0 650192083 3440943104 716657 33554432000 4194304 4625164 140733245683440 18446744073709551615 4328194 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=3360296 CPUtime=703.05 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4202560 1160339 0 0 0 70143 162 0 0 25 0 4 0 650192083 3440943104 716657 33554432000 4194304 4625164 140733245683440 18446744073709551615 4479607 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3041.82
Current children cumulated vsize (KiB) 3360296

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.12 s]
/proc/loadavg: 11.05 11.14 11.10 12/451 11826
/proc/meminfo: memFree=17562868/32951124 swapFree=67023148/67111528
[pid=11756] ppid=11754 vsize=0 CPUtime=3041.95 cores=0,2,4,6
/proc/11756/stat : 11756 (SArTagnan) Z 11754 11756 11674 0 -1 4203548 2616656 0 0 0 303798 397 0 0 25 0 2 0 650192032 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/11756/statm: 0 0 0 0 0 0 0
[pid=11756/tid=11760] ppid=11754 vsize=0 CPUtime=703.16 cores=0,2,4,6
/proc/11756/task/11760/stat : 11760 (SArTagnan) R 11754 11756 11674 0 -1 4203588 1160339 0 0 0 70144 172 0 0 25 0 2 0 650192083 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3041.95
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.14
CPU time (s): 3041.98
CPU user time (s): 3037.99
CPU system time (s): 3.99239
CPU usage (%): 233.972
Max. virtual memory (cumulated for all children) (KiB): 3360296

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3037.99
system time used= 3.99239
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2616656
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8841
involuntary context switches= 52438

runsolver used 5.42518 second user time and 13.7209 second system time

The end

Launcher Data

Begin job on node145 at 2011-05-16 22:29:22
IDJOB=3386258
IDBENCH=71010
IDSOLVER=1871
FILE ID=node145/3386258-1305577761
RUNJOBID= node145-1305577446-11692
PBS_JOBID= 13350223
Free space on /tmp= 73612 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UCG-15-10p1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386258-1305577761/watcher-3386258-1305577761 -o /tmp/evaluation-result-3386258-1305577761/solver-3386258-1305577761 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386258-1305577761.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 484dad50fb275faff8eff92c4d5447cb
RANDOM SEED=1994212481

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20747512 kB
Buffers:        107032 kB
Cached:         948072 kB
SwapCached:       4796 kB
Active:        8390996 kB
Inactive:      3555072 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20747512 kB
SwapTotal:    67111528 kB
SwapFree:     67023148 kB
Dirty:           19296 kB
Writeback:           0 kB
AnonPages:    10885844 kB
Mapped:          34332 kB
Slab:           137116 kB
PageTables:      54728 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 119936112 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73612 MiB
End job on node145 at 2011-05-16 22:51:04