Trace number 3386416

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.48 1205.72

General information on the benchmark

Nameapplication/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf
MD5SUMb967fca11e85ef5b614d3452b1c4b2ad
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables257030
Number of clauses769313
Sum of the clauses size1795061
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2512874
Number of clauses of size 3256437
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386416-1305579826/watcher-3386416-1305579826 -o /tmp/evaluation-result-3386416-1305579826/solver-3386416-1305579826 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386416-1305579826.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.09 9.06 8.60 7/502 23490
/proc/meminfo: memFree=20574064/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=58304 CPUtime=0.01 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 5150 0 0 0 1 0 0 0 21 0 1 0 669583587 59703296 5089 33554432000 4194304 4625164 140737188260560 18446744073709551615 270612807791 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/23490/statm: 14576 5090 296 106 0 10079 0

[startup+0.109792 s]
/proc/loadavg: 9.09 9.06 8.60 7/502 23490
/proc/meminfo: memFree=20574064/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=69232 CPUtime=0.1 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 10884 0 0 0 9 1 0 0 21 0 1 0 669583587 70893568 7757 33554432000 4194304 4625164 140737188260560 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/23490/statm: 17308 7758 296 106 0 12811 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 69232

[startup+0.200777 s]
/proc/loadavg: 9.09 9.06 8.60 7/502 23490
/proc/meminfo: memFree=20574064/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=78228 CPUtime=0.19 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 15329 0 0 0 17 2 0 0 21 0 1 0 669583587 80105472 10580 33554432000 4194304 4625164 140737188260560 18446744073709551615 270613110528 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/23490/statm: 19557 10581 296 106 0 15060 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 78228

[startup+0.300758 s]
/proc/loadavg: 9.09 9.06 8.60 7/502 23490
/proc/meminfo: memFree=20574064/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=90028 CPUtime=0.29 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 21034 0 0 0 26 3 0 0 22 0 1 0 669583587 92188672 13854 33554432000 4194304 4625164 140737188260560 18446744073709551615 270613110528 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/23490/statm: 22507 13855 296 106 0 18010 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 90028

[startup+0.70065 s]
/proc/loadavg: 9.09 9.06 8.60 7/502 23490
/proc/meminfo: memFree=20574064/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=471148 CPUtime=1.62 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 61840 0 0 0 155 7 0 0 24 0 4 0 669583587 482455552 50646 33554432000 4194304 4625164 140737188260560 18446744073709551615 270612766677 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 117787 50646 336 106 0 113290 0
Current children cumulated CPU time (s) 1.62
Current children cumulated vsize (KiB) 471148

[startup+1.50051 s]
/proc/loadavg: 9.09 9.06 8.60 10/506 23494
/proc/meminfo: memFree=20361124/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=479164 CPUtime=4.8 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 63784 0 0 0 473 7 0 0 25 0 4 0 669583587 490663936 52589 33554432000 4194304 4625164 140737188260560 18446744073709551615 4278661 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 119791 52589 342 106 0 115294 0
[pid=23490/tid=23492] ppid=23488 vsize=479164 CPUtime=1.11 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 2432 0 0 0 111 0 0 0 25 0 4 0 669583625 490663936 52589 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351722 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=479164 CPUtime=1.1 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 3110 0 0 0 110 0 0 0 25 0 4 0 669583625 490663936 52589 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=479164 CPUtime=1.09 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 4720 0 0 0 109 0 0 0 25 0 4 0 669583625 490663936 52589 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.8
Current children cumulated vsize (KiB) 479164

[startup+3.10023 s]
/proc/loadavg: 9.09 9.06 8.60 10/506 23494
/proc/meminfo: memFree=20352940/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=479164 CPUtime=11.19 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 64401 0 0 0 1111 8 0 0 25 0 4 0 669583587 490663936 53206 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 119791 53206 342 106 0 115294 0
[pid=23490/tid=23492] ppid=23488 vsize=479164 CPUtime=2.71 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 2600 0 0 0 271 0 0 0 25 0 4 0 669583625 490663936 53206 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=479164 CPUtime=2.7 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 3184 0 0 0 270 0 0 0 25 0 4 0 669583625 490663936 53206 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=479164 CPUtime=2.67 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 4838 0 0 0 267 0 0 0 25 0 4 0 669583625 490663936 53206 33554432000 4194304 4625164 140737188260560 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.19
Current children cumulated vsize (KiB) 479164

[startup+6.30066 s]
/proc/loadavg: 9.08 9.06 8.60 10/506 23494
/proc/meminfo: memFree=20351900/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=479164 CPUtime=23.93 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 67375 0 0 0 2385 8 0 0 25 0 4 0 669583587 490663936 56180 33554432000 4194304 4625164 140737188260560 18446744073709551615 4509483 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 119791 56180 342 106 0 115294 0
[pid=23490/tid=23492] ppid=23488 vsize=479164 CPUtime=5.91 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 3222 0 0 0 591 0 0 0 25 0 4 0 669583625 490663936 56180 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=479164 CPUtime=5.9 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 3837 0 0 0 590 0 0 0 25 0 4 0 669583625 490663936 56180 33554432000 4194304 4625164 140737188260560 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=479164 CPUtime=5.81 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 5407 0 0 0 581 0 0 0 25 0 4 0 669583625 490663936 56180 33554432000 4194304 4625164 140737188260560 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.93
Current children cumulated vsize (KiB) 479164

[startup+12.7005 s]
/proc/loadavg: 9.08 9.06 8.60 12/507 23496
/proc/meminfo: memFree=19332280/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1607676 CPUtime=49.15 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 681169 0 0 0 4823 92 0 0 25 0 4 0 669583587 1646260224 300128 33554432000 4194304 4625164 140737188260560 18446744073709551615 4337785 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 401919 300128 351 106 0 397422 0
[pid=23490/tid=23492] ppid=23488 vsize=1607676 CPUtime=12.2 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 117021 0 0 0 1206 14 0 0 25 0 4 0 669583625 1646260224 300128 33554432000 4194304 4625164 140737188260560 18446744073709551615 4278495 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1607676 CPUtime=12.19 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 111902 0 0 0 1204 15 0 0 25 0 4 0 669583625 1646260224 300128 33554432000 4194304 4625164 140737188260560 18446744073709551615 4353075 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1607676 CPUtime=12.07 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 132519 0 0 0 1190 17 0 0 25 0 4 0 669583625 1646260224 300128 33554432000 4194304 4625164 140737188260560 18446744073709551615 4278626 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.15
Current children cumulated vsize (KiB) 1607676

[startup+25.5013 s]
/proc/loadavg: 9.36 9.12 8.63 11/507 23496
/proc/meminfo: memFree=19141132/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1713816 CPUtime=99.59 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 838713 0 0 0 9844 115 0 0 25 0 4 0 669583587 1754947584 331982 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 428454 331982 351 106 0 423957 0
[pid=23490/tid=23492] ppid=23488 vsize=1713816 CPUtime=24.76 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 118776 0 0 0 2461 15 0 0 25 0 4 0 669583625 1754947584 331982 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1713816 CPUtime=24.99 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 113104 0 0 0 2484 15 0 0 25 0 4 0 669583625 1754947584 331982 33554432000 4194304 4625164 140737188260560 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1713816 CPUtime=24.62 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 235247 0 0 0 2431 31 0 0 25 0 4 0 669583625 1754947584 331982 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.59
Current children cumulated vsize (KiB) 1713816

[startup+51.1007 s]
/proc/loadavg: 9.29 9.13 8.64 10/506 23497
/proc/meminfo: memFree=18916724/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1713816 CPUtime=201.44 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 1108186 0 0 0 19988 156 0 0 25 0 4 0 669583587 1754947584 333031 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511941 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 428454 333031 347 106 0 423957 0
[pid=23490/tid=23492] ppid=23488 vsize=1713816 CPUtime=50.35 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 119209 0 0 0 5020 15 0 0 25 0 4 0 669583625 1754947584 333031 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1713816 CPUtime=50.59 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 113183 0 0 0 5044 15 0 0 25 0 4 0 669583625 1754947584 333031 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1713816 CPUtime=49.81 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 503828 0 0 0 4909 72 0 0 25 0 4 0 669583625 1754947584 333031 33554432000 4194304 4625164 140737188260560 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 201.44
Current children cumulated vsize (KiB) 1713816

[startup+102.301 s]
/proc/loadavg: 9.13 9.11 8.66 10/506 23498
/proc/meminfo: memFree=18741744/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1713816 CPUtime=405.45 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 1518076 0 0 0 40326 219 0 0 25 0 4 0 669583587 1754947584 338110 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 428454 338110 347 106 0 423957 0
[pid=23490/tid=23492] ppid=23488 vsize=1713816 CPUtime=101.55 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 119865 0 0 0 10140 15 0 0 25 0 4 0 669583625 1754947584 338110 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1713816 CPUtime=101.81 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 113386 0 0 0 10165 16 0 0 25 0 4 0 669583625 1754947584 338110 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1713816 CPUtime=100.18 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 910691 0 0 0 9885 133 0 0 25 0 4 0 669583625 1754947584 338110 33554432000 4194304 4625164 140737188260560 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 405.45
Current children cumulated vsize (KiB) 1713816

[startup+162.301 s]
/proc/loadavg: 9.04 9.08 8.68 10/506 23500
/proc/meminfo: memFree=18440012/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1713816 CPUtime=644.39 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 2007549 0 0 0 64149 290 0 0 25 0 4 0 669583587 1754947584 343196 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511795 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 428454 343196 347 106 0 423957 0
[pid=23490/tid=23492] ppid=23488 vsize=1713816 CPUtime=161.52 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 121253 0 0 0 16137 15 0 0 25 0 4 0 669583625 1754947584 343196 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1713816 CPUtime=161.79 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 113795 0 0 0 16163 16 0 0 25 0 4 0 669583625 1754947584 343196 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1713816 CPUtime=159.19 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 1396773 0 0 0 15715 204 0 0 25 0 4 0 669583625 1754947584 343196 33554432000 4194304 4625164 140737188260560 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 644.39
Current children cumulated vsize (KiB) 1713816

[startup+222.319 s]
/proc/loadavg: 9.01 9.07 8.69 10/506 23501
/proc/meminfo: memFree=17560076/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1713816 CPUtime=883.46 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 2546883 0 0 0 87981 365 0 0 25 0 4 0 669583587 1754947584 345981 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 428454 345981 347 106 0 423957 0
[pid=23490/tid=23492] ppid=23488 vsize=1713816 CPUtime=221.53 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 121592 0 0 0 22137 16 0 0 25 0 4 0 669583625 1754947584 345981 33554432000 4194304 4625164 140737188260560 18446744073709551615 4375232 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1713816 CPUtime=221.8 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 114140 0 0 0 22164 16 0 0 25 0 4 0 669583625 1754947584 345981 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1713816 CPUtime=218.22 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 1934674 0 0 0 21544 278 0 0 25 0 4 0 669583625 1754947584 345981 33554432000 4194304 4625164 140737188260560 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 883.46
Current children cumulated vsize (KiB) 1713816

[startup+282.301 s]

################
# More data... #
################

[pid=23490] ppid=23488 vsize=1915916 CPUtime=2795.42 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 5298059 0 0 0 278766 776 0 0 25 0 4 0 669583587 1961897984 382710 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 478979 382710 347 106 0 474482 0
[pid=23490/tid=23492] ppid=23488 vsize=1915916 CPUtime=701.38 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 175610 0 0 0 70109 29 0 0 25 0 4 0 669583625 1961897984 382710 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1915916 CPUtime=701.78 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 115944 0 0 0 70160 18 0 0 25 0 4 0 669583625 1961897984 382710 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1915916 CPUtime=690.36 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 4615288 0 0 0 68366 670 0 0 25 0 4 0 669583625 1961897984 382710 33554432000 4194304 4625164 140737188260560 18446744073709551615 4554582 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2795.42
Current children cumulated vsize (KiB) 1915916

[startup+762.301 s]
/proc/loadavg: 9.10 9.10 8.86 10/506 23546
/proc/meminfo: memFree=22406064/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1919612 CPUtime=3034.48 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 5300018 0 0 0 302671 777 0 0 25 0 4 0 669583587 1965682688 384669 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 479903 384669 347 106 0 475406 0
[pid=23490/tid=23492] ppid=23488 vsize=1919612 CPUtime=761.37 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 176089 0 0 0 76108 29 0 0 25 0 4 0 669583625 1965682688 384669 33554432000 4194304 4625164 140737188260560 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1919612 CPUtime=761.8 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 116109 0 0 0 76162 18 0 0 25 0 4 0 669583625 1965682688 384669 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288783 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1919612 CPUtime=749.38 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 4616490 0 0 0 74268 670 0 0 25 0 4 0 669583625 1965682688 384669 33554432000 4194304 4625164 140737188260560 18446744073709551615 4375467 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3034.48
Current children cumulated vsize (KiB) 1919612

[startup+822.3 s]
/proc/loadavg: 9.08 9.09 8.87 10/506 23547
/proc/meminfo: memFree=22300108/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1922920 CPUtime=3273.42 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 5468336 0 0 0 326541 801 0 0 25 0 4 0 669583587 1969070080 389728 33554432000 4194304 4625164 140737188260560 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 480730 389728 347 106 0 476233 0
[pid=23490/tid=23492] ppid=23488 vsize=1922920 CPUtime=821.34 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 177707 0 0 0 82105 29 0 0 25 0 4 0 669583625 1969070080 389728 33554432000 4194304 4625164 140737188260560 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1922920 CPUtime=821.78 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 116140 0 0 0 82160 18 0 0 25 0 4 0 669583625 1969070080 389728 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288743 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1922920 CPUtime=808.39 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 4782375 0 0 0 80145 694 0 0 25 0 4 0 669583625 1969070080 389728 33554432000 4194304 4625164 140737188260560 18446744073709551615 4554582 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3273.42
Current children cumulated vsize (KiB) 1922920

[startup+882.319 s]
/proc/loadavg: 9.07 9.09 8.88 10/506 23549
/proc/meminfo: memFree=22203472/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1922920 CPUtime=3512.49 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 5887485 0 0 0 350387 862 0 0 25 0 4 0 669583587 1969070080 393359 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511941 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 480730 393359 347 106 0 476233 0
[pid=23490/tid=23492] ppid=23488 vsize=1922920 CPUtime=881.35 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 178612 0 0 0 88106 29 0 0 25 0 4 0 669583625 1969070080 393359 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1922920 CPUtime=881.79 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 116163 0 0 0 88161 18 0 0 25 0 4 0 669583625 1969070080 393359 33554432000 4194304 4625164 140737188260560 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1922920 CPUtime=867.42 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 5199969 0 0 0 85987 755 0 0 25 0 4 0 669583625 1969070080 393359 33554432000 4194304 4625164 140737188260560 18446744073709551615 4554582 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3512.49
Current children cumulated vsize (KiB) 1922920

[startup+942.301 s]
/proc/loadavg: 9.13 9.10 8.90 10/506 23550
/proc/meminfo: memFree=22137836/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1922920 CPUtime=3751.43 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 6271178 0 0 0 374232 911 0 0 25 0 4 0 669583587 1969070080 399046 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 480730 399046 347 106 0 476233 0
[pid=23490/tid=23492] ppid=23488 vsize=1922920 CPUtime=941.31 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 178766 0 0 0 94102 29 0 0 25 0 4 0 669583625 1969070080 399046 33554432000 4194304 4625164 140737188260560 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1922920 CPUtime=941.78 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 116361 0 0 0 94160 18 0 0 25 0 4 0 669583625 1969070080 399046 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1922920 CPUtime=926.43 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 5582802 0 0 0 91839 804 0 0 25 0 4 0 669583625 1969070080 399046 33554432000 4194304 4625164 140737188260560 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3751.43
Current children cumulated vsize (KiB) 1922920

[startup+1002.3 s]
/proc/loadavg: 9.14 9.11 8.91 10/506 23552
/proc/meminfo: memFree=22093624/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1922920 CPUtime=3990.43 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 6656810 0 0 0 398075 968 0 0 25 0 4 0 669583587 1969070080 399594 33554432000 4194304 4625164 140737188260560 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 480730 399594 347 106 0 476233 0
[pid=23490/tid=23492] ppid=23488 vsize=1922920 CPUtime=1001.29 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 179058 0 0 0 100100 29 0 0 25 0 4 0 669583625 1969070080 399594 33554432000 4194304 4625164 140737188260560 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1922920 CPUtime=1001.77 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 116589 0 0 0 100159 18 0 0 25 0 4 0 669583625 1969070080 399594 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1922920 CPUtime=985.45 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 5967411 0 0 0 97684 861 0 0 25 0 4 0 669583625 1969070080 399594 33554432000 4194304 4625164 140737188260560 18446744073709551615 4352002 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3990.43
Current children cumulated vsize (KiB) 1922920

[startup+1062.3 s]
/proc/loadavg: 9.14 9.11 8.92 10/506 23554
/proc/meminfo: memFree=21994492/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1923132 CPUtime=4229.45 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 6793986 0 0 0 421956 989 0 0 25 0 4 0 669583587 1969287168 402183 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 480783 402183 347 106 0 476286 0
[pid=23490/tid=23492] ppid=23488 vsize=1923132 CPUtime=1061.29 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 179942 0 0 0 106099 30 0 0 25 0 4 0 669583625 1969287168 402183 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1923132 CPUtime=1061.78 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 117567 0 0 0 106159 19 0 0 25 0 4 0 669583625 1969287168 402183 33554432000 4194304 4625164 140737188260560 18446744073709551615 4328630 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1923132 CPUtime=1044.48 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 6102491 0 0 0 103567 881 0 0 25 0 4 0 669583625 1969287168 402183 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4229.45
Current children cumulated vsize (KiB) 1923132

[startup+1122.3 s]
/proc/loadavg: 9.34 9.17 8.95 10/506 23555
/proc/meminfo: memFree=21900444/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1924820 CPUtime=4468.44 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 7108059 0 0 0 445809 1035 0 0 25 0 4 0 669583587 1971015680 405562 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 481205 405562 347 106 0 476708 0
[pid=23490/tid=23492] ppid=23488 vsize=1924820 CPUtime=1121.26 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 181965 0 0 0 112095 31 0 0 25 0 4 0 669583625 1971015680 405562 33554432000 4194304 4625164 140737188260560 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1924820 CPUtime=1121.78 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 117841 0 0 0 112159 19 0 0 25 0 4 0 669583625 1971015680 405562 33554432000 4194304 4625164 140737188260560 18446744073709551615 4352098 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1924820 CPUtime=1103.48 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 6414237 0 0 0 109423 925 0 0 25 0 4 0 669583625 1971015680 405562 33554432000 4194304 4625164 140737188260560 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4468.44
Current children cumulated vsize (KiB) 1924820

[startup+1182.3 s]
/proc/loadavg: 9.24 9.17 8.96 10/506 23557
/proc/meminfo: memFree=21861936/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1990356 CPUtime=4707.46 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 7414116 0 0 0 469666 1080 0 0 25 0 4 0 669583587 2038124544 412461 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 497589 412461 347 106 0 493092 0
[pid=23490/tid=23492] ppid=23488 vsize=1990356 CPUtime=1181.25 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 183833 0 0 0 118093 32 0 0 25 0 4 0 669583625 2038124544 412461 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1990356 CPUtime=1181.78 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 117947 0 0 0 118159 19 0 0 25 0 4 0 669583625 2038124544 412461 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1990356 CPUtime=1162.52 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 6718274 0 0 0 115282 970 0 0 25 0 4 0 669583625 2038124544 412461 33554432000 4194304 4625164 140737188260560 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4707.46
Current children cumulated vsize (KiB) 1990356



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.6 s]
/proc/loadavg: 9.16 9.15 8.96 11/506 23557
/proc/meminfo: memFree=21854968/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1990356 CPUtime=4800.38 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 7547425 0 0 0 478938 1100 0 0 25 0 4 0 669583587 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 497589 413063 347 106 0 493092 0
[pid=23490/tid=23492] ppid=23488 vsize=1990356 CPUtime=1204.58 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 184108 0 0 0 120426 32 0 0 25 0 4 0 669583625 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1990356 CPUtime=1205.11 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 117975 0 0 0 120492 19 0 0 25 0 4 0 669583625 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1990356 CPUtime=1185.43 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 6851241 0 0 0 117554 989 0 0 25 0 4 0 669583625 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 1990356

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.6 s]
/proc/loadavg: 9.16 9.15 8.96 11/506 23557
/proc/meminfo: memFree=21854968/32951124 swapFree=60609076/67111528
[pid=23490] ppid=23488 vsize=1990356 CPUtime=4800.38 cores=0,2,4,6
/proc/23490/stat : 23490 (SArTagnan) R 23488 23490 22974 0 -1 4202496 7547425 0 0 0 478938 1100 0 0 25 0 4 0 669583587 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23490/statm: 497589 413063 347 106 0 493092 0
[pid=23490/tid=23492] ppid=23488 vsize=1990356 CPUtime=1204.58 cores=0,2,4,6
/proc/23490/task/23492/stat : 23492 (SArTagnan) R 23488 23490 22974 0 -1 4202560 184108 0 0 0 120426 32 0 0 25 0 4 0 669583625 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23490/tid=23493] ppid=23488 vsize=1990356 CPUtime=1205.11 cores=0,2,4,6
/proc/23490/task/23493/stat : 23493 (SArTagnan) R 23488 23490 22974 0 -1 4202560 117975 0 0 0 120492 19 0 0 25 0 4 0 669583625 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=23490/tid=23494] ppid=23488 vsize=1990356 CPUtime=1185.43 cores=0,2,4,6
/proc/23490/task/23494/stat : 23494 (SArTagnan) R 23488 23490 22974 0 -1 4202560 6851241 0 0 0 117554 989 0 0 25 0 4 0 669583625 2038124544 413063 33554432000 4194304 4625164 140737188260560 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 1990356

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.72
CPU time (s): 4800.48
CPU user time (s): 4789.4
CPU system time (s): 11.0803
CPU usage (%): 398.144
Max. virtual memory (cumulated for all children) (KiB): 1990356

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4789.4
system time used= 11.0803
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7547425
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4815
involuntary context switches= 23542

runsolver used 5.60415 second user time and 14.1758 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-16 23:03:46
IDJOB=3386416
IDBENCH=82459
IDSOLVER=1871
FILE ID=node108/3386416-1305579826
RUNJOBID= node108-1305577160-22992
PBS_JOBID= 13350217
Free space on /tmp= 73420 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/application/jarvisalo/smtqfbv-aigs/smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386416-1305579826/watcher-3386416-1305579826 -o /tmp/evaluation-result-3386416-1305579826/solver-3386416-1305579826 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386416-1305579826.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b967fca11e85ef5b614d3452b1c4b2ad
RANDOM SEED=1774341649

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20574228 kB
Buffers:         69856 kB
Cached:         767900 kB
SwapCached:      25796 kB
Active:        4788400 kB
Inactive:      7363024 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20574228 kB
SwapTotal:    67111528 kB
SwapFree:     60609076 kB
Dirty:           14364 kB
Writeback:           0 kB
AnonPages:    11297176 kB
Mapped:          29268 kB
Slab:            82024 kB
PageTables:      73188 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 139565668 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73440 MiB
End job on node108 at 2011-05-16 23:23:54