Trace number 1781065

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 2997.62 1000.04

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_12_UNKNOWN.cnf
MD5SUMd18a114d646a89f18fb3efba2be009e6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1898
Number of clauses118441
Sum of the clauses size352559
Maximum clause length13
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22994
Number of clauses of size 3115424
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781065-1243652404/watcher-1781065-1243652404 -o /tmp/evaluation-result-1781065-1243652404/solver-1781065-1243652404 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1781065-1243652404.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.78 2.99 2.98 3/115 14674
/proc/meminfo: memFree=2952508/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=3176 CPUtime=0
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 624 0 0 0 0 0 0 0 18 0 5 0 1129920193 3252224 581 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 794 584 63 164 0 629 0
[pid=14674/tid=14675] ppid=14672 vsize=3308 CPUtime=0
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129920193 3387392 612 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=3308 CPUtime=0
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 542 0 0 0 0 0 0 0 20 0 5 0 1129920193 3387392 614 4294967295 134512640 135180984 3214906704 3086422160 134691935 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=3308 CPUtime=0
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1129920193 3387392 614 4294967295 134512640 135180984 3214906704 3086357316 134705812 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=3308 CPUtime=0
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1129920193 3387392 615 4294967295 134512640 135180984 3214906704 3086291780 134705812 0 0 0 0 0 0 0 -1 1 0 0 0

[startup+0.057285 s]
/proc/loadavg: 2.78 2.99 2.98 3/115 14674
/proc/meminfo: memFree=2952508/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=13224 CPUtime=0.11
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 2910 0 0 0 9 2 0 0 18 0 5 0 1129920193 13541376 2859 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 3306 2860 63 164 0 3141 0
[pid=14674/tid=14675] ppid=14672 vsize=13224 CPUtime=0
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129920193 13541376 2860 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=13224 CPUtime=0.06
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 1171 0 0 0 5 1 0 0 21 0 5 0 1129920193 13541376 2860 4294967295 134512640 135180984 3214906704 3086422104 134675846 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=13224 CPUtime=0.04
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 892 0 0 0 3 1 0 0 20 0 5 0 1129920193 13541376 2862 4294967295 134512640 135180984 3214906704 3086356768 134513762 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=13224 CPUtime=0.01
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 731 0 0 0 1 0 0 0 20 0 5 0 1129920193 13541376 2862 4294967295 134512640 135180984 3214906704 3086291168 134520020 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 13224

[startup+0.107284 s]
/proc/loadavg: 2.78 2.99 2.98 3/115 14674
/proc/meminfo: memFree=2952508/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=19436 CPUtime=0.26
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 4616 0 0 0 22 4 0 0 18 0 5 0 1129920193 19902464 4095 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 4859 4096 68 164 0 4694 0
[pid=14674/tid=14675] ppid=14672 vsize=19436 CPUtime=0
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 41 0 0 0 0 0 0 0 18 0 5 0 1129920193 19902464 4096 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=19436 CPUtime=0.11
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 1595 0 0 0 10 1 0 0 20 0 5 0 1129920193 19902464 4097 4294967295 134512640 135180984 3214906704 3086421764 134579745 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=19436 CPUtime=0.09
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 1476 0 0 0 7 2 0 0 20 0 5 0 1129920193 19902464 4097 4294967295 134512640 135180984 3214906704 3086356768 134513738 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=19436 CPUtime=0.06
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 1395 0 0 0 5 1 0 0 20 0 5 0 1129920193 19902464 4097 4294967295 134512640 135180984 3214906704 3086291092 134579745 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 19436

[startup+0.307275 s]
/proc/loadavg: 2.78 2.99 2.98 3/115 14674
/proc/meminfo: memFree=2952508/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=18600 CPUtime=0.86
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 5499 0 0 0 81 5 0 0 18 0 5 0 1129920193 19046400 4038 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 4650 4038 68 164 0 4485 0
[pid=14674/tid=14675] ppid=14672 vsize=18600 CPUtime=0
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 5 0 1129920193 19046400 4038 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=18600 CPUtime=0.31
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 1720 0 0 0 30 1 0 0 20 0 5 0 1129920193 19046400 4038 4294967295 134512640 135180984 3214906704 3086421776 134524643 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=18600 CPUtime=0.29
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 1731 0 0 0 27 2 0 0 20 0 5 0 1129920193 19046400 4038 4294967295 134512640 135180984 3214906704 3086356168 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=18600 CPUtime=0.26
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 1896 0 0 0 24 2 0 0 20 0 5 0 1129920193 19046400 4038 4294967295 134512640 135180984 3214906704 3086290792 134518214 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.86
Current children cumulated vsize (KiB) 18600

[startup+0.70726 s]
/proc/loadavg: 2.78 2.99 2.98 3/115 14674
/proc/meminfo: memFree=2952508/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=20680 CPUtime=2.06
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 6032 0 0 0 200 6 0 0 18 0 5 0 1129920193 21176320 4571 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 5170 4571 68 164 0 5005 0
[pid=14674/tid=14675] ppid=14672 vsize=20680 CPUtime=0
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 41 0 0 0 0 0 0 0 15 0 5 0 1129920193 21176320 4571 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=20680 CPUtime=0.71
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 1893 0 0 0 69 2 0 0 21 0 5 0 1129920193 21176320 4571 4294967295 134512640 135180984 3214906704 3086421872 134528546 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=20680 CPUtime=0.69
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 1924 0 0 0 67 2 0 0 21 0 5 0 1129920193 21176320 4571 4294967295 134512640 135180984 3214906704 3086356448 134531973 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=20680 CPUtime=0.66
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 2063 0 0 0 64 2 0 0 21 0 5 0 1129920193 21176320 4571 4294967295 134512640 135180984 3214906704 3086290800 134528648 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.06
Current children cumulated vsize (KiB) 20680

[startup+1.50723 s]
/proc/loadavg: 2.78 2.99 2.98 4/120 14679
/proc/meminfo: memFree=2934192/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=23288 CPUtime=4.45
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 6831 0 0 0 438 7 0 0 18 0 5 0 1129920193 23846912 5370 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 5822 5370 68 164 0 5657 0
[pid=14674/tid=14675] ppid=14672 vsize=23288 CPUtime=0
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 42 0 0 0 0 0 0 0 16 0 5 0 1129920193 23846912 5370 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=23288 CPUtime=1.5
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 2125 0 0 0 147 3 0 0 25 0 5 0 1129920193 23846912 5370 4294967295 134512640 135180984 3214906704 3086421888 134532610 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=23288 CPUtime=1.49
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 2215 0 0 0 147 2 0 0 25 0 5 0 1129920193 23846912 5370 4294967295 134512640 135180984 3214906704 3086356052 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=23288 CPUtime=1.46
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 2338 0 0 0 144 2 0 0 23 0 5 0 1129920193 23846912 5370 4294967295 134512640 135180984 3214906704 3086290800 134528869 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.45
Current children cumulated vsize (KiB) 23288

[startup+3.10716 s]
/proc/loadavg: 2.78 2.99 2.98 4/120 14679
/proc/meminfo: memFree=2930344/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=30156 CPUtime=9.25
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 8215 0 0 0 916 9 0 0 18 0 5 0 1129920193 30879744 6754 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 7539 6754 68 164 0 7374 0
[pid=14674/tid=14675] ppid=14672 vsize=30156 CPUtime=0.01
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 45 0 0 0 1 0 0 0 15 0 5 0 1129920193 30879744 6754 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=30156 CPUtime=3.09
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 2548 0 0 0 305 4 0 0 25 0 5 0 1129920193 30879744 6754 4294967295 134512640 135180984 3214906704 3086421984 134530765 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=30156 CPUtime=3.09
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 2570 0 0 0 307 2 0 0 25 0 5 0 1129920193 30879744 6754 4294967295 134512640 135180984 3214906704 3086356336 134528628 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=30156 CPUtime=3.06
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 2941 0 0 0 303 3 0 0 25 0 5 0 1129920193 30879744 6754 4294967295 134512640 135180984 3214906704 3086290796 134520661 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9.25
Current children cumulated vsize (KiB) 30156

[startup+6.30704 s]
/proc/loadavg: 2.88 3.01 2.99 4/120 14679
/proc/meminfo: memFree=2920484/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=38008 CPUtime=18.83
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 10303 0 0 0 1869 14 0 0 18 0 5 0 1129920193 38920192 8842 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 9502 8842 68 164 0 9337 0
[pid=14674/tid=14675] ppid=14672 vsize=38008 CPUtime=0.02
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 46 0 0 0 1 1 0 0 15 0 5 0 1129920193 38920192 8842 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=38008 CPUtime=6.28
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 3070 0 0 0 622 6 0 0 25 0 5 0 1129920193 38920192 8842 4294967295 134512640 135180984 3214906704 3086421872 134528536 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=38008 CPUtime=6.29
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 3254 0 0 0 625 4 0 0 25 0 5 0 1129920193 38920192 8842 4294967295 134512640 135180984 3214906704 3086356272 134523615 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=38008 CPUtime=6.24
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 3822 0 0 0 621 3 0 0 25 0 5 0 1129920193 38920192 8842 4294967295 134512640 135180984 3214906704 3086290800 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.83
Current children cumulated vsize (KiB) 38008

[startup+12.7068 s]
/proc/loadavg: 2.89 3.00 2.99 4/120 14865
/proc/meminfo: memFree=2907704/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=48740 CPUtime=37.98
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 13029 0 0 0 3774 24 0 0 18 0 5 0 1129920193 49909760 11568 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 12185 11568 68 164 0 12020 0
[pid=14674/tid=14675] ppid=14672 vsize=48740 CPUtime=0.07
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 69 0 0 0 2 5 0 0 15 0 5 0 1129920193 49909760 11568 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=48740 CPUtime=12.61
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 3766 0 0 0 1254 7 0 0 25 0 5 0 1129920193 49909760 11568 4294967295 134512640 135180984 3214906704 3086421872 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=48740 CPUtime=12.67
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 4059 0 0 0 1262 5 0 0 25 0 5 0 1129920193 49909760 11568 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=48740 CPUtime=12.63
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 5024 0 0 0 1256 7 0 0 25 0 5 0 1129920193 49909760 11568 4294967295 134512640 135180984 3214906704 3086290704 134524994 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.98
Current children cumulated vsize (KiB) 48740

[startup+25.5063 s]
/proc/loadavg: 2.91 3.00 2.99 4/120 14865
/proc/meminfo: memFree=2891032/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=66072 CPUtime=76.37
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 17189 0 0 0 7600 37 0 0 18 0 5 0 1129920193 67657728 15728 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 16518 15728 68 164 0 16353 0
[pid=14674/tid=14675] ppid=14672 vsize=66072 CPUtime=0.13
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 80 0 0 0 3 10 0 0 15 0 5 0 1129920193 67657728 15728 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=66072 CPUtime=25.35
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 4903 0 0 0 2524 11 0 0 25 0 5 0 1129920193 67657728 15728 4294967295 134512640 135180984 3214906704 3086421872 134528532 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=66072 CPUtime=25.46
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 5353 0 0 0 2541 5 0 0 25 0 5 0 1129920193 67657728 15728 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=66072 CPUtime=25.43
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 6742 0 0 0 2532 11 0 0 25 0 5 0 1129920193 67657728 15728 4294967295 134512640 135180984 3214906704 3086290632 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 76.37
Current children cumulated vsize (KiB) 66072

[startup+51.1053 s]
/proc/loadavg: 2.94 3.00 2.99 4/120 14867
/proc/meminfo: memFree=2866516/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=91536 CPUtime=153.12
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 23425 0 0 0 15255 57 0 0 18 0 5 0 1129920193 93732864 21964 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 22884 21964 68 164 0 22719 0
[pid=14674/tid=14675] ppid=14672 vsize=91536 CPUtime=0.22
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 113 0 0 0 5 17 0 0 15 0 5 0 1129920193 93732864 21964 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=91536 CPUtime=50.82
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 7019 0 0 0 5066 16 0 0 25 0 5 0 1129920193 93732864 21964 4294967295 134512640 135180984 3214906704 3086421872 134528636 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=91536 CPUtime=51.06
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 7696 0 0 0 5097 9 0 0 25 0 5 0 1129920193 93732864 21964 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=91536 CPUtime=51.02
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 8486 0 0 0 5087 15 0 0 25 0 5 0 1129920193 93732864 21964 4294967295 134512640 135180984 3214906704 3086290800 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 153.12
Current children cumulated vsize (KiB) 91536

[startup+102.323 s]
/proc/loadavg: 2.97 3.00 2.99 4/120 15054

################
# More data... #
################

[pid=14674/tid=14676] ppid=14672 vsize=244012 CPUtime=521.11
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 16933 0 0 0 52051 60 0 0 25 0 5 0 1129920193 249868288 58825 4294967295 134512640 135180984 3214906704 3086421872 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=244012 CPUtime=521.94
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 20543 0 0 0 52156 38 0 0 25 0 5 0 1129920193 249868288 58825 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=244012 CPUtime=522.06
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 22483 0 0 0 52161 45 0 0 25 0 5 0 1129920193 249868288 58825 4294967295 134512640 135180984 3214906704 3086290796 134518208 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1565.62
Current children cumulated vsize (KiB) 244012

[startup+582.314 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 16569
/proc/meminfo: memFree=2716484/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=244376 CPUtime=1745.41
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 60371 0 0 0 174348 193 0 0 18 0 5 0 1129920193 250241024 58910 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 61094 58910 68 164 0 60929 0
[pid=14674/tid=14675] ppid=14672 vsize=244376 CPUtime=0.56
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 226 0 0 0 18 38 0 0 15 0 5 0 1129920193 250241024 58910 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=244376 CPUtime=580.96
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 17000 0 0 0 58029 67 0 0 25 0 5 0 1129920193 250241024 58910 4294967295 134512640 135180984 3214906704 3086421864 134518224 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=244376 CPUtime=581.88
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 20548 0 0 0 58148 40 0 0 25 0 5 0 1129920193 250241024 58910 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=244376 CPUtime=582.01
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 22486 0 0 0 58153 48 0 0 25 0 5 0 1129920193 250241024 58910 4294967295 134512640 135180984 3214906704 3086290800 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1745.41
Current children cumulated vsize (KiB) 244376

[startup+642.302 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 16757
/proc/meminfo: memFree=2715492/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=247068 CPUtime=1925.25
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 60968 0 0 0 192326 199 0 0 18 0 5 0 1129920193 252997632 59507 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 61767 59507 68 164 0 61602 0
[pid=14674/tid=14675] ppid=14672 vsize=247068 CPUtime=0.6
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 227 0 0 0 18 42 0 0 15 0 5 0 1129920193 252997632 59507 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=247068 CPUtime=640.88
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 17262 0 0 0 64020 68 0 0 25 0 5 0 1129920193 252997632 59507 4294967295 134512640 135180984 3214906704 3086421864 134518214 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=247068 CPUtime=641.81
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 20709 0 0 0 64140 41 0 0 25 0 5 0 1129920193 252997632 59507 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=247068 CPUtime=641.96
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 22659 0 0 0 64148 48 0 0 25 0 5 0 1129920193 252997632 59507 4294967295 134512640 135180984 3214906704 3086290800 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1925.25
Current children cumulated vsize (KiB) 247068

[startup+702.309 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 16948
/proc/meminfo: memFree=2710160/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=252932 CPUtime=2105.22
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 62248 0 0 0 210315 207 0 0 18 0 5 0 1129920193 259002368 60787 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 63233 60787 68 164 0 63068 0
[pid=14674/tid=14675] ppid=14672 vsize=252932 CPUtime=0.65
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 230 0 0 0 19 46 0 0 15 0 5 0 1129920193 259002368 60787 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=252932 CPUtime=700.83
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 18119 0 0 0 70013 70 0 0 25 0 5 0 1129920193 259002368 60787 4294967295 134512640 135180984 3214906704 3086421872 134528756 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=252932 CPUtime=701.77
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 20756 0 0 0 70135 42 0 0 25 0 5 0 1129920193 259002368 60787 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=252932 CPUtime=701.97
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 23032 0 0 0 70148 49 0 0 25 0 5 0 1129920193 259002368 60787 4294967295 134512640 135180984 3214906704 3086290792 134518214 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2105.22
Current children cumulated vsize (KiB) 252932

[startup+762.317 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 17137
/proc/meminfo: memFree=2704192/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=259032 CPUtime=2285.04
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 63635 0 0 0 228282 222 0 0 18 0 5 0 1129920193 265248768 62174 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 64758 62174 68 164 0 64593 0
[pid=14674/tid=14675] ppid=14672 vsize=259032 CPUtime=0.69
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 234 0 0 0 19 50 0 0 15 0 5 0 1129920193 265248768 62174 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=259032 CPUtime=760.67
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 18956 0 0 0 75990 77 0 0 25 0 5 0 1129920193 265248768 62174 4294967295 134512640 135180984 3214906704 3086421872 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=259032 CPUtime=761.74
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 20781 0 0 0 76130 44 0 0 25 0 5 0 1129920193 265248768 62174 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=259032 CPUtime=761.94
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 23553 0 0 0 76143 51 0 0 25 0 5 0 1129920193 265248768 62174 4294967295 134512640 135180984 3214906704 3086290800 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2285.04
Current children cumulated vsize (KiB) 259032

[startup+822.305 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 17323
/proc/meminfo: memFree=2699860/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=264636 CPUtime=2464.85
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 64755 0 0 0 246252 233 0 0 18 0 5 0 1129920193 270987264 63294 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 66159 63294 68 164 0 65994 0
[pid=14674/tid=14675] ppid=14672 vsize=264636 CPUtime=0.74
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 237 0 0 0 20 54 0 0 15 0 5 0 1129920193 270987264 63294 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=264636 CPUtime=820.53
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 19582 0 0 0 81971 82 0 0 25 0 5 0 1129920193 270987264 63294 4294967295 134512640 135180984 3214906704 3086421872 134528211 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=264636 CPUtime=821.68
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 20809 0 0 0 82123 45 0 0 25 0 5 0 1129920193 270987264 63294 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=264636 CPUtime=821.9
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 24016 0 0 0 82138 52 0 0 25 0 5 0 1129920193 270987264 63294 4294967295 134512640 135180984 3214906704 3086290792 134518224 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2464.85
Current children cumulated vsize (KiB) 264636

[startup+882.312 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 17515
/proc/meminfo: memFree=2698628/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=266152 CPUtime=2644.8
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 65015 0 0 0 264235 245 0 0 18 0 5 0 1129920193 272539648 63554 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 66538 63554 68 164 0 66373 0
[pid=14674/tid=14675] ppid=14672 vsize=266152 CPUtime=0.83
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 237 0 0 0 23 60 0 0 15 0 5 0 1129920193 272539648 63554 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=266152 CPUtime=880.43
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 19584 0 0 0 87957 86 0 0 25 0 5 0 1129920193 272539648 63554 4294967295 134512640 135180984 3214906704 3086421872 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=266152 CPUtime=881.66
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 21008 0 0 0 88120 46 0 0 25 0 5 0 1129920193 272539648 63554 4294967295 134512640 135180984 3214906704 3086356336 134528680 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=266152 CPUtime=881.88
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 24075 0 0 0 88135 53 0 0 25 0 5 0 1129920193 272539648 63554 4294967295 134512640 135180984 3214906704 3086290792 134518224 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2644.8
Current children cumulated vsize (KiB) 266152

[startup+942.31 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 17703
/proc/meminfo: memFree=2693048/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=271436 CPUtime=2824.66
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 66462 0 0 0 282204 262 0 0 18 0 5 0 1129920193 277950464 65001 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 67859 65001 68 164 0 67694 0
[pid=14674/tid=14675] ppid=14672 vsize=271436 CPUtime=0.85
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 238 0 0 0 23 62 0 0 15 0 5 0 1129920193 277950464 65001 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=271436 CPUtime=940.31
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 19589 0 0 0 93933 98 0 0 25 0 5 0 1129920193 277950464 65001 4294967295 134512640 135180984 3214906704 3086421872 134528756 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=271436 CPUtime=941.63
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 22372 0 0 0 94115 48 0 0 25 0 5 0 1129920193 277950464 65001 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=271436 CPUtime=941.87
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 24152 0 0 0 94133 54 0 0 25 0 5 0 1129920193 277950464 65001 4294967295 134512640 135180984 3214906704 3086290800 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2824.66
Current children cumulated vsize (KiB) 271436



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 2.99 2.98 2.98 4/120 17891
/proc/meminfo: memFree=2686964/3368532 swapFree=1941392/1959888
[pid=14674] ppid=14672 vsize=278236 CPUtime=2997.55
/proc/14674/stat : 14674 (satake) S 14672 14674 11369 0 -1 4202496 68039 0 0 0 299479 276 0 0 18 0 5 0 1129920193 284913664 66578 4294967295 134512640 135180984 3214906704 3214906140 134573496 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14674/statm: 69559 66578 68 164 0 69394 0
[pid=14674/tid=14675] ppid=14672 vsize=278236 CPUtime=0.85
/proc/14674/task/14675/stat : 14675 (satake) S 14672 14674 11369 0 -1 4202560 239 0 0 0 23 62 0 0 15 0 5 0 1129920193 284913664 66578 4294967295 134512640 135180984 3214906704 3086487568 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=14674/tid=14676] ppid=14672 vsize=278236 CPUtime=997.85
/proc/14674/task/14676/stat : 14676 (satake) R 14672 14674 11369 0 -1 4202560 19592 0 0 0 99681 104 0 0 25 0 5 0 1129920193 284913664 66578 4294967295 134512640 135180984 3214906704 3086421872 134528680 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14674/tid=14677] ppid=14672 vsize=278236 CPUtime=999.3
/proc/14674/task/14677/stat : 14677 (satake) R 14672 14674 11369 0 -1 4202560 23542 0 0 0 99875 55 0 0 25 0 5 0 1129920193 284913664 66578 4294967295 134512640 135180984 3214906704 3086356336 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14674/tid=14678] ppid=14672 vsize=278236 CPUtime=999.55
/proc/14674/task/14678/stat : 14678 (satake) R 14672 14674 11369 0 -1 4202560 24555 0 0 0 99900 55 0 0 25 0 5 0 1129920193 284913664 66578 4294967295 134512640 135180984 3214906704 3086290796 134518246 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2997.55
Current children cumulated vsize (KiB) 278236

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.04
CPU time (s): 2997.62
CPU user time (s): 2994.85
CPU system time (s): 2.77
CPU usage (%): 299.749
Max. virtual memory (cumulated for all children) (KiB): 278236

deleting IPC queue 27262976
deleting IPC queue 27295745
deleting IPC queue 27328514
deleting IPC queue 27361283
deleting IPC queue 27394052
deleting IPC queue 27426821
deleting IPC queue 27459590
deleting IPC queue 27492359
deleting IPC queue 27525128
deleting IPC queue 27557897
deleting IPC queue 27590666
deleting IPC queue 27623435
deleting IPC queue 27656204
deleting IPC queue 27688973
deleting IPC queue 27721742
deleting IPC queue 27754511

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2994.85
system time used= 2.77
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 68039
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 83234
involuntary context switches= 98343

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 05:00:04
IDJOB=1781065
IDBENCH=71092
IDSOLVER=629
FILE ID=/1781065-1243652404
PBS_JOBID=
Free space on /tmp= 15728 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_12_UNKNOWN.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781065-1243652404/watcher-1781065-1243652404 -o /tmp/evaluation-result-1781065-1243652404/solver-1781065-1243652404 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1781065-1243652404.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= d18a114d646a89f18fb3efba2be009e6
RANDOM SEED= 822131311

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2952508 kB
Buffers:         49516 kB
Cached:         280096 kB
SwapCached:       4320 kB
Active:         143016 kB
Inactive:       197240 kB
HighTotal:     2489216 kB
HighFree:      2196220 kB
LowTotal:       879316 kB
LowFree:        756288 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            2492 kB
Writeback:           0 kB
AnonPages:        9432 kB
Mapped:           4288 kB
Slab:            64628 kB
SReclaimable:    56072 kB
SUnreclaim:       8556 kB
PageTables:        780 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127080 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15728 MiB
End job on  at 2009-05-30 05:16:46