Trace number 1780930

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 2998.01 1000.04

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_10_UNSAT.cnf
MD5SUM54c22a62e5d0a640d4ea8d185b9b1fc7
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2112
Number of clauses191788
Sum of the clauses size572017
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23595
Number of clauses of size 3188162
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780930-1243651400/watcher-1780930-1243651400 -o /tmp/evaluation-result-1780930-1243651400/solver-1780930-1243651400 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780930-1243651400.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.99 2.97 2.97 3/115 11609
/proc/meminfo: memFree=2952356/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=5264 CPUtime=0
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 816 0 0 0 0 0 0 0 18 0 5 0 1129819865 5390336 773 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 1316 777 63 164 0 1151 0
[pid=11609/tid=11610] ppid=11607 vsize=5264 CPUtime=0
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129819865 5390336 840 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=5264 CPUtime=0
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 770 0 0 0 0 0 0 0 20 0 5 0 1129819865 5390336 845 4294967295 134512640 135180984 3219259760 3086455076 134583077 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=5264 CPUtime=0
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1129819865 5390336 850 4294967295 134512640 135180984 3219259760 3086390084 134705812 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=5264 CPUtime=0
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1129819865 5390336 855 4294967295 134512640 135180984 3219259760 3086324548 134705812 0 0 0 0 0 0 0 -1 2 0 0 0

[startup+0.078007 s]
/proc/loadavg: 2.99 2.97 2.97 3/115 11609
/proc/meminfo: memFree=2952356/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=19696 CPUtime=0.16
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 4324 0 0 0 15 1 0 0 18 0 5 0 1129819865 20168704 4262 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 4924 4262 63 164 0 4759 0
[pid=11609/tid=11610] ppid=11607 vsize=19696 CPUtime=0
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129819865 20168704 4262 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=19696 CPUtime=0.05
/proc/11609/task/11611/stat : 11611 (satake) D 11607 11609 11369 0 -1 4202560 1473 0 0 0 5 0 0 0 20 0 5 0 1129819865 20168704 4262 4294967295 134512640 135180984 3219259760 3086454864 134702260 0 0 0 0 3223098951 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=19696 CPUtime=0.06
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 1358 0 0 0 5 1 0 0 20 0 5 0 1129819865 20168704 4262 4294967295 134512640 135180984 3219259760 3086389220 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=19696 CPUtime=0.05
/proc/11609/task/11613/stat : 11613 (satake) D 11607 11609 11369 0 -1 4202560 1375 0 0 0 5 0 0 0 20 0 5 0 1129819865 20168704 4262 4294967295 134512640 135180984 3219259760 3086323640 134869198 0 0 0 0 3223098951 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 19696

[startup+0.107513 s]
/proc/loadavg: 2.99 2.97 2.97 3/115 11609
/proc/meminfo: memFree=2952356/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=24684 CPUtime=0.25
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 5389 0 0 0 23 2 0 0 18 0 5 0 1129819865 25276416 5327 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 6171 5328 63 164 0 6006 0
[pid=11609/tid=11610] ppid=11607 vsize=24684 CPUtime=0
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129819865 25276416 5328 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=24684 CPUtime=0.08
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 1812 0 0 0 7 1 0 0 20 0 5 0 1129819865 25276416 5328 4294967295 134512640 135180984 3219259760 3086454872 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=24684 CPUtime=0.09
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 1713 0 0 0 8 1 0 0 20 0 5 0 1129819865 25276416 5328 4294967295 134512640 135180984 3219259760 3086389496 134519901 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=24684 CPUtime=0.08
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 1749 0 0 0 8 0 0 0 20 0 5 0 1129819865 25276416 5332 4294967295 134512640 135180984 3219259760 3086323984 134520025 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 24684

[startup+0.307509 s]
/proc/loadavg: 2.99 2.97 2.97 3/115 11609
/proc/meminfo: memFree=2952356/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=28220 CPUtime=0.84
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 8437 0 0 0 79 5 0 0 18 0 5 0 1129819865 28897280 6080 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 7055 6080 68 164 0 6890 0
[pid=11609/tid=11610] ppid=11607 vsize=28220 CPUtime=0.01
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 44 0 0 0 1 0 0 0 16 0 5 0 1129819865 28897280 6080 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=28220 CPUtime=0.27
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 2638 0 0 0 26 1 0 0 19 0 5 0 1129819865 28897280 6080 4294967295 134512640 135180984 3219259760 3086454640 134528470 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=28220 CPUtime=0.29
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 2785 0 0 0 27 2 0 0 19 0 5 0 1129819865 28897280 6080 4294967295 134512640 135180984 3219259760 3086389040 134523635 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=28220 CPUtime=0.27
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 2859 0 0 0 25 2 0 0 19 0 5 0 1129819865 28897280 6080 4294967295 134512640 135180984 3219259760 3086323284 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.84
Current children cumulated vsize (KiB) 28220

[startup+0.707493 s]
/proc/loadavg: 2.99 2.97 2.97 3/115 11609
/proc/meminfo: memFree=2952356/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=29412 CPUtime=2.04
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 8858 0 0 0 195 9 0 0 18 0 5 0 1129819865 30117888 6501 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 7353 6501 68 164 0 7188 0
[pid=11609/tid=11610] ppid=11607 vsize=29412 CPUtime=0.01
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 48 0 0 0 1 0 0 0 16 0 5 0 1129819865 30117888 6501 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=29412 CPUtime=0.67
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 2787 0 0 0 64 3 0 0 20 0 5 0 1129819865 30117888 6501 4294967295 134512640 135180984 3219259760 3086454632 134518252 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=29412 CPUtime=0.69
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 2940 0 0 0 67 2 0 0 20 0 5 0 1129819865 30117888 6501 4294967295 134512640 135180984 3219259760 3086389104 134528866 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=29412 CPUtime=0.67
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 2972 0 0 0 63 4 0 0 19 0 5 0 1129819865 30117888 6501 4294967295 134512640 135180984 3219259760 3086323568 134528219 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.04
Current children cumulated vsize (KiB) 29412

[startup+1.50746 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11614
/proc/meminfo: memFree=2926308/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=31000 CPUtime=4.44
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 9393 0 0 0 433 11 0 0 18 0 5 0 1129819865 31744000 7036 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 7750 7036 68 164 0 7585 0
[pid=11609/tid=11610] ppid=11607 vsize=31000 CPUtime=0.01
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 53 0 0 0 1 0 0 0 15 0 5 0 1129819865 31744000 7036 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=31000 CPUtime=1.47
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 2925 0 0 0 144 3 0 0 22 0 5 0 1129819865 31744000 7036 4294967295 134512640 135180984 3219259760 3086454640 134528568 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=31000 CPUtime=1.49
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 3131 0 0 0 147 2 0 0 22 0 5 0 1129819865 31744000 7036 4294967295 134512640 135180984 3219259760 3086389104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=31000 CPUtime=1.47
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 3173 0 0 0 141 6 0 0 21 0 5 0 1129819865 31744000 7036 4294967295 134512640 135180984 3219259760 3086323400 134675846 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.44
Current children cumulated vsize (KiB) 31000

[startup+3.1074 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11614
/proc/meminfo: memFree=2923912/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=34136 CPUtime=9.24
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 10048 0 0 0 905 19 0 0 18 0 5 0 1129819865 34955264 7691 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 8534 7691 68 164 0 8369 0
[pid=11609/tid=11610] ppid=11607 vsize=34136 CPUtime=0.09
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 70 0 0 0 4 5 0 0 15 0 5 0 1129819865 34955264 7691 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=34136 CPUtime=2.99
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 3093 0 0 0 296 3 0 0 25 0 5 0 1129819865 34955264 7691 4294967295 134512640 135180984 3219259760 3086454640 134528519 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=34136 CPUtime=3.09
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 3324 0 0 0 305 4 0 0 25 0 5 0 1129819865 34955264 7691 4294967295 134512640 135180984 3219259760 3086389104 134528862 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=34136 CPUtime=3.07
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 3450 0 0 0 300 7 0 0 25 0 5 0 1129819865 34955264 7691 4294967295 134512640 135180984 3219259760 3086323568 134528652 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.24
Current children cumulated vsize (KiB) 34136

[startup+6.30727 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11614
/proc/meminfo: memFree=2918740/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=40048 CPUtime=18.84
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 11239 0 0 0 1852 32 0 0 18 0 5 0 1129819865 41009152 8882 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 10012 8882 68 164 0 9847 0
[pid=11609/tid=11610] ppid=11607 vsize=40048 CPUtime=0.19
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 99 0 0 0 7 12 0 0 16 0 5 0 1129819865 41009152 8882 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=40048 CPUtime=6.09
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 3433 0 0 0 605 4 0 0 25 0 5 0 1129819865 41009152 8882 4294967295 134512640 135180984 3219259760 3086454640 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=40048 CPUtime=6.29
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 3718 0 0 0 622 7 0 0 25 0 5 0 1129819865 41009152 8882 4294967295 134512640 135180984 3219259760 3086389104 134528652 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=40048 CPUtime=6.27
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 3878 0 0 0 618 9 0 0 25 0 5 0 1129819865 41009152 8882 4294967295 134512640 135180984 3219259760 3086323568 134528536 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.84
Current children cumulated vsize (KiB) 40048

[startup+12.717 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11614
/proc/meminfo: memFree=2909144/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=48436 CPUtime=38.07
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 13598 0 0 0 3763 44 0 0 18 0 5 0 1129819865 49598464 11241 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 12109 11241 68 164 0 11944 0
[pid=11609/tid=11610] ppid=11607 vsize=48436 CPUtime=0.27
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 116 0 0 0 9 18 0 0 15 0 5 0 1129819865 49598464 11241 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=48436 CPUtime=12.42
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 4177 0 0 0 1238 4 0 0 25 0 5 0 1129819865 49598464 11241 4294967295 134512640 135180984 3219259760 3086454640 134528568 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=48436 CPUtime=12.7
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 4456 0 0 0 1258 12 0 0 25 0 5 0 1129819865 49598464 11241 4294967295 134512640 135180984 3219259760 3086389104 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=48436 CPUtime=12.68
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 4738 0 0 0 1258 10 0 0 25 0 5 0 1129819865 49598464 11241 4294967295 134512640 135180984 3219259760 3086323568 134528206 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38.07
Current children cumulated vsize (KiB) 48436

[startup+25.5165 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11615
/proc/meminfo: memFree=2896144/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=61100 CPUtime=76.45
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 16717 0 0 0 7587 58 0 0 18 0 5 0 1129819865 62566400 14360 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 15275 14360 68 164 0 15110 0
[pid=11609/tid=11610] ppid=11607 vsize=61100 CPUtime=0.34
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 135 0 0 0 9 25 0 0 15 0 5 0 1129819865 62566400 14361 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=61100 CPUtime=25.15
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 5170 0 0 0 2508 7 0 0 25 0 5 0 1129819865 62566400 14361 4294967295 134512640 135180984 3219259760 3086454640 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=61100 CPUtime=25.49
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 5352 0 0 0 2535 14 0 0 25 0 5 0 1129819865 62566400 14361 4294967295 134512640 135180984 3219259760 3086389100 134518208 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=61100 CPUtime=25.47
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 5950 0 0 0 2535 12 0 0 25 0 5 0 1129819865 62566400 14361 4294967295 134512640 135180984 3219259760 3086323400 134675846 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 76.45
Current children cumulated vsize (KiB) 61100

[startup+51.1155 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11618
/proc/meminfo: memFree=2879536/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=79080 CPUtime=153.18
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 20911 0 0 0 15245 73 0 0 18 0 5 0 1129819865 80977920 18554 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 19770 18554 68 164 0 19605 0
[pid=11609/tid=11610] ppid=11607 vsize=79080 CPUtime=0.41
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 158 0 0 0 11 30 0 0 15 0 5 0 1129819865 80977920 18554 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=79080 CPUtime=50.64
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 6351 0 0 0 5051 13 0 0 25 0 5 0 1129819865 80977920 18554 4294967295 134512640 135180984 3219259760 3086454640 134528648 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=79080 CPUtime=51.06
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 6608 0 0 0 5092 14 0 0 25 0 5 0 1129819865 80977920 18554 4294967295 134512640 135180984 3219259760 3086389104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=79080 CPUtime=51.07
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 7683 0 0 0 5091 16 0 0 25 0 5 0 1129819865 80977920 18554 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 153.18
Current children cumulated vsize (KiB) 79080

[startup+102.313 s]
/proc/loadavg: 2.99 2.97 2.97 4/120 11808

################
# More data... #
################

[pid=11609/tid=11611] ppid=11607 vsize=211316 CPUtime=521.33
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 16753 0 0 0 52110 23 0 0 25 0 5 0 1129819865 216387584 50151 4294967295 134512640 135180984 3219259760 3086454640 134528866 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=211316 CPUtime=522.09
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 17337 0 0 0 52181 28 0 0 25 0 5 0 1129819865 216387584 50151 4294967295 134512640 135180984 3219259760 3086389104 134528674 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=211316 CPUtime=522.05
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 18099 0 0 0 52156 49 0 0 25 0 5 0 1129819865 216387584 50151 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1566.06
Current children cumulated vsize (KiB) 211316

[startup+582.314 s]
/proc/loadavg: 3.01 3.00 2.98 4/120 13317
/proc/meminfo: memFree=2738548/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=225344 CPUtime=1745.97
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 55820 0 0 0 174445 152 0 0 18 0 5 0 1129819865 230752256 53455 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 56336 53455 68 164 0 56171 0
[pid=11609/tid=11610] ppid=11607 vsize=225344 CPUtime=0.61
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 209 0 0 0 14 47 0 0 15 0 5 0 1129819865 230752256 53455 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=225344 CPUtime=581.28
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 17553 0 0 0 58104 24 0 0 25 0 5 0 1129819865 230752256 53455 4294967295 134512640 135180984 3219259760 3086454640 134528688 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=225344 CPUtime=582.08
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 18123 0 0 0 58179 29 0 0 25 0 5 0 1129819865 230752256 53455 4294967295 134512640 135180984 3219259760 3086389104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=225344 CPUtime=582
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 19824 0 0 0 58148 52 0 0 25 0 5 0 1129819865 230752256 53455 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1745.97
Current children cumulated vsize (KiB) 225344

[startup+642.312 s]
/proc/loadavg: 3.00 3.00 2.98 4/120 13506
/proc/meminfo: memFree=2723164/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=239836 CPUtime=1925.89
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 59424 0 0 0 192430 159 0 0 18 0 5 0 1129819865 245592064 57059 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 59959 57059 68 164 0 59794 0
[pid=11609/tid=11610] ppid=11607 vsize=239836 CPUtime=0.62
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 212 0 0 0 14 48 0 0 15 0 5 0 1129819865 245592064 57059 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=239836 CPUtime=641.23
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 18549 0 0 0 64097 26 0 0 25 0 5 0 1129819865 245592064 57059 4294967295 134512640 135180984 3219259760 3086454640 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=239836 CPUtime=642.07
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 19084 0 0 0 64177 30 0 0 25 0 5 0 1129819865 245592064 57059 4294967295 134512640 135180984 3219259760 3086389104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=239836 CPUtime=641.97
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 21468 0 0 0 64142 55 0 0 25 0 5 0 1129819865 245592064 57059 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1925.89
Current children cumulated vsize (KiB) 239836

[startup+702.31 s]
/proc/loadavg: 3.00 3.00 2.98 4/120 13692
/proc/meminfo: memFree=2711764/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=253020 CPUtime=2105.74
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 62424 0 0 0 210404 170 0 0 18 0 5 0 1129819865 259092480 60051 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 63255 60051 68 164 0 63090 0
[pid=11609/tid=11610] ppid=11607 vsize=253020 CPUtime=0.65
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 214 0 0 0 16 49 0 0 15 0 5 0 1129819865 259092480 60051 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=253020 CPUtime=701.17
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 19511 0 0 0 70090 27 0 0 25 0 5 0 1129819865 259092480 60051 4294967295 134512640 135180984 3219259760 3086454632 134519890 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=253020 CPUtime=702.06
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 19741 0 0 0 70173 33 0 0 25 0 5 0 1129819865 259092480 60051 4294967295 134512640 135180984 3219259760 3086389104 134528641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=253020 CPUtime=701.86
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 22847 0 0 0 70125 61 0 0 25 0 5 0 1129819865 259092480 60051 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2105.74
Current children cumulated vsize (KiB) 253020

[startup+762.317 s]
/proc/loadavg: 3.15 3.05 3.00 4/120 13884
/proc/meminfo: memFree=2700108/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=263592 CPUtime=2285.58
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 65340 0 0 0 228377 181 0 0 18 0 5 0 1129819865 269918208 62967 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 65898 62967 68 164 0 65733 0
[pid=11609/tid=11610] ppid=11607 vsize=263592 CPUtime=0.69
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 218 0 0 0 18 51 0 0 15 0 5 0 1129819865 269918208 62967 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=263592 CPUtime=761.09
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 20226 0 0 0 76079 30 0 0 25 0 5 0 1129819865 269918208 62967 4294967295 134512640 135180984 3219259760 3086454640 134528543 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=263592 CPUtime=762.05
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 20456 0 0 0 76170 35 0 0 25 0 5 0 1129819865 269918208 62967 4294967295 134512640 135180984 3219259760 3086389104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=263592 CPUtime=761.75
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 24329 0 0 0 76110 65 0 0 25 0 5 0 1129819865 269918208 62967 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2285.58
Current children cumulated vsize (KiB) 263592

[startup+822.315 s]
/proc/loadavg: 3.05 3.04 3.00 4/120 14072
/proc/meminfo: memFree=2688080/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=276928 CPUtime=2465.19
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 68522 0 0 0 246312 207 0 0 18 0 5 0 1129819865 283574272 66149 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 69232 66149 68 164 0 69067 0
[pid=11609/tid=11610] ppid=11607 vsize=276928 CPUtime=0.71
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 219 0 0 0 19 52 0 0 15 0 5 0 1129819865 283574272 66149 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=276928 CPUtime=821.01
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 20777 0 0 0 82071 30 0 0 25 0 5 0 1129819865 283574272 66149 4294967295 134512640 135180984 3219259760 3086454640 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=276928 CPUtime=822.04
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 21084 0 0 0 82167 37 0 0 25 0 5 0 1129819865 283574272 66149 4294967295 134512640 135180984 3219259760 3086389100 134518218 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=276928 CPUtime=821.43
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 26331 0 0 0 82055 88 0 0 25 0 5 0 1129819865 283574272 66149 4294967295 134512640 135180984 3219259760 3086323568 134528524 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2465.19
Current children cumulated vsize (KiB) 276928

[startup+882.312 s]
/proc/loadavg: 3.15 3.06 3.01 4/120 14260
/proc/meminfo: memFree=2678904/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=288680 CPUtime=2645.02
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 70579 0 0 0 264292 210 0 0 18 0 5 0 1129819865 295608320 68206 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 72170 68206 68 164 0 72005 0
[pid=11609/tid=11610] ppid=11607 vsize=288680 CPUtime=0.71
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 220 0 0 0 19 52 0 0 15 0 5 0 1129819865 295608320 68206 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=288680 CPUtime=880.95
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 21302 0 0 0 88065 30 0 0 25 0 5 0 1129819865 295608320 68206 4294967295 134512640 135180984 3219259760 3086454640 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=288680 CPUtime=882.02
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 21680 0 0 0 88164 38 0 0 25 0 5 0 1129819865 295608320 68206 4294967295 134512640 135180984 3219259760 3086389104 134528688 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=288680 CPUtime=881.34
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 27266 0 0 0 88044 90 0 0 25 0 5 0 1129819865 295608320 68206 4294967295 134512640 135180984 3219259760 3086323560 134518216 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2645.02
Current children cumulated vsize (KiB) 288680

[startup+942.31 s]
/proc/loadavg: 3.05 3.05 3.00 4/120 14449
/proc/meminfo: memFree=2672696/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=294560 CPUtime=2824.91
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 72245 0 0 0 282269 222 0 0 18 0 5 0 1129819865 301629440 69872 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 73640 69872 68 164 0 73475 0
[pid=11609/tid=11610] ppid=11607 vsize=294560 CPUtime=0.73
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 223 0 0 0 19 54 0 0 15 0 5 0 1129819865 301629440 69872 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=294560 CPUtime=940.9
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 21898 0 0 0 94058 32 0 0 25 0 5 0 1129819865 301629440 69872 4294967295 134512640 135180984 3219259760 3086454544 134525385 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=294560 CPUtime=942
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 22261 0 0 0 94161 39 0 0 25 0 5 0 1129819865 301629440 69872 4294967295 134512640 135180984 3219259760 3086389072 134520035 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=294560 CPUtime=941.28
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 27752 0 0 0 94031 97 0 0 25 0 5 0 1129819865 301629440 69872 4294967295 134512640 135180984 3219259760 3086323568 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2824.91
Current children cumulated vsize (KiB) 294560



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 3.02 3.04 3.00 4/120 14635
/proc/meminfo: memFree=2665760/3368532 swapFree=1941392/1959888
[pid=11609] ppid=11607 vsize=301800 CPUtime=2997.94
/proc/11609/stat : 11609 (satake) S 11607 11609 11369 0 -1 4202496 74006 0 0 0 299564 230 0 0 18 0 5 0 1129819865 309043200 71633 4294967295 134512640 135180984 3219259760 3219259196 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/11609/statm: 75450 71633 68 164 0 75285 0
[pid=11609/tid=11610] ppid=11607 vsize=301800 CPUtime=0.74
/proc/11609/task/11610/stat : 11610 (satake) S 11607 11609 11369 0 -1 4202560 227 0 0 0 19 55 0 0 15 0 5 0 1129819865 309043200 71633 4294967295 134512640 135180984 3219259760 3086520336 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11609/tid=11611] ppid=11607 vsize=301800 CPUtime=998.59
/proc/11609/task/11611/stat : 11611 (satake) R 11607 11609 11369 0 -1 4202560 22482 0 0 0 99826 33 0 0 25 0 5 0 1129819865 309043200 71633 4294967295 134512640 135180984 3219259760 3086454636 134520036 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11609/tid=11612] ppid=11607 vsize=301800 CPUtime=999.69
/proc/11609/task/11612/stat : 11612 (satake) R 11607 11609 11369 0 -1 4202560 23018 0 0 0 99930 39 0 0 25 0 5 0 1129819865 309043200 71633 4294967295 134512640 135180984 3219259760 3086389104 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11609/tid=11613] ppid=11607 vsize=301800 CPUtime=998.92
/proc/11609/task/11613/stat : 11613 (satake) R 11607 11609 11369 0 -1 4202560 28168 0 0 0 99789 103 0 0 25 0 5 0 1129819865 309043200 71633 4294967295 134512640 135180984 3219259760 3086323536 134519935 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2997.94
Current children cumulated vsize (KiB) 301800

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.04
CPU time (s): 2998.01
CPU user time (s): 2995.7
CPU system time (s): 2.31
CPU usage (%): 299.788
Max. virtual memory (cumulated for all children) (KiB): 301800

deleting IPC queue 26738688
deleting IPC queue 26771457
deleting IPC queue 26804226
deleting IPC queue 26836995
deleting IPC queue 26869764
deleting IPC queue 26902533
deleting IPC queue 26935302
deleting IPC queue 26968071
deleting IPC queue 27000840
deleting IPC queue 27033609
deleting IPC queue 27066378
deleting IPC queue 27099147
deleting IPC queue 27131916
deleting IPC queue 27164685
deleting IPC queue 27197454
deleting IPC queue 27230223

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2995.7
system time used= 2.31
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74006
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 82891
involuntary context switches= 105667

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 04:43:20
IDJOB=1780930
IDBENCH=71080
IDSOLVER=629
FILE ID=/1780930-1243651400
PBS_JOBID=
Free space on /tmp= 15727 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_10_UNSAT.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780930-1243651400/watcher-1780930-1243651400 -o /tmp/evaluation-result-1780930-1243651400/solver-1780930-1243651400 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780930-1243651400.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 54c22a62e5d0a640d4ea8d185b9b1fc7
RANDOM SEED= 1257158785

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2952356 kB
Buffers:         49516 kB
Cached:         281172 kB
SwapCached:       4320 kB
Active:         144116 kB
Inactive:       197116 kB
HighTotal:     2489216 kB
HighFree:      2195964 kB
LowTotal:       879316 kB
LowFree:        756392 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            3812 kB
Writeback:           0 kB
AnonPages:        9128 kB
Mapped:           4296 kB
Slab:            65024 kB
SReclaimable:    56064 kB
SUnreclaim:       8960 kB
PageTables:        748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127076 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15727 MiB
End job on  at 2009-05-30 05:00:03