Trace number 3299376

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.23 1202.39

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf
MD5SUM1002234f62b5dfa01a75197c65e66327
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.921859
Satisfiable
(Un)Satisfiability was proved
Number of variables1285
Number of clauses166723
Sum of the clauses size334661
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2166688
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...110749/instance-3299376-1304110749.cnf
0.69/0.73	c Solving...
4800.03/1202.21	
4800.03/1202.21	*** INTERRUPTED! ***
4800.03/1202.21	*** Shutting down threads...
4800.15/1202.38	s UNKNOWN
4800.15/1202.38	
4800.15/1202.38	c INTERRUPTED   : 1
4800.15/1202.38	c Models        : 0+    
4800.15/1202.38	c Time          : 1202.240s (Solving: 1201.51s 1st Model: 0.00s Unsat: 0.00s)
4800.15/1202.38	c CPU Time      : 4800.080s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299376-1304110749/watcher-3299376-1304110749 -o /tmp/evaluation-result-3299376-1304110749/solver-3299376-1304110749 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299376-1304110749.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.09 8.07 1/179 4507
/proc/meminfo: memFree=30469508/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=21604 CPUtime=0 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 690 0 0 0 0 0 0 0 25 0 1 0 522672768 22122496 610 33554432000 4194304 4964704 140735491914624 18446744073709551615 271550198469 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4507/statm: 5401 611 385 189 0 275 0

[startup+0.00911703 s]
/proc/loadavg: 8.13 8.09 8.07 1/179 4507
/proc/meminfo: memFree=30469508/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=22216 CPUtime=0 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 876 0 0 0 0 0 0 0 25 0 1 0 522672768 22749184 761 33554432000 4194304 4964704 140735491914624 18446744073709551615 271550198469 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4507/statm: 5554 762 385 189 0 428 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 22216

[startup+0.101104 s]
/proc/loadavg: 8.13 8.09 8.07 1/179 4507
/proc/meminfo: memFree=30469508/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=31672 CPUtime=0.09 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 3856 0 0 0 9 0 0 0 25 0 1 0 522672768 32432128 3020 33554432000 4194304 4964704 140735491914624 18446744073709551615 4607644 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4507/statm: 7918 3020 398 189 0 2792 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31672

[startup+0.301057 s]
/proc/loadavg: 8.13 8.09 8.07 1/179 4507
/proc/meminfo: memFree=30469508/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=31672 CPUtime=0.29 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 3856 0 0 0 29 0 0 0 25 0 1 0 522672768 32432128 3020 33554432000 4194304 4964704 140735491914624 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4507/statm: 7918 3020 398 189 0 2792 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 31672

[startup+0.700982 s]
/proc/loadavg: 8.13 8.09 8.07 1/179 4507
/proc/meminfo: memFree=30469508/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=32596 CPUtime=0.69 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 4119 0 0 0 69 0 0 0 25 0 1 0 522672768 33378304 3283 33554432000 4194304 4964704 140735491914624 18446744073709551615 4608110 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4507/statm: 8149 3283 399 189 0 3023 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 32596

[startup+1.50081 s]
/proc/loadavg: 8.13 8.09 8.07 9/188 4541
/proc/meminfo: memFree=30535376/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=180984 CPUtime=3.76 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 9232 0 0 0 374 2 0 0 25 0 4 0 522672768 185327616 8052 33554432000 4194304 4964704 140735491914624 18446744073709551615 4653552 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 45246 8052 458 189 0 39595 0
[pid=4507/tid=4539] ppid=4505 vsize=180984 CPUtime=0.75 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 1423 0 0 0 75 0 0 0 25 0 4 0 522672842 185327616 8052 33554432000 4194304 4964704 140735491914624 18446744073709551615 4654508 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=180984 CPUtime=0.75 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 1125 0 0 0 75 0 0 0 25 0 4 0 522672842 185327616 8052 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=180984 CPUtime=0.75 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 1194 0 0 0 75 0 0 0 25 0 4 0 522672842 185327616 8052 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.76
Current children cumulated vsize (KiB) 180984

[startup+3.10052 s]
/proc/loadavg: 8.36 8.14 8.08 9/188 4541
/proc/meminfo: memFree=30507292/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=253096 CPUtime=10.15 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 14132 0 0 0 1011 4 0 0 25 0 4 0 522672768 259170304 12952 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 63274 12952 458 189 0 57623 0
[pid=4507/tid=4539] ppid=4505 vsize=253096 CPUtime=2.34 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 2722 0 0 0 234 0 0 0 18 0 4 0 522672842 259170304 12952 33554432000 4194304 4964704 140735491914624 18446744073709551615 4627248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=253096 CPUtime=2.35 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 2142 0 0 0 235 0 0 0 25 0 4 0 522672842 259170304 12952 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=253096 CPUtime=2.34 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 2341 0 0 0 233 1 0 0 19 0 4 0 522672842 259170304 12952 33554432000 4194304 4964704 140735491914624 18446744073709551615 4627868 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.15
Current children cumulated vsize (KiB) 253096

[startup+6.30093 s]
/proc/loadavg: 8.36 8.14 8.08 9/188 4541
/proc/meminfo: memFree=30459676/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=260820 CPUtime=22.94 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 20953 0 0 0 2287 7 0 0 25 0 4 0 522672768 267079680 19773 33554432000 4194304 4964704 140735491914624 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 65205 19773 460 189 0 59554 0
[pid=4507/tid=4539] ppid=4505 vsize=260820 CPUtime=5.55 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 3840 0 0 0 554 1 0 0 25 0 4 0 522672842 267079680 19773 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=260820 CPUtime=5.55 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 3240 0 0 0 554 1 0 0 25 0 4 0 522672842 267079680 19773 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320864 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=260820 CPUtime=5.53 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 4860 0 0 0 551 2 0 0 25 0 4 0 522672842 267079680 19773 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 22.94
Current children cumulated vsize (KiB) 260820

[startup+12.7008 s]
/proc/loadavg: 8.38 8.15 8.09 9/188 4541
/proc/meminfo: memFree=30392680/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=268904 CPUtime=48.5 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 31392 0 0 0 4838 12 0 0 25 0 4 0 522672768 275357696 30212 33554432000 4194304 4964704 140735491914624 18446744073709551615 4668942 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 67226 30212 460 189 0 61575 0
[pid=4507/tid=4539] ppid=4505 vsize=268904 CPUtime=11.95 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 7933 0 0 0 1192 3 0 0 25 0 4 0 522672842 275357696 30212 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=268904 CPUtime=11.95 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 4645 0 0 0 1194 1 0 0 25 0 4 0 522672842 275357696 30212 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=268904 CPUtime=11.89 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 6196 0 0 0 1186 3 0 0 25 0 4 0 522672842 275357696 30212 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.5
Current children cumulated vsize (KiB) 268904

[startup+25.5005 s]
/proc/loadavg: 8.32 8.14 8.09 6/185 4569
/proc/meminfo: memFree=30375848/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=269824 CPUtime=99.63 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 41386 0 0 0 9945 18 0 0 25 0 4 0 522672768 276299776 40202 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321082 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 67456 40202 460 189 0 61805 0
[pid=4507/tid=4539] ppid=4505 vsize=269824 CPUtime=24.74 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 8470 0 0 0 2471 3 0 0 25 0 4 0 522672842 276299776 40202 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=269824 CPUtime=24.76 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 5054 0 0 0 2474 2 0 0 25 0 4 0 522672842 276299776 40202 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=269824 CPUtime=24.61 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 7432 0 0 0 2458 3 0 0 25 0 4 0 522672842 276299776 40202 33554432000 4194304 4964704 140735491914624 18446744073709551615 4668512 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 99.63
Current children cumulated vsize (KiB) 269824

[startup+51.1008 s]
/proc/loadavg: 8.12 8.10 8.07 10/188 4572
/proc/meminfo: memFree=30121860/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=297980 CPUtime=201.88 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 52541 0 0 0 20164 24 0 0 25 0 4 0 522672768 305131520 51308 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 74495 51308 460 189 0 68844 0
[pid=4507/tid=4539] ppid=4505 vsize=297980 CPUtime=50.34 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 10439 0 0 0 5029 5 0 0 25 0 4 0 522672842 305131520 51308 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=297980 CPUtime=50.35 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 5741 0 0 0 5033 2 0 0 25 0 4 0 522672842 305131520 51308 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=297980 CPUtime=50.07 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 11794 0 0 0 5002 5 0 0 25 0 4 0 522672842 305131520 51308 33554432000 4194304 4964704 140735491914624 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.88
Current children cumulated vsize (KiB) 297980

[startup+102.307 s]
/proc/loadavg: 8.19 8.11 8.08 9/188 4574
/proc/meminfo: memFree=29842016/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=429360 CPUtime=406.43 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 76915 0 0 0 40597 46 0 0 25 0 4 0 522672768 439664640 75578 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 107340 75578 460 189 0 101689 0
[pid=4507/tid=4539] ppid=4505 vsize=429360 CPUtime=101.54 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 19963 0 0 0 10142 12 0 0 25 0 4 0 522672842 439664640 75578 33554432000 4194304 4964704 140735491914624 18446744073709551615 4644880 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=429360 CPUtime=101.56 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 7645 0 0 0 10153 3 0 0 25 0 4 0 522672842 439664640 75578 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=429360 CPUtime=101 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 22448 0 0 0 10083 17 0 0 25 0 4 0 522672842 439664640 75578 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.43
Current children cumulated vsize (KiB) 429360

[startup+162.301 s]
/proc/loadavg: 8.14 8.11 8.08 9/188 4584
/proc/meminfo: memFree=29670988/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=495788 CPUtime=646.07 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 82220 0 0 0 64555 52 0 0 25 0 4 0 522672768 507686912 80746 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 123947 80746 460 189 0 118296 0
[pid=4507/tid=4539] ppid=4505 vsize=495788 CPUtime=161.53 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 20297 0 0 0 16140 13 0 0 25 0 4 0 522672842 507686912 80746 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=495788 CPUtime=161.55 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 8846 0 0 0 16152 3 0 0 25 0 4 0 522672842 507686912 80746 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=495788 CPUtime=160.67 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 22484 0 0 0 16049 18 0 0 25 0 4 0 522672842 507686912 80746 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 646.07
Current children cumulated vsize (KiB) 495788

[startup+222.301 s]
/proc/loadavg: 8.29 8.15 8.09 9/188 4586
/proc/meminfo: memFree=29565180/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=497596 CPUtime=885.74 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 98761 0 0 0 88501 73 0 0 25 0 4 0 522672768 509538304 97271 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 124399 97271 460 189 0 118748 0
[pid=4507/tid=4539] ppid=4505 vsize=497596 CPUtime=221.53 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 24312 0 0 0 22136 17 0 0 25 0 4 0 522672842 509538304 97271 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670062 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=497596 CPUtime=221.55 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 9301 0 0 0 22152 3 0 0 25 0 4 0 522672842 509538304 97271 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=497596 CPUtime=220.33 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 34410 0 0 0 21999 34 0 0 25 0 4 0 522672842 509538304 97271 33554432000 4194304 4964704 140735491914624 18446744073709551615 4683951 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 885.74
Current children cumulated vsize (KiB) 497596

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2563.46
Current children cumulated vsize (KiB) 809688

[startup+702.301 s]
/proc/loadavg: 8.24 8.24 8.16 9/188 4602
/proc/meminfo: memFree=28798420/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=809688 CPUtime=2803.11 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 170336 0 0 0 280177 134 0 0 25 0 4 0 522672768 829120512 168514 33554432000 4194304 4964704 140735491914624 18446744073709551615 4627299 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 202422 168514 460 189 0 196771 0
[pid=4507/tid=4539] ppid=4505 vsize=809688 CPUtime=701.51 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 36292 0 0 0 70125 26 0 0 25 0 4 0 522672842 829120512 168514 33554432000 4194304 4964704 140735491914624 18446744073709551615 4342199 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=809688 CPUtime=701.56 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 24023 0 0 0 70147 9 0 0 25 0 4 0 522672842 829120512 168514 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=809688 CPUtime=697.72 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 56205 0 0 0 69708 64 0 0 25 0 4 0 522672842 829120512 168514 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2803.11
Current children cumulated vsize (KiB) 809688

[startup+762.307 s]
/proc/loadavg: 8.12 8.21 8.15 10/188 4603
/proc/meminfo: memFree=28639652/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=809688 CPUtime=3042.82 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 180569 0 0 0 304136 146 0 0 25 0 4 0 522672768 829120512 178747 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 202422 178747 460 189 0 196771 0
[pid=4507/tid=4539] ppid=4505 vsize=809688 CPUtime=761.52 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 37964 0 0 0 76124 28 0 0 25 0 4 0 522672842 829120512 178747 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=809688 CPUtime=761.57 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 25549 0 0 0 76147 10 0 0 25 0 4 0 522672842 829120512 178747 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=809688 CPUtime=757.4 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 60669 0 0 0 75671 69 0 0 25 0 4 0 522672842 829120512 178747 33554432000 4194304 4964704 140735491914624 18446744073709551615 4363547 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3042.82
Current children cumulated vsize (KiB) 809688

[startup+822.301 s]
/proc/loadavg: 8.15 8.20 8.15 9/188 4605
/proc/meminfo: memFree=28578220/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=875224 CPUtime=3282.47 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 187505 0 0 0 328093 154 0 0 25 0 4 0 522672768 896229376 185582 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 218806 185582 460 189 0 213155 0
[pid=4507/tid=4539] ppid=4505 vsize=875224 CPUtime=821.51 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 42229 0 0 0 82116 35 0 0 25 0 4 0 522672842 896229376 185582 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=875224 CPUtime=821.57 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 28165 0 0 0 82146 11 0 0 25 0 4 0 522672842 896229376 185582 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=875224 CPUtime=817.07 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 60697 0 0 0 81638 69 0 0 25 0 4 0 522672842 896229376 185582 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3282.47
Current children cumulated vsize (KiB) 875224

[startup+882.3 s]
/proc/loadavg: 8.16 8.19 8.15 9/188 4607
/proc/meminfo: memFree=28495852/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=877016 CPUtime=3522.14 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 200555 0 0 0 352039 175 0 0 25 0 4 0 522672768 898064384 198632 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 219254 198632 460 189 0 213603 0
[pid=4507/tid=4539] ppid=4505 vsize=877016 CPUtime=881.52 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 43119 0 0 0 88115 37 0 0 25 0 4 0 522672842 898064384 198632 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=877016 CPUtime=881.57 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 29230 0 0 0 88146 11 0 0 25 0 4 0 522672842 898064384 198632 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=877016 CPUtime=876.73 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 71783 0 0 0 87586 87 0 0 25 0 4 0 522672842 898064384 198632 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3522.14
Current children cumulated vsize (KiB) 877016

[startup+942.3 s]
/proc/loadavg: 8.24 8.20 8.16 9/188 4608
/proc/meminfo: memFree=28343648/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=944688 CPUtime=3761.82 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 207891 0 0 0 375998 184 0 0 25 0 4 0 522672768 967360512 205968 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 236172 205968 460 189 0 230521 0
[pid=4507/tid=4539] ppid=4505 vsize=944688 CPUtime=941.51 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 43398 0 0 0 94114 37 0 0 25 0 4 0 522672842 967360512 205968 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=944688 CPUtime=941.58 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 30010 0 0 0 94146 12 0 0 25 0 4 0 522672842 967360512 205968 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=944688 CPUtime=936.42 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 75357 0 0 0 93549 93 0 0 25 0 4 0 522672842 967360512 205968 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3761.82
Current children cumulated vsize (KiB) 944688

[startup+1002.3 s]
/proc/loadavg: 8.13 8.17 8.15 9/188 4610
/proc/meminfo: memFree=28200752/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=948328 CPUtime=4001.48 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 212519 0 0 0 399958 190 0 0 25 0 4 0 522672768 971087872 210339 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321099 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 237082 210339 460 189 0 231431 0
[pid=4507/tid=4539] ppid=4505 vsize=948328 CPUtime=1001.49 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 44137 0 0 0 100112 37 0 0 25 0 4 0 522672842 971087872 210339 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321065 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=948328 CPUtime=1001.58 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 30882 0 0 0 100146 12 0 0 25 0 4 0 522672842 971087872 210339 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=948328 CPUtime=996.09 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 77909 0 0 0 99512 97 0 0 25 0 4 0 522672842 971087872 210339 33554432000 4194304 4964704 140735491914624 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4001.48
Current children cumulated vsize (KiB) 948328

[startup+1062.3 s]
/proc/loadavg: 8.18 8.18 8.15 9/188 4611
/proc/meminfo: memFree=28173068/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=1081156 CPUtime=4241.15 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 217328 0 0 0 423922 193 0 0 25 0 4 0 522672768 1107103744 215148 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 270289 215148 460 189 0 264638 0
[pid=4507/tid=4539] ppid=4505 vsize=1081156 CPUtime=1061.5 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 44512 0 0 0 106112 38 0 0 25 0 4 0 522672842 1107103744 215148 33554432000 4194304 4964704 140735491914624 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=1081156 CPUtime=1061.57 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 33096 0 0 0 106145 12 0 0 25 0 4 0 522672842 1107103744 215148 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=1081156 CPUtime=1055.77 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 80128 0 0 0 105477 100 0 0 25 0 4 0 522672842 1107103744 215148 33554432000 4194304 4964704 140735491914624 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4241.15
Current children cumulated vsize (KiB) 1081156

[startup+1122.3 s]
/proc/loadavg: 8.16 8.18 8.15 9/188 4613
/proc/meminfo: memFree=28019620/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=1136248 CPUtime=4480.83 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 241930 0 0 0 447870 213 0 0 25 0 4 0 522672768 1163517952 238534 33554432000 4194304 4964704 140735491914624 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 284062 238534 460 189 0 278411 0
[pid=4507/tid=4539] ppid=4505 vsize=1136248 CPUtime=1121.49 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 56139 0 0 0 112107 42 0 0 25 0 4 0 522672842 1163517952 238534 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=1136248 CPUtime=1121.58 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 35572 0 0 0 112145 13 0 0 25 0 4 0 522672842 1163517952 238534 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=1136248 CPUtime=1115.43 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 89012 0 0 0 111430 113 0 0 25 0 4 0 522672842 1163517952 238534 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4480.83
Current children cumulated vsize (KiB) 1136248

[startup+1182.3 s]
/proc/loadavg: 8.27 8.21 8.17 9/188 4615
/proc/meminfo: memFree=27984736/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=1152484 CPUtime=4720.5 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 249014 0 0 0 471831 219 0 0 25 0 4 0 522672768 1180143616 245390 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670286 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 288121 245390 460 189 0 282470 0
[pid=4507/tid=4539] ppid=4505 vsize=1152484 CPUtime=1181.48 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 56425 0 0 0 118105 43 0 0 25 0 4 0 522672842 1180143616 245390 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=1152484 CPUtime=1181.58 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 37585 0 0 0 118144 14 0 0 25 0 4 0 522672842 1180143616 245390 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=1152484 CPUtime=1175.11 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 90076 0 0 0 117396 115 0 0 25 0 4 0 522672842 1180143616 245390 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4720.5
Current children cumulated vsize (KiB) 1152484



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.19 8.20 8.16 9/188 4615
/proc/meminfo: memFree=27969216/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=1152484 CPUtime=4800.03 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 249350 0 0 0 479784 219 0 0 25 0 4 0 522672768 1180143616 245726 33554432000 4194304 4964704 140735491914624 18446744073709551615 4627248 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4507/statm: 288121 245726 460 189 0 282470 0
[pid=4507/tid=4539] ppid=4505 vsize=1152484 CPUtime=1201.4 cores=1,3,5,7
/proc/4507/task/4539/stat : 4539 (claspmt) R 4505 4507 3867 0 -1 4202560 56427 0 0 0 120097 43 0 0 25 0 4 0 522672842 1180143616 245726 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4507/tid=4540] ppid=4505 vsize=1152484 CPUtime=1201.49 cores=1,3,5,7
/proc/4507/task/4540/stat : 4540 (claspmt) R 4505 4507 3867 0 -1 4202560 37890 0 0 0 120135 14 0 0 25 0 4 0 522672842 1180143616 245726 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4507/tid=4541] ppid=4505 vsize=1152484 CPUtime=1194.9 cores=1,3,5,7
/proc/4507/task/4541/stat : 4541 (claspmt) R 4505 4507 3867 0 -1 4202560 90105 0 0 0 119375 115 0 0 25 0 4 0 522672842 1180143616 245726 33554432000 4194304 4964704 140735491914624 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 1152484

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.32 s]
/proc/loadavg: 8.19 8.20 8.16 9/188 4615
/proc/meminfo: memFree=27969216/32951124 swapFree=67111344/67111528
[pid=4507] ppid=4505 vsize=1152320 CPUtime=4800.15 cores=1,3,5,7
/proc/4507/stat : 4507 (claspmt) R 4505 4507 3867 0 -1 4202496 249360 0 0 0 479796 219 0 0 25 0 1 0 522672768 1179975680 242671 33554432000 4194304 4964704 140735491914624 18446744073709551615 271550580871 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4507/statm: 288080 242281 470 189 0 282429 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 1152320

Child status: 0
Real time (s): 1202.39
CPU time (s): 4800.23
CPU user time (s): 4798
CPU system time (s): 2.23266
CPU usage (%): 399.224
Max. virtual memory (cumulated for all children) (KiB): 1152484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798
system time used= 2.23266
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 249362
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7431
involuntary context switches= 20876

runsolver used 1.78273 second user time and 4.78727 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 22:59:09
IDJOB=3299376
IDBENCH=88205
IDSOLVER=1683
FILE ID=node133/3299376-1304110749
RUNJOBID= node133-1304109542-4423
PBS_JOBID= 13170659
Free space on /tmp= 71792 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299376-1304110749/watcher-3299376-1304110749 -o /tmp/evaluation-result-3299376-1304110749/solver-3299376-1304110749 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299376-1304110749.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1002234f62b5dfa01a75197c65e66327
RANDOM SEED=1981633118

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30469664 kB
Buffers:        765736 kB
Cached:        1294064 kB
SwapCached:        124 kB
Active:         725952 kB
Inactive:      1398960 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30469664 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:            2768 kB
Writeback:           0 kB
AnonPages:       64740 kB
Mapped:          15164 kB
Slab:           294256 kB
PageTables:       4732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   217848 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71888 MiB
End job on node133 at 2011-04-29 23:19:13