Trace number 3299519

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.51 1205.07

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_60_28_40_7-log.shuffled-as.sat03-127.cnf
MD5SUMf1f35d90237c4ca07d41a6a9b08e6279
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables140
Number of clauses58376
Sum of the clauses size583480
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 556
Number of clauses of size over 558320

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...099460/instance-3299519-1304099460.cnf
4.19/4.29	c Solving...
4800.41/1205.01	
4800.41/1205.01	*** INTERRUPTED! ***
4800.41/1205.01	*** Shutting down threads...
4800.41/1205.07	s UNKNOWN
4800.41/1205.07	
4800.41/1205.07	c INTERRUPTED   : 1
4800.41/1205.07	c Models        : 0+    
4800.41/1205.07	c Time          : 1205.010s (Solving: 1200.72s 1st Model: 0.00s Unsat: 0.00s)
4800.41/1205.07	c CPU Time      : 4800.430s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299519-1304099460/watcher-3299519-1304099460 -o /tmp/evaluation-result-3299519-1304099460/solver-3299519-1304099460 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299519-1304099460.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.24 8.12 8.00 5/180 6986
/proc/meminfo: memFree=19808556/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=21156 CPUtime=0 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 597 0 0 0 0 0 0 0 25 0 1 0 521545760 21663744 526 33554432000 4194304 4964704 140737042341008 18446744073709551615 237278540485 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 5289 527 385 189 0 163 0

[startup+0.0136041 s]
/proc/loadavg: 8.24 8.12 8.00 5/180 6986
/proc/meminfo: memFree=19808556/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=22032 CPUtime=0.01 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 799 0 0 0 1 0 0 0 25 0 1 0 521545760 22560768 728 33554432000 4194304 4964704 140737042341008 18446744073709551615 4599424 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 5508 729 385 189 0 382 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 22032

[startup+0.100595 s]
/proc/loadavg: 8.24 8.12 8.00 5/180 6986
/proc/meminfo: memFree=19808556/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=28612 CPUtime=0.09 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 2631 0 0 0 9 0 0 0 25 0 1 0 521545760 29298688 2389 33554432000 4194304 4964704 140737042341008 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 7153 2389 398 189 0 2027 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28612

[startup+0.300556 s]
/proc/loadavg: 8.24 8.12 8.00 5/180 6986
/proc/meminfo: memFree=19808556/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=28612 CPUtime=0.29 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 2631 0 0 0 29 0 0 0 25 0 1 0 521545760 29298688 2389 33554432000 4194304 4964704 140737042341008 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 7153 2389 398 189 0 2027 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 28612

[startup+0.700484 s]
/proc/loadavg: 8.24 8.12 8.00 5/180 6986
/proc/meminfo: memFree=19808556/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=28612 CPUtime=0.69 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 2631 0 0 0 69 0 0 0 25 0 1 0 521545760 29298688 2389 33554432000 4194304 4964704 140737042341008 18446744073709551615 4607510 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 7153 2389 398 189 0 2027 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 28612

[startup+1.50034 s]
/proc/loadavg: 8.24 8.12 8.00 6/181 6987
/proc/meminfo: memFree=19798256/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=28612 CPUtime=1.49 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 2633 0 0 0 149 0 0 0 25 0 1 0 521545760 29298688 2391 33554432000 4194304 4964704 140737042341008 18446744073709551615 4607644 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 7153 2391 398 189 0 2027 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 28612

[startup+3.10106 s]
/proc/loadavg: 8.24 8.12 8.00 6/181 6987
/proc/meminfo: memFree=19796892/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=28976 CPUtime=3.09 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 2700 0 0 0 309 0 0 0 25 0 1 0 521545760 29671424 2458 33554432000 4194304 4964704 140737042341008 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6986/statm: 7244 2458 398 189 0 2118 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 28976

[startup+6.3005 s]
/proc/loadavg: 7.98 8.07 7.98 9/184 6990
/proc/meminfo: memFree=19777768/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=180912 CPUtime=12.28 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 8240 0 0 0 1227 1 0 0 25 0 4 0 521545760 185253888 7806 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 45228 7806 458 189 0 39577 0
[pid=6986/tid=6988] ppid=6984 vsize=180912 CPUtime=2 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 737 0 0 0 200 0 0 0 25 0 4 0 521546189 185253888 7806 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=180912 CPUtime=2 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 2005 0 0 0 200 0 0 0 25 0 4 0 521546189 185253888 7806 33554432000 4194304 4964704 140737042341008 18446744073709551615 4361118 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=180912 CPUtime=1.98 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 1346 0 0 0 198 0 0 0 25 0 4 0 521546189 185253888 7806 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.28
Current children cumulated vsize (KiB) 180912

[startup+12.7004 s]
/proc/loadavg: 7.98 8.07 7.98 10/184 6990
/proc/meminfo: memFree=19755956/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=185216 CPUtime=37.85 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 11443 0 0 0 3782 3 0 0 25 0 4 0 521545760 189661184 11009 33554432000 4194304 4964704 140737042341008 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 46304 11009 460 189 0 40653 0
[pid=6986/tid=6988] ppid=6984 vsize=185216 CPUtime=8.39 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 1314 0 0 0 839 0 0 0 25 0 4 0 521546189 189661184 11009 33554432000 4194304 4964704 140737042341008 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=185216 CPUtime=8.4 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 3668 0 0 0 839 1 0 0 25 0 4 0 521546189 189661184 11009 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=185216 CPUtime=8.35 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 1802 0 0 0 835 0 0 0 25 0 4 0 521546189 189661184 11009 33554432000 4194304 4964704 140737042341008 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37.85
Current children cumulated vsize (KiB) 185216

[startup+25.5011 s]
/proc/loadavg: 7.99 8.06 7.98 9/184 6991
/proc/meminfo: memFree=19717640/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=193220 CPUtime=88.97 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 16754 0 0 0 8892 5 0 0 25 0 4 0 521545760 197857280 15868 33554432000 4194304 4964704 140737042341008 18446744073709551615 4626941 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 48305 15868 460 189 0 42654 0
[pid=6986/tid=6988] ppid=6984 vsize=193220 CPUtime=21.19 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 2205 0 0 0 2119 0 0 0 25 0 4 0 521546189 197857280 15868 33554432000 4194304 4964704 140737042341008 18446744073709551615 4626882 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=193220 CPUtime=21.2 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 6238 0 0 0 2118 2 0 0 25 0 4 0 521546189 197857280 15868 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=193220 CPUtime=21.07 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 2793 0 0 0 2107 0 0 0 25 0 4 0 521546189 197857280 15868 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 88.97
Current children cumulated vsize (KiB) 193220

[startup+51.1005 s]
/proc/loadavg: 7.99 8.06 7.98 9/184 6991
/proc/meminfo: memFree=19677492/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=197156 CPUtime=191.21 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 20417 0 0 0 19113 8 0 0 25 0 4 0 521545760 201887744 19500 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 49289 19500 460 189 0 43638 0
[pid=6986/tid=6988] ppid=6984 vsize=197156 CPUtime=46.79 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 3030 0 0 0 4678 1 0 0 25 0 4 0 521546189 201887744 19500 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=197156 CPUtime=46.79 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 8024 0 0 0 4676 3 0 0 25 0 4 0 521546189 201887744 19500 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=197156 CPUtime=46.54 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 3492 0 0 0 4653 1 0 0 25 0 4 0 521546189 201887744 19500 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 191.21
Current children cumulated vsize (KiB) 197156

[startup+102.306 s]
/proc/loadavg: 8.07 8.08 7.99 9/184 6993
/proc/meminfo: memFree=19624248/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=203444 CPUtime=395.74 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 25445 0 0 0 39562 12 0 0 25 0 4 0 521545760 208326656 24421 33554432000 4194304 4964704 140737042341008 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 50861 24421 460 189 0 45210 0
[pid=6986/tid=6988] ppid=6984 vsize=203444 CPUtime=97.98 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 4855 0 0 0 9796 2 0 0 25 0 4 0 521546189 208326656 24421 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=203444 CPUtime=97.71 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 9484 0 0 0 9767 4 0 0 25 0 4 0 521546189 208326656 24421 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=203444 CPUtime=97.74 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 4600 0 0 0 9772 2 0 0 25 0 4 0 521546189 208326656 24421 33554432000 4194304 4964704 140737042341008 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 395.74
Current children cumulated vsize (KiB) 203444

[startup+162.301 s]
/proc/loadavg: 8.06 8.07 8.00 10/184 6994
/proc/meminfo: memFree=19598888/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=211252 CPUtime=635.38 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 29344 0 0 0 63523 15 0 0 25 0 4 0 521545760 216322048 28121 33554432000 4194304 4964704 140737042341008 18446744073709551615 4320848 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 52813 28121 460 189 0 47162 0
[pid=6986/tid=6988] ppid=6984 vsize=211252 CPUtime=157.98 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 6334 0 0 0 15795 3 0 0 25 0 4 0 521546189 216322048 28121 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=211252 CPUtime=157.38 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 11299 0 0 0 15733 5 0 0 25 0 4 0 521546189 216322048 28121 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=211252 CPUtime=157.72 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 4956 0 0 0 15770 2 0 0 21 0 4 0 521546189 216322048 28121 33554432000 4194304 4964704 140737042341008 18446744073709551615 4627964 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 635.38
Current children cumulated vsize (KiB) 211252

[startup+222.301 s]
/proc/loadavg: 8.13 8.09 8.01 10/184 6996
/proc/meminfo: memFree=19576008/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=215160 CPUtime=875.04 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 32006 0 0 0 87486 18 0 0 25 0 4 0 521545760 220323840 30471 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 53790 30471 460 189 0 48139 0
[pid=6986/tid=6988] ppid=6984 vsize=215160 CPUtime=217.97 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 7367 0 0 0 21793 4 0 0 25 0 4 0 521546189 220323840 30471 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=215160 CPUtime=217.04 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 12553 0 0 0 21699 5 0 0 25 0 4 0 521546189 220323840 30471 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=215160 CPUtime=217.72 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 5182 0 0 0 21769 3 0 0 25 0 4 0 521546189 220323840 30471 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 875.04
Current children cumulated vsize (KiB) 215160

[startup+282.3 s]
/proc/loadavg: 8.12 8.09 8.00 9/184 6997
/proc/meminfo: memFree=19551272/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=215896 CPUtime=1114.7 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 33531 0 0 0 111449 21 0 0 25 0 4 0 521545760 221077504 31849 33554432000 4194304 4964704 140737042341008 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 53974 31849 460 189 0 48323 0
[pid=6986/tid=6988] ppid=6984 vsize=215896 CPUtime=277.96 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 7874 0 0 0 27792 4 0 0 25 0 4 0 521546189 221077504 31849 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=215896 CPUtime=276.71 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 13100 0 0 0 27665 6 0 0 25 0 4 0 521546189 221077504 31849 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670281 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=215896 CPUtime=277.72 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 5450 0 0 0 27768 4 0 0 25 0 4 0 521546189 221077504 31849 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1114.7

################
# More data... #
################

[pid=6986] ppid=6984 vsize=227196 CPUtime=2552.71 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 40818 0 0 0 255234 37 0 0 25 0 4 0 521545760 232648704 38239 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 56799 38239 460 189 0 51148 0
[pid=6986/tid=6988] ppid=6984 vsize=227196 CPUtime=637.96 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 11172 0 0 0 63788 8 0 0 25 0 4 0 521546189 232648704 38239 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=227196 CPUtime=634.74 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 15488 0 0 0 63463 11 0 0 25 0 4 0 521546189 232648704 38239 33554432000 4194304 4964704 140737042341008 18446744073709551615 237278535579 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=227196 CPUtime=637.71 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 6592 0 0 0 63763 8 0 0 25 0 4 0 521546189 232648704 38239 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2552.71
Current children cumulated vsize (KiB) 227196

[startup+702.301 s]
/proc/loadavg: 8.10 8.10 8.01 9/184 7018
/proc/meminfo: memFree=19441708/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=228260 CPUtime=2792.36 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 41689 0 0 0 279197 39 0 0 25 0 4 0 521545760 233738240 39036 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 57065 39036 460 189 0 51414 0
[pid=6986/tid=6988] ppid=6984 vsize=228260 CPUtime=697.96 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 11439 0 0 0 69787 9 0 0 25 0 4 0 521546189 233738240 39036 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=228260 CPUtime=694.41 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 16078 0 0 0 69430 11 0 0 25 0 4 0 521546189 233738240 39036 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=228260 CPUtime=697.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 6603 0 0 0 69762 8 0 0 25 0 4 0 521546189 233738240 39036 33554432000 4194304 4964704 140737042341008 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2792.36
Current children cumulated vsize (KiB) 228260

[startup+762.307 s]
/proc/loadavg: 8.08 8.09 8.01 10/184 7019
/proc/meminfo: memFree=19434624/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=228684 CPUtime=3032.06 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 42258 0 0 0 303165 41 0 0 25 0 4 0 521545760 234172416 39493 33554432000 4194304 4964704 140737042341008 18446744073709551615 4627825 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 57171 39493 460 189 0 51520 0
[pid=6986/tid=6988] ppid=6984 vsize=228684 CPUtime=757.96 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 11622 0 0 0 75787 9 0 0 25 0 4 0 521546189 234172416 39493 33554432000 4194304 4964704 140737042341008 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=228684 CPUtime=754.09 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 16344 0 0 0 75397 12 0 0 25 0 4 0 521546189 234172416 39493 33554432000 4194304 4964704 140737042341008 18446744073709551615 4644800 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=228684 CPUtime=757.71 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 6684 0 0 0 75762 9 0 0 25 0 4 0 521546189 234172416 39493 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3032.06
Current children cumulated vsize (KiB) 228684

[startup+822.3 s]
/proc/loadavg: 8.34 8.17 8.04 9/184 7024
/proc/meminfo: memFree=19423752/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=230068 CPUtime=3271.71 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 43032 0 0 0 327127 44 0 0 25 0 4 0 521545760 235589632 40120 33554432000 4194304 4964704 140737042341008 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 57517 40120 460 189 0 51866 0
[pid=6986/tid=6988] ppid=6984 vsize=230068 CPUtime=817.95 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 12017 0 0 0 81785 10 0 0 25 0 4 0 521546189 235589632 40120 33554432000 4194304 4964704 140737042341008 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=230068 CPUtime=813.76 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 16551 0 0 0 81364 12 0 0 25 0 4 0 521546189 235589632 40120 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=230068 CPUtime=817.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 6788 0 0 0 81760 10 0 0 25 0 4 0 521546189 235589632 40120 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3271.71
Current children cumulated vsize (KiB) 230068

[startup+882.301 s]
/proc/loadavg: 8.16 8.15 8.04 10/184 7025
/proc/meminfo: memFree=19413648/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=231428 CPUtime=3511.38 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 43766 0 0 0 351092 46 0 0 25 0 4 0 521545760 236982272 40780 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670184 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 57857 40780 460 189 0 52206 0
[pid=6986/tid=6988] ppid=6984 vsize=231428 CPUtime=877.95 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 12309 0 0 0 87785 10 0 0 25 0 4 0 521546189 236982272 40780 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=231428 CPUtime=873.44 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 16759 0 0 0 87331 13 0 0 25 0 4 0 521546189 236982272 40780 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=231428 CPUtime=877.71 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 6999 0 0 0 87760 11 0 0 25 0 4 0 521546189 236982272 40780 33554432000 4194304 4964704 140737042341008 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3511.38
Current children cumulated vsize (KiB) 231428

[startup+942.301 s]
/proc/loadavg: 8.09 8.13 8.04 10/184 7027
/proc/meminfo: memFree=19408312/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=232284 CPUtime=3751.05 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 45058 0 0 0 375057 48 0 0 25 0 4 0 521545760 237858816 41743 33554432000 4194304 4964704 140737042341008 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 58071 41743 460 189 0 52420 0
[pid=6986/tid=6988] ppid=6984 vsize=232284 CPUtime=937.95 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 12631 0 0 0 93784 11 0 0 25 0 4 0 521546189 237858816 41743 33554432000 4194304 4964704 140737042341008 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=232284 CPUtime=933.1 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 17529 0 0 0 93297 13 0 0 25 0 4 0 521546189 237858816 41743 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=232284 CPUtime=937.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 7159 0 0 0 93759 11 0 0 25 0 4 0 521546189 237858816 41743 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3751.05
Current children cumulated vsize (KiB) 232284

[startup+1002.3 s]
/proc/loadavg: 8.07 8.12 8.04 10/184 7029
/proc/meminfo: memFree=19405700/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=233132 CPUtime=3990.71 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 45609 0 0 0 399021 50 0 0 25 0 4 0 521545760 238727168 42220 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6986/statm: 58283 42220 460 189 0 52632 0
[pid=6986/tid=6988] ppid=6984 vsize=233132 CPUtime=997.95 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 12871 0 0 0 99784 11 0 0 25 0 4 0 521546189 238727168 42220 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=233132 CPUtime=992.77 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 17574 0 0 0 99263 14 0 0 25 0 4 0 521546189 238727168 42220 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=233132 CPUtime=997.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 7414 0 0 0 99759 11 0 0 25 0 4 0 521546189 238727168 42220 33554432000 4194304 4964704 140737042341008 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3990.71
Current children cumulated vsize (KiB) 233132

[startup+1062.3 s]
/proc/loadavg: 8.06 8.11 8.04 9/184 7030
/proc/meminfo: memFree=19401976/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=235056 CPUtime=4230.37 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 46575 0 0 0 422986 51 0 0 25 0 4 0 521545760 240697344 43074 33554432000 4194304 4964704 140737042341008 18446744073709551615 4627528 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6986/statm: 58764 43074 460 189 0 53113 0
[pid=6986/tid=6988] ppid=6984 vsize=235056 CPUtime=1057.95 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 13345 0 0 0 105783 12 0 0 25 0 4 0 521546189 240697344 43074 33554432000 4194304 4964704 140737042341008 18446744073709551615 4626894 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=235056 CPUtime=1052.45 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 18013 0 0 0 105231 14 0 0 25 0 4 0 521546189 240697344 43074 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=235056 CPUtime=1057.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 7426 0 0 0 105758 12 0 0 25 0 4 0 521546189 240697344 43074 33554432000 4194304 4964704 140737042341008 18446744073709551615 4644138 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4230.37
Current children cumulated vsize (KiB) 235056

[startup+1122.3 s]
/proc/loadavg: 8.13 8.12 8.04 9/184 7032
/proc/meminfo: memFree=19399236/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=236904 CPUtime=4470.04 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 47200 0 0 0 446951 53 0 0 25 0 4 0 521545760 242589696 43586 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6986/statm: 59226 43586 460 189 0 53575 0
[pid=6986/tid=6988] ppid=6984 vsize=236904 CPUtime=1117.95 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 13852 0 0 0 111783 12 0 0 25 0 4 0 521546189 242589696 43586 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=236904 CPUtime=1112.45 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 18047 0 0 0 111230 15 0 0 25 0 4 0 521546189 242589696 43586 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=236904 CPUtime=1117.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 7506 0 0 0 111758 12 0 0 25 0 4 0 521546189 242589696 43586 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4470.04
Current children cumulated vsize (KiB) 236904

[startup+1182.3 s]
/proc/loadavg: 6.17 7.61 7.87 5/175 7051
/proc/meminfo: memFree=19758068/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=237756 CPUtime=4709.72 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 48008 0 0 0 470917 55 0 0 25 0 4 0 521545760 243462144 44242 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6986/statm: 59439 44242 460 189 0 53788 0
[pid=6986/tid=6988] ppid=6984 vsize=237756 CPUtime=1177.94 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 14493 0 0 0 117782 12 0 0 25 0 4 0 521546189 243462144 44242 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=237756 CPUtime=1172.45 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 18049 0 0 0 117230 15 0 0 25 0 4 0 521546189 243462144 44242 33554432000 4194304 4964704 140737042341008 18446744073709551615 237278577242 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=237756 CPUtime=1177.7 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 7666 0 0 0 117757 13 0 0 25 0 4 0 521546189 243462144 44242 33554432000 4194304 4964704 140737042341008 18446744073709551615 4379076 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4709.72
Current children cumulated vsize (KiB) 237756



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205 s]
/proc/loadavg: 5.43 7.32 7.77 5/175 7052
/proc/meminfo: memFree=19756948/32950904 swapFree=67082284/67111528
[pid=6986] ppid=6984 vsize=238324 CPUtime=4800.41 cores=1,3,5,7
/proc/6986/stat : 6986 (claspmt) R 6984 6986 6445 0 -1 4202496 48306 0 0 0 479985 56 0 0 25 0 4 0 521545760 244043776 44540 33554432000 4194304 4964704 140737042341008 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6986/statm: 59581 44540 460 189 0 53930 0
[pid=6986/tid=6988] ppid=6984 vsize=238324 CPUtime=1200.66 cores=1,3,5,7
/proc/6986/task/6988/stat : 6988 (claspmt) R 6984 6986 6445 0 -1 4202560 14639 0 0 0 120053 13 0 0 25 0 4 0 521546189 244043776 44540 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6986/tid=6989] ppid=6984 vsize=238324 CPUtime=1195.15 cores=1,3,5,7
/proc/6986/task/6989/stat : 6989 (claspmt) R 6984 6986 6445 0 -1 4202560 18126 0 0 0 119500 15 0 0 25 0 4 0 521546189 244043776 44540 33554432000 4194304 4964704 140737042341008 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=6986/tid=6990] ppid=6984 vsize=238324 CPUtime=1200.4 cores=1,3,5,7
/proc/6986/task/6990/stat : 6990 (claspmt) R 6984 6986 6445 0 -1 4202560 7668 0 0 0 120027 13 0 0 25 0 4 0 521546189 244043776 44540 33554432000 4194304 4964704 140737042341008 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 238324

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1205.07
CPU time (s): 4800.51
CPU user time (s): 4799.93
CPU system time (s): 0.573912
CPU usage (%): 398.358
Max. virtual memory (cumulated for all children) (KiB): 238324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.93
system time used= 0.573912
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 48318
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17604
involuntary context switches= 34907

runsolver used 1.79273 second user time and 4.78627 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 19:51:00
IDJOB=3299519
IDBENCH=83965
IDSOLVER=1683
FILE ID=node121/3299519-1304099460
RUNJOBID= node121-1304096537-6464
PBS_JOBID= 13170609
Free space on /tmp= 72652 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_60_28_40_7-log.shuffled-as.sat03-127.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299519-1304099460/watcher-3299519-1304099460 -o /tmp/evaluation-result-3299519-1304099460/solver-3299519-1304099460 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299519-1304099460.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f1f35d90237c4ca07d41a6a9b08e6279
RANDOM SEED=1106300271

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      19808704 kB
Buffers:       2183764 kB
Cached:       10276928 kB
SwapCached:       2776 kB
Active:        9253852 kB
Inactive:      3369812 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      19808704 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:            3136 kB
Writeback:           0 kB
AnonPages:      160428 kB
Mapped:          14720 kB
Slab:           455820 kB
PageTables:       4616 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   346148 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72652 MiB
End job on node121 at 2011-04-29 20:11:07