Trace number 3299385

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.46 1205.04

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf
MD5SUM002a4cb53ea02f66e0c3418dc8834f7c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.82957
Satisfiable
(Un)Satisfiability was proved
Number of variables2561
Number of clauses490309
Sum of the clauses size983079
Maximum clause length52
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2490259
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...110774/instance-3299385-1304110774.cnf
3.69/3.76	c Solving...
4800.20/1204.81	
4800.20/1204.81	*** INTERRUPTED! ***
4800.20/1204.81	*** Shutting down threads...
4800.41/1205.03	s UNKNOWN
4800.41/1205.03	
4800.41/1205.03	c INTERRUPTED   : 1
4800.41/1205.03	c Models        : 0+    
4800.41/1205.03	c Time          : 1204.818s (Solving: 1201.06s 1st Model: 0.00s Unsat: 0.00s)
4800.41/1205.03	c CPU Time      : 4800.240s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299385-1304110774/watcher-3299385-1304110774 -o /tmp/evaluation-result-3299385-1304110774/solver-3299385-1304110774 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299385-1304110774.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.32 8.14 8.09 5/184 4568
/proc/meminfo: memFree=30407096/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=22004 CPUtime=0 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 803 0 0 0 0 0 0 0 25 0 1 0 522675264 22532096 713 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550537472 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 5501 714 385 189 0 375 0

[startup+0.0676749 s]
/proc/loadavg: 8.32 8.14 8.09 5/184 4568
/proc/meminfo: memFree=30407096/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=33268 CPUtime=0.06 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 4772 0 0 0 6 0 0 0 25 0 1 0 522675264 34066432 3532 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550198469 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 8317 3533 385 189 0 3191 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 33268

[startup+0.100669 s]
/proc/loadavg: 8.32 8.14 8.09 5/184 4568
/proc/meminfo: memFree=30407096/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=39236 CPUtime=0.09 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 6849 0 0 0 9 0 0 0 25 0 1 0 522675264 40177664 5001 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550198469 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 9809 5002 385 189 0 4683 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 39236

[startup+0.300632 s]
/proc/loadavg: 8.32 8.14 8.09 5/184 4568
/proc/meminfo: memFree=30407096/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=54332 CPUtime=0.29 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 10970 0 0 0 29 0 0 0 25 0 1 0 522675264 55635968 8186 33554432000 4194304 4964704 140733796959296 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 13583 8186 398 189 0 8457 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 54332

[startup+0.700585 s]
/proc/loadavg: 8.32 8.14 8.09 5/184 4568
/proc/meminfo: memFree=30407096/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=54332 CPUtime=0.69 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 10970 0 0 0 69 0 0 0 25 0 1 0 522675264 55635968 8186 33554432000 4194304 4964704 140733796959296 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 13583 8186 398 189 0 8457 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 54332

[startup+1.50041 s]
/proc/loadavg: 8.32 8.14 8.09 6/185 4569
/proc/meminfo: memFree=30375228/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=54332 CPUtime=1.49 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 10970 0 0 0 149 0 0 0 25 0 1 0 522675264 55635968 8186 33554432000 4194304 4964704 140733796959296 18446744073709551615 4607562 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 13583 8186 398 189 0 8457 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 54332

[startup+3.10112 s]
/proc/loadavg: 8.06 8.09 8.07 6/185 4569
/proc/meminfo: memFree=30374724/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=56048 CPUtime=3.09 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 11412 0 0 0 309 0 0 0 25 0 1 0 522675264 57393152 8628 33554432000 4194304 4964704 140733796959296 18446744073709551615 4600360 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 14012 8628 399 189 0 8886 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 56048

[startup+6.3005 s]
/proc/loadavg: 8.06 8.09 8.07 9/188 4572
/proc/meminfo: memFree=30326348/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=263880 CPUtime=13.85 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 23640 0 0 0 1379 6 0 0 19 0 4 0 522675264 270213120 19892 33554432000 4194304 4964704 140733796959296 18446744073709551615 4362262 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 65970 19892 458 189 0 60319 0
[pid=4568/tid=4570] ppid=4566 vsize=263880 CPUtime=2.52 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 3816 0 0 0 250 2 0 0 25 0 4 0 522675641 270213120 19892 33554432000 4194304 4964704 140733796959296 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=263880 CPUtime=2.52 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 1213 0 0 0 252 0 0 0 25 0 4 0 522675641 270213120 19892 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=263880 CPUtime=2.52 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 4208 0 0 0 251 1 0 0 25 0 4 0 522675641 270213120 19892 33554432000 4194304 4964704 140733796959296 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 13.85
Current children cumulated vsize (KiB) 263880

[startup+12.7003 s]
/proc/loadavg: 8.05 8.09 8.07 9/188 4572
/proc/meminfo: memFree=30236204/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=275868 CPUtime=39.42 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 39798 0 0 0 3927 15 0 0 25 0 4 0 522675264 282488832 36050 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 68967 36051 460 189 0 63316 0
[pid=4568/tid=4570] ppid=4566 vsize=275868 CPUtime=8.91 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 6508 0 0 0 888 3 0 0 25 0 4 0 522675641 282488832 36051 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550198817 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=275868 CPUtime=8.92 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 3936 0 0 0 890 2 0 0 25 0 4 0 522675641 282488832 36051 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=275868 CPUtime=8.92 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 11078 0 0 0 887 5 0 0 25 0 4 0 522675641 282488832 36051 33554432000 4194304 4964704 140733796959296 18446744073709551615 4653552 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39.42
Current children cumulated vsize (KiB) 275868

[startup+25.501 s]
/proc/loadavg: 8.12 8.10 8.07 9/188 4572
/proc/meminfo: memFree=30126820/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=350056 CPUtime=90.54 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 64243 0 0 0 9026 28 0 0 25 0 4 0 522675264 358457344 60495 33554432000 4194304 4964704 140733796959296 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 87514 60495 460 189 0 81863 0
[pid=4568/tid=4570] ppid=4566 vsize=350056 CPUtime=21.72 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 10895 0 0 0 2166 6 0 0 25 0 4 0 522675641 358457344 60495 33554432000 4194304 4964704 140733796959296 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=350056 CPUtime=21.72 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 8043 0 0 0 2168 4 0 0 25 0 4 0 522675641 358457344 60495 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=350056 CPUtime=21.72 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 20571 0 0 0 2161 11 0 0 25 0 4 0 522675641 358457344 60495 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 90.54
Current children cumulated vsize (KiB) 350056

[startup+51.1004 s]
/proc/loadavg: 8.08 8.09 8.07 9/188 4573
/proc/meminfo: memFree=29913876/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=524760 CPUtime=192.8 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 100711 0 0 0 19235 45 0 0 25 0 4 0 522675264 537354240 96959 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 131190 96959 460 189 0 125539 0
[pid=4568/tid=4570] ppid=4566 vsize=524760 CPUtime=47.31 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 24598 0 0 0 4720 11 0 0 25 0 4 0 522675641 537354240 96959 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=524760 CPUtime=47.32 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 10578 0 0 0 4727 5 0 0 25 0 4 0 522675641 537354240 96959 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=524760 CPUtime=47.32 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 25789 0 0 0 4718 14 0 0 25 0 4 0 522675641 537354240 96959 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 192.8
Current children cumulated vsize (KiB) 524760

[startup+102.307 s]
/proc/loadavg: 8.13 8.10 8.08 9/188 4583
/proc/meminfo: memFree=29753832/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=561480 CPUtime=397.3 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 126783 0 0 0 39670 60 0 0 25 0 4 0 522675264 574955520 123031 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 140370 123031 460 189 0 134719 0
[pid=4568/tid=4570] ppid=4566 vsize=561480 CPUtime=98.51 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 31080 0 0 0 9838 13 0 0 25 0 4 0 522675641 574955520 123031 33554432000 4194304 4964704 140733796959296 18446744073709551615 4627259 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=561480 CPUtime=98.52 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 12479 0 0 0 9846 6 0 0 25 0 4 0 522675641 574955520 123031 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=561480 CPUtime=98.51 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 31511 0 0 0 9833 18 0 0 25 0 4 0 522675641 574955520 123031 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550198817 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 397.3
Current children cumulated vsize (KiB) 561480

[startup+162.3 s]
/proc/loadavg: 8.17 8.11 8.08 9/188 4585
/proc/meminfo: memFree=29665272/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=649264 CPUtime=636.94 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 148080 0 0 0 63619 75 0 0 25 0 4 0 522675264 664846336 144328 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 162316 144328 460 189 0 156665 0
[pid=4568/tid=4570] ppid=4566 vsize=649264 CPUtime=158.5 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 35828 0 0 0 15836 14 0 0 25 0 4 0 522675641 664846336 144328 33554432000 4194304 4964704 140733796959296 18446744073709551615 4332409 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=649264 CPUtime=158.5 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 16214 0 0 0 15843 7 0 0 25 0 4 0 522675641 664846336 144328 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=649264 CPUtime=158.5 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 41239 0 0 0 15823 27 0 0 25 0 4 0 522675641 664846336 144328 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 636.94
Current children cumulated vsize (KiB) 649264

[startup+222.3 s]
/proc/loadavg: 8.26 8.15 8.09 10/188 4587
/proc/meminfo: memFree=29480216/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=780336 CPUtime=876.61 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 162126 0 0 0 87573 88 0 0 25 0 4 0 522675264 799064064 158304 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670250 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 195084 158304 460 189 0 189433 0
[pid=4568/tid=4570] ppid=4566 vsize=780336 CPUtime=218.49 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 39869 0 0 0 21832 17 0 0 25 0 4 0 522675641 799064064 158304 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=780336 CPUtime=218.5 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 17087 0 0 0 21843 7 0 0 25 0 4 0 522675641 799064064 158304 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=780336 CPUtime=218.5 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 45427 0 0 0 21818 32 0 0 25 0 4 0 522675641 799064064 158304 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 876.61
Current children cumulated vsize (KiB) 780336

[startup+282.301 s]
/proc/loadavg: 8.27 8.18 8.10 9/188 4588
/proc/meminfo: memFree=29303976/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=869816 CPUtime=1116.27 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 195520 0 0 0 111514 113 0 0 25 0 4 0 522675264 890691584 191698 33554432000 4194304 4964704 140733796959296 18446744073709551615 4332080 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 217454 191698 460 189 0 211803 0
[pid=4568/tid=4570] ppid=4566 vsize=869816 CPUtime=278.49 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 57062 0 0 0 27817 32 0 0 25 0 4 0 522675641 890691584 191698 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=869816 CPUtime=278.5 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 19323 0 0 0 27842 8 0 0 25 0 4 0 522675641 890691584 191698 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=869816 CPUtime=278.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 53986 0 0 0 27813 36 0 0 25 0 4 0 522675641 890691584 191698 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1116.27

################
# More data... #
################

Current children cumulated CPU time (s) 2553.39
Current children cumulated vsize (KiB) 1124604

[startup+702.3 s]
/proc/loadavg: 8.22 8.23 8.16 9/188 4602
/proc/meminfo: memFree=28762684/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1255824 CPUtime=2793.05 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 286470 0 0 0 279137 168 0 0 25 0 4 0 522675264 1285963776 281808 33554432000 4194304 4964704 140733796959296 18446744073709551615 4684662 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 313956 281808 460 189 0 308305 0
[pid=4568/tid=4570] ppid=4566 vsize=1255824 CPUtime=698.27 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 73945 0 0 0 69786 41 0 0 25 0 4 0 522675641 1285963776 281808 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1255824 CPUtime=698.45 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 29792 0 0 0 69834 11 0 0 25 0 4 0 522675641 1285963776 281808 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1255824 CPUtime=698.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 75750 0 0 0 69799 50 0 0 25 0 4 0 522675641 1285963776 281808 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2793.05
Current children cumulated vsize (KiB) 1255824

[startup+762.307 s]
/proc/loadavg: 8.14 8.20 8.15 9/188 4604
/proc/meminfo: memFree=28605400/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1380504 CPUtime=3032.73 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 314675 0 0 0 303086 187 0 0 25 0 4 0 522675264 1413636096 310013 33554432000 4194304 4964704 140733796959296 18446744073709551615 4332545 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 345126 310013 460 189 0 339475 0
[pid=4568/tid=4570] ppid=4566 vsize=1380504 CPUtime=758.28 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 83430 0 0 0 75777 51 0 0 25 0 4 0 522675641 1413636096 310013 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550235234 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1380504 CPUtime=758.45 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 31130 0 0 0 75834 11 0 0 25 0 4 0 522675641 1413636096 310013 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1380504 CPUtime=758.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 90459 0 0 0 75792 57 0 0 25 0 4 0 522675641 1413636096 310013 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3032.73
Current children cumulated vsize (KiB) 1380504

[startup+822.301 s]
/proc/loadavg: 8.15 8.20 8.15 9/188 4606
/proc/meminfo: memFree=28556252/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1380504 CPUtime=3272.35 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 316737 0 0 0 327046 189 0 0 25 0 4 0 522675264 1413636096 311865 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 345126 311865 460 189 0 339475 0
[pid=4568/tid=4570] ppid=4566 vsize=1380504 CPUtime=818.23 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 83515 0 0 0 81772 51 0 0 25 0 4 0 522675641 1413636096 311865 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1380504 CPUtime=818.45 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 31409 0 0 0 81834 11 0 0 25 0 4 0 522675641 1413636096 311865 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1380504 CPUtime=818.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 92143 0 0 0 81791 58 0 0 25 0 4 0 522675641 1413636096 311865 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3272.35
Current children cumulated vsize (KiB) 1380504

[startup+882.301 s]
/proc/loadavg: 8.19 8.19 8.15 9/188 4607
/proc/meminfo: memFree=28428980/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1511576 CPUtime=3512.01 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 336050 0 0 0 350992 209 0 0 25 0 4 0 522675264 1547853824 331178 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 377894 331178 460 189 0 372243 0
[pid=4568/tid=4570] ppid=4566 vsize=1511576 CPUtime=878.23 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 89865 0 0 0 87766 57 0 0 25 0 4 0 522675641 1547853824 331178 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1511576 CPUtime=878.43 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 32134 0 0 0 87832 11 0 0 25 0 4 0 522675641 1547853824 331178 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1511576 CPUtime=878.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 104373 0 0 0 87778 71 0 0 25 0 4 0 522675641 1547853824 331179 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3512.01
Current children cumulated vsize (KiB) 1511576

[startup+942.301 s]
/proc/loadavg: 8.23 8.20 8.16 9/188 4609
/proc/meminfo: memFree=28291796/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1577112 CPUtime=3751.69 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 365032 0 0 0 374933 236 0 0 25 0 4 0 522675264 1614962688 360039 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 394278 360039 460 189 0 388627 0
[pid=4568/tid=4570] ppid=4566 vsize=1577112 CPUtime=938.23 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 103392 0 0 0 93752 71 0 0 25 0 4 0 522675641 1614962688 360039 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1577112 CPUtime=938.44 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 32803 0 0 0 93832 12 0 0 25 0 4 0 522675641 1614962688 360039 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1577112 CPUtime=938.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 119145 0 0 0 93765 84 0 0 25 0 4 0 522675641 1614962688 360039 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3751.69
Current children cumulated vsize (KiB) 1577112

[startup+1002.3 s]
/proc/loadavg: 8.21 8.19 8.16 9/188 4610
/proc/meminfo: memFree=28197760/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1643612 CPUtime=3991.33 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 385595 0 0 0 398879 254 0 0 25 0 4 0 522675264 1683058688 380365 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 410903 380365 460 189 0 405252 0
[pid=4568/tid=4570] ppid=4566 vsize=1643612 CPUtime=998.21 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 107559 0 0 0 99745 76 0 0 25 0 4 0 522675641 1683058688 380365 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1643612 CPUtime=998.43 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 34375 0 0 0 99831 12 0 0 25 0 4 0 522675641 1683058688 380365 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1643612 CPUtime=998.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 124945 0 0 0 99760 89 0 0 25 0 4 0 522675641 1683058688 380365 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3991.33
Current children cumulated vsize (KiB) 1643612

[startup+1062.3 s]
/proc/loadavg: 8.18 8.18 8.15 9/188 4612
/proc/meminfo: memFree=28136708/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1715972 CPUtime=4230.99 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 394420 0 0 0 422834 265 0 0 25 0 4 0 522675264 1757155328 389190 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4568/statm: 428993 389190 460 189 0 423342 0
[pid=4568/tid=4570] ppid=4566 vsize=1715972 CPUtime=1058.21 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 114703 0 0 0 105735 86 0 0 25 0 4 0 522675641 1757155328 389190 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1715972 CPUtime=1058.43 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 36006 0 0 0 105830 13 0 0 25 0 4 0 522675641 1757155328 389190 33554432000 4194304 4964704 140733796959296 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1715972 CPUtime=1058.49 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 124994 0 0 0 105760 89 0 0 25 0 4 0 522675641 1757155328 389190 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4230.99
Current children cumulated vsize (KiB) 1715972

[startup+1122.3 s]
/proc/loadavg: 8.36 8.22 8.17 9/188 4614
/proc/meminfo: memFree=27991580/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1718532 CPUtime=4470.64 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 404139 0 0 0 446788 276 0 0 25 0 4 0 522675264 1759776768 398648 33554432000 4194304 4964704 140733796959296 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4568/statm: 429633 398648 460 189 0 423982 0
[pid=4568/tid=4570] ppid=4566 vsize=1718532 CPUtime=1118.04 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 122700 0 0 0 111707 97 0 0 25 0 4 0 522675641 1759776768 398648 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1718532 CPUtime=1118.42 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 37691 0 0 0 111829 13 0 0 25 0 4 0 522675641 1759776768 398648 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1718532 CPUtime=1118.5 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 125029 0 0 0 111760 90 0 0 25 0 4 0 522675641 1759776768 398648 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4470.64
Current children cumulated vsize (KiB) 1718532

[startup+1182.3 s]
/proc/loadavg: 7.85 8.13 8.14 5/180 4633
/proc/meminfo: memFree=28950224/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1784068 CPUtime=4710.32 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 409913 0 0 0 470743 289 0 0 25 0 4 0 522675264 1826885632 404422 33554432000 4194304 4964704 140733796959296 18446744073709551615 4332519 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4568/statm: 446017 404422 460 189 0 440366 0
[pid=4568/tid=4570] ppid=4566 vsize=1784068 CPUtime=1177.72 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 127801 0 0 0 117663 109 0 0 25 0 4 0 522675641 1826885632 404422 33554432000 4194304 4964704 140733796959296 18446744073709551615 4668904 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1784068 CPUtime=1178.42 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 38308 0 0 0 117829 13 0 0 25 0 4 0 522675641 1826885632 404422 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1784068 CPUtime=1178.5 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 125085 0 0 0 117760 90 0 0 25 0 4 0 522675641 1826885632 404422 33554432000 4194304 4964704 140733796959296 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4710.32
Current children cumulated vsize (KiB) 1784068



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 6.76 7.86 8.05 5/179 4634
/proc/meminfo: memFree=28925460/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=1784068 CPUtime=4800.2 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 415859 0 0 0 479704 316 0 0 25 0 4 0 522675264 1826885632 410368 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4568/statm: 446017 410368 460 189 0 440366 0
[pid=4568/tid=4570] ppid=4566 vsize=1784068 CPUtime=1200.09 cores=0,2,4,6
/proc/4568/task/4570/stat : 4570 (claspmt) R 4566 4568 3867 0 -1 4202560 133450 0 0 0 119873 136 0 0 25 0 4 0 522675641 1826885632 410368 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4568/tid=4571] ppid=4566 vsize=1784068 CPUtime=1200.92 cores=0,2,4,6
/proc/4568/task/4571/stat : 4571 (claspmt) R 4566 4568 3867 0 -1 4202560 38602 0 0 0 120079 13 0 0 25 0 4 0 522675641 1826885632 410368 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4568/tid=4572] ppid=4566 vsize=1784068 CPUtime=1201.01 cores=0,2,4,6
/proc/4568/task/4572/stat : 4572 (claspmt) R 4566 4568 3867 0 -1 4202560 125088 0 0 0 120011 90 0 0 25 0 4 0 522675641 1826885632 410368 33554432000 4194304 4964704 140733796959296 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 1784068

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205 s]
/proc/loadavg: 6.76 7.86 8.05 5/179 4634
/proc/meminfo: memFree=28925460/32951124 swapFree=67111344/67111528
[pid=4568] ppid=4566 vsize=983060 CPUtime=4800.41 cores=0,2,4,6
/proc/4568/stat : 4568 (claspmt) R 4566 4568 3867 0 -1 4202496 415871 0 0 0 479722 319 0 0 25 0 1 0 522675264 1006653440 207357 33554432000 4194304 4964704 140733796959296 18446744073709551615 271550581095 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/4568/statm: 245765 207357 471 189 0 240114 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 983060

Child status: 0
Real time (s): 1205.04
CPU time (s): 4800.46
CPU user time (s): 4797.23
CPU system time (s): 3.23451
CPU usage (%): 398.366
Max. virtual memory (cumulated for all children) (KiB): 1784068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.23
system time used= 3.23451
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 415872
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7926
involuntary context switches= 83816

runsolver used 1.82172 second user time and 4.76228 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 22:59:34
IDJOB=3299385
IDBENCH=88207
IDSOLVER=1683
FILE ID=node133/3299385-1304110774
RUNJOBID= node133-1304109542-4422
PBS_JOBID= 13170659
Free space on /tmp= 71888 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299385-1304110774/watcher-3299385-1304110774 -o /tmp/evaluation-result-3299385-1304110774/solver-3299385-1304110774 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299385-1304110774.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 002a4cb53ea02f66e0c3418dc8834f7c
RANDOM SEED=1779497721

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30407376 kB
Buffers:        765844 kB
Cached:        1198080 kB
SwapCached:        124 kB
Active:         787436 kB
Inactive:      1399996 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30407376 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:           10328 kB
Writeback:           0 kB
AnonPages:      223624 kB
Mapped:          15736 kB
Slab:           294288 kB
PageTables:       5440 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   377952 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71888 MiB
End job on node133 at 2011-04-29 23:19:41