Trace number 3299505

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.27 1201.87

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_18_80_10-dir.shuffled-as.sat03-140.cnf
MD5SUM1037a2754a0a53f62ba8ec901741c9e9
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables540
Number of clauses40510
Sum of the clauses size81524
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 240492
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 518

Solver Data

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...099217/instance-3299505-1304099217.cnf
0.09/0.16	c Solving...
4800.18/1201.81	
4800.18/1201.81	*** INTERRUPTED! ***
4800.18/1201.81	*** Shutting down threads...
4800.18/1201.87	s UNKNOWN
4800.18/1201.87	
4800.18/1201.87	c INTERRUPTED   : 1
4800.18/1201.87	c Models        : 0+    
4800.18/1201.87	c Time          : 1201.810s (Solving: 1201.65s 1st Model: 0.00s Unsat: 0.00s)
4800.18/1201.87	c CPU Time      : 4800.200s

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299505-1304099217/watcher-3299505-1304099217 -o /tmp/evaluation-result-3299505-1304099217/solver-3299505-1304099217 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299505-1304099217.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.72 7.99 7.93 5/180 8390
/proc/meminfo: memFree=31188600/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=21448 CPUtime=0 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 651 0 0 0 0 0 0 0 25 0 1 0 502337326 21962752 577 33554432000 4194304 4964704 140735668886144 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/8390/statm: 5362 578 385 189 0 236 0

[startup+0.0383461 s]
/proc/loadavg: 7.72 7.99 7.93 5/180 8390
/proc/meminfo: memFree=31188600/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=23356 CPUtime=0.03 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 1254 0 0 0 3 0 0 0 25 0 1 0 502337326 23916544 1086 33554432000 4194304 4964704 140735668886144 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/8390/statm: 5839 1086 398 189 0 713 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23356

[startup+0.100329 s]
/proc/loadavg: 7.72 7.99 7.93 5/180 8390
/proc/meminfo: memFree=31188600/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=23488 CPUtime=0.09 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 1268 0 0 0 9 0 0 0 25 0 1 0 502337326 24051712 1100 33554432000 4194304 4964704 140735668886144 18446744073709551615 4600421 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/8390/statm: 5872 1100 399 189 0 746 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23488

[startup+0.300258 s]
/proc/loadavg: 7.72 7.99 7.93 5/180 8390
/proc/meminfo: memFree=31188600/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=171740 CPUtime=0.67 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 3064 0 0 0 67 0 0 0 25 0 4 0 502337326 175861760 2815 33554432000 4194304 4964704 140735668886144 18446744073709551615 4362448 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 42935 2817 458 189 0 37284 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 171740

[startup+0.70018 s]
/proc/loadavg: 7.72 7.99 7.93 5/180 8390
/proc/meminfo: memFree=31188600/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=174832 CPUtime=2.27 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 5301 0 0 0 226 1 0 0 25 0 4 0 502337326 179027968 5052 33554432000 4194304 4964704 140735668886144 18446744073709551615 4654479 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 43708 5052 458 189 0 38057 0
Current children cumulated CPU time (s) 2.27
Current children cumulated vsize (KiB) 174832

[startup+1.50102 s]
/proc/loadavg: 7.72 7.99 7.93 5/179 8395
/proc/meminfo: memFree=31352048/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=177628 CPUtime=5.47 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 7344 0 0 0 545 2 0 0 25 0 4 0 502337326 181891072 7095 33554432000 4194304 4964704 140735668886144 18446744073709551615 4660304 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 44407 7095 458 189 0 38756 0
[pid=8390/tid=8392] ppid=8388 vsize=177628 CPUtime=1.32 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 1318 0 0 0 132 0 0 0 19 0 4 0 502337343 181891072 7095 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670312 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=177628 CPUtime=1.31 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 1425 0 0 0 131 0 0 0 25 0 4 0 502337343 181891072 7095 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=177628 CPUtime=1.32 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 1857 0 0 0 132 0 0 0 18 0 4 0 502337343 181891072 7095 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.47
Current children cumulated vsize (KiB) 177628

[startup+3.1007 s]
/proc/loadavg: 7.72 7.99 7.93 5/179 8395
/proc/meminfo: memFree=31343660/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=181408 CPUtime=11.86 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 10084 0 0 0 1182 4 0 0 18 0 4 0 502337326 185761792 9835 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 45352 9835 460 189 0 39701 0
[pid=8390/tid=8392] ppid=8388 vsize=181408 CPUtime=2.91 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 1919 0 0 0 291 0 0 0 18 0 4 0 502337343 185761792 9835 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=181408 CPUtime=2.9 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 1895 0 0 0 290 0 0 0 25 0 4 0 502337343 185761792 9835 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=181408 CPUtime=2.92 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 2816 0 0 0 291 1 0 0 18 0 4 0 502337343 185761792 9835 33554432000 4194304 4964704 140735668886144 18446744073709551615 4660423 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.86
Current children cumulated vsize (KiB) 181408

[startup+6.30107 s]
/proc/loadavg: 7.74 7.99 7.93 9/184 8425
/proc/meminfo: memFree=31293744/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=186392 CPUtime=24.64 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 13749 0 0 0 2458 6 0 0 25 0 4 0 502337326 190865408 13500 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321038 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 46598 13500 460 189 0 40947 0
[pid=8390/tid=8392] ppid=8388 vsize=186392 CPUtime=6.11 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 2794 0 0 0 610 1 0 0 22 0 4 0 502337343 190865408 13500 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=186392 CPUtime=6.09 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 2671 0 0 0 609 0 0 0 25 0 4 0 502337343 190865408 13500 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=186392 CPUtime=6.12 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 3551 0 0 0 611 1 0 0 25 0 4 0 502337343 190865408 13500 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.64
Current children cumulated vsize (KiB) 186392

[startup+12.7008 s]
/proc/loadavg: 7.76 7.99 7.93 9/184 8425
/proc/meminfo: memFree=31248052/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=194072 CPUtime=50.2 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 18208 0 0 0 5013 7 0 0 25 0 4 0 502337326 198729728 17954 33554432000 4194304 4964704 140735668886144 18446744073709551615 4627873 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 48518 17954 460 189 0 42867 0
[pid=8390/tid=8392] ppid=8388 vsize=194072 CPUtime=12.51 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 4269 0 0 0 1250 1 0 0 25 0 4 0 502337343 198729728 17954 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=194072 CPUtime=12.46 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 3720 0 0 0 1245 1 0 0 25 0 4 0 502337343 198729728 17954 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=194072 CPUtime=12.52 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 4569 0 0 0 1250 2 0 0 25 0 4 0 502337343 198729728 17954 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.2
Current children cumulated vsize (KiB) 194072

[startup+25.5003 s]
/proc/loadavg: 7.89 8.00 7.93 9/184 8426
/proc/meminfo: memFree=31185572/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=201288 CPUtime=101.32 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 25013 0 0 0 10122 10 0 0 25 0 4 0 502337326 206118912 24627 33554432000 4194304 4964704 140735668886144 18446744073709551615 4334283 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 50322 24627 460 189 0 44671 0
[pid=8390/tid=8392] ppid=8388 vsize=201288 CPUtime=25.3 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 5385 0 0 0 2528 2 0 0 25 0 4 0 502337343 206118912 24627 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=201288 CPUtime=25.19 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 5680 0 0 0 2518 1 0 0 25 0 4 0 502337343 206118912 24627 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=201288 CPUtime=25.32 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 6386 0 0 0 2529 3 0 0 25 0 4 0 502337343 206118912 24627 33554432000 4194304 4964704 140735668886144 18446744073709551615 4332351 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.32
Current children cumulated vsize (KiB) 201288

[startup+51.1012 s]
/proc/loadavg: 7.93 8.00 7.93 9/184 8426
/proc/meminfo: memFree=31136268/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=209752 CPUtime=203.59 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 29059 0 0 0 20346 13 0 0 25 0 4 0 502337326 214786048 28611 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 52438 28611 460 189 0 46787 0
[pid=8390/tid=8392] ppid=8388 vsize=209752 CPUtime=50.89 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 6484 0 0 0 5087 2 0 0 25 0 4 0 502337343 214786048 28611 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=209752 CPUtime=50.67 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 7804 0 0 0 5065 2 0 0 25 0 4 0 502337343 214786048 28611 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=209752 CPUtime=50.92 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 6897 0 0 0 5089 3 0 0 25 0 4 0 502337343 214786048 28611 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.59
Current children cumulated vsize (KiB) 209752

[startup+102.307 s]
/proc/loadavg: 8.07 8.03 7.94 9/184 8428
/proc/meminfo: memFree=31016588/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=235356 CPUtime=408.13 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 46505 0 0 0 40790 23 0 0 25 0 4 0 502337326 241004544 45566 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 58839 45566 460 189 0 53188 0
[pid=8390/tid=8392] ppid=8388 vsize=235356 CPUtime=102.09 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 9024 0 0 0 10205 4 0 0 25 0 4 0 502337343 241004544 45566 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=235356 CPUtime=101.6 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 12704 0 0 0 10157 3 0 0 25 0 4 0 502337343 241004544 45566 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=235356 CPUtime=102.12 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 14700 0 0 0 10203 9 0 0 25 0 4 0 502337343 241004544 45566 33554432000 4194304 4964704 140735668886144 18446744073709551615 4342199 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.13
Current children cumulated vsize (KiB) 235356

[startup+162.301 s]
/proc/loadavg: 8.11 8.05 7.95 9/184 8429
/proc/meminfo: memFree=30912412/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=386744 CPUtime=647.78 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 58955 0 0 0 64746 32 0 0 25 0 4 0 502337326 396025856 57824 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 96686 57824 460 189 0 91035 0
[pid=8390/tid=8392] ppid=8388 vsize=386744 CPUtime=162.06 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 10289 0 0 0 16201 5 0 0 25 0 4 0 502337343 396025856 57824 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=386744 CPUtime=161.28 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 16636 0 0 0 16123 5 0 0 25 0 4 0 502337343 396025856 57824 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=386744 CPUtime=162.12 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 17862 0 0 0 16200 12 0 0 25 0 4 0 502337343 396025856 57824 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 647.78
Current children cumulated vsize (KiB) 386744

[startup+222.301 s]
/proc/loadavg: 8.12 8.07 7.96 9/184 8431
/proc/meminfo: memFree=30843076/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=455444 CPUtime=887.45 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 69602 0 0 0 88705 40 0 0 25 0 4 0 502337326 466374656 68393 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 113861 68393 460 189 0 108210 0
[pid=8390/tid=8392] ppid=8388 vsize=455444 CPUtime=222.06 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 11015 0 0 0 22200 6 0 0 25 0 4 0 502337343 466374656 68393 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=455444 CPUtime=220.95 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 17592 0 0 0 22090 5 0 0 25 0 4 0 502337343 466374656 68393 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=455444 CPUtime=222.12 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 24276 0 0 0 22195 17 0 0 25 0 4 0 502337343 466374656 68393 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 887.45
Current children cumulated vsize (KiB) 455444

[startup+282.3 s]

################
# More data... #
################

[pid=8390] ppid=8388 vsize=456256 CPUtime=2565.2 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 86854 0 0 0 256458 62 0 0 25 0 4 0 502337326 467206144 84407 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 114064 84407 460 189 0 108413 0
[pid=8390/tid=8392] ppid=8388 vsize=456256 CPUtime=642.04 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16355 0 0 0 64190 14 0 0 25 0 4 0 502337343 467206144 84407 33554432000 4194304 4964704 140735668886144 18446744073709551615 4332346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=456256 CPUtime=638.7 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 19977 0 0 0 63863 7 0 0 25 0 4 0 502337343 467206144 84407 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=456256 CPUtime=642.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 29018 0 0 0 64190 24 0 0 25 0 4 0 502337343 467206144 84407 33554432000 4194304 4964704 140735668886144 18446744073709551615 4332093 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2565.2
Current children cumulated vsize (KiB) 456256

[startup+702.301 s]
/proc/loadavg: 8.12 8.09 8.00 9/184 8474
/proc/meminfo: memFree=30767944/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=456256 CPUtime=2804.86 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 86947 0 0 0 280423 63 0 0 25 0 4 0 502337326 467206144 84435 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 114064 84435 460 189 0 108413 0
[pid=8390/tid=8392] ppid=8388 vsize=456256 CPUtime=702.03 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16429 0 0 0 70189 14 0 0 25 0 4 0 502337343 467206144 84435 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=456256 CPUtime=698.37 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 19987 0 0 0 69830 7 0 0 25 0 4 0 502337343 467206144 84435 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=456256 CPUtime=702.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 29023 0 0 0 70190 24 0 0 25 0 4 0 502337343 467206144 84435 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2804.86
Current children cumulated vsize (KiB) 456256

[startup+762.306 s]
/proc/loadavg: 8.21 8.11 8.02 10/184 8475
/proc/meminfo: memFree=30746340/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=521792 CPUtime=3044.56 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 89129 0 0 0 304389 67 0 0 25 0 4 0 502337326 534315008 86617 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320916 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 130448 86617 460 189 0 124797 0
[pid=8390/tid=8392] ppid=8388 vsize=521792 CPUtime=762.03 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16429 0 0 0 76189 14 0 0 25 0 4 0 502337343 534315008 86617 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=521792 CPUtime=758.05 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 20889 0 0 0 75797 8 0 0 25 0 4 0 502337343 534315008 86617 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=521792 CPUtime=762.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 30301 0 0 0 76187 27 0 0 25 0 4 0 502337343 534315008 86617 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.56
Current children cumulated vsize (KiB) 521792

[startup+822.301 s]
/proc/loadavg: 8.27 8.14 8.03 9/184 8477
/proc/meminfo: memFree=30709240/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=522048 CPUtime=3284.22 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 90898 0 0 0 328353 69 0 0 25 0 4 0 502337326 534577152 88386 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320958 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 130512 88386 460 189 0 124861 0
[pid=8390/tid=8392] ppid=8388 vsize=522048 CPUtime=822.02 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16456 0 0 0 82187 15 0 0 25 0 4 0 502337343 534577152 88386 33554432000 4194304 4964704 140735668886144 18446744073709551615 4669440 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=522048 CPUtime=817.73 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 21414 0 0 0 81765 8 0 0 25 0 4 0 502337343 534577152 88386 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=522048 CPUtime=822.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 31508 0 0 0 82186 28 0 0 25 0 4 0 502337343 534577152 88386 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.22
Current children cumulated vsize (KiB) 522048

[startup+882.3 s]
/proc/loadavg: 8.17 8.13 8.02 9/184 8488
/proc/meminfo: memFree=30662700/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=522472 CPUtime=3523.88 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 91011 0 0 0 352318 70 0 0 25 0 4 0 502337326 535011328 88499 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670193 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 130618 88499 460 189 0 124967 0
[pid=8390/tid=8392] ppid=8388 vsize=522472 CPUtime=882.02 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16458 0 0 0 88186 16 0 0 25 0 4 0 502337343 535011328 88499 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=522472 CPUtime=877.41 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 21518 0 0 0 87732 9 0 0 25 0 4 0 502337343 535011328 88499 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320919 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=522472 CPUtime=882.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 31515 0 0 0 88186 28 0 0 25 0 4 0 502337343 535011328 88499 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.88
Current children cumulated vsize (KiB) 522472

[startup+942.3 s]
/proc/loadavg: 8.11 8.12 8.02 9/184 8489
/proc/meminfo: memFree=30641704/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=522900 CPUtime=3763.58 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 92145 0 0 0 376284 74 0 0 25 0 4 0 502337326 535449600 89505 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 130725 89505 460 189 0 125074 0
[pid=8390/tid=8392] ppid=8388 vsize=522900 CPUtime=942.01 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16720 0 0 0 94185 16 0 0 25 0 4 0 502337343 535449600 89505 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=522900 CPUtime=937.1 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 21738 0 0 0 93701 9 0 0 25 0 4 0 502337343 535449600 89505 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=522900 CPUtime=942.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 32104 0 0 0 94184 30 0 0 25 0 4 0 502337343 535449600 89505 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.58
Current children cumulated vsize (KiB) 522900

[startup+1002.3 s]
/proc/loadavg: 8.15 8.12 8.03 10/184 8491
/proc/meminfo: memFree=30624700/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=524292 CPUtime=4003.24 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 93121 0 0 0 400249 75 0 0 25 0 4 0 502337326 536875008 90246 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670440 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 131073 90246 460 189 0 125422 0
[pid=8390/tid=8392] ppid=8388 vsize=524292 CPUtime=1002 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16725 0 0 0 100183 17 0 0 23 0 4 0 502337343 536875008 90246 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=524292 CPUtime=996.77 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 22701 0 0 0 99668 9 0 0 25 0 4 0 502337343 536875008 90246 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=524292 CPUtime=1002.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 32111 0 0 0 100184 30 0 0 25 0 4 0 502337343 536875008 90246 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.24
Current children cumulated vsize (KiB) 524292

[startup+1062.3 s]
/proc/loadavg: 8.05 8.10 8.02 10/184 8492
/proc/meminfo: memFree=30603104/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=524292 CPUtime=4242.91 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 93220 0 0 0 424215 76 0 0 25 0 4 0 502337326 536875008 90345 33554432000 4194304 4964704 140735668886144 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 131073 90345 460 189 0 125422 0
[pid=8390/tid=8392] ppid=8388 vsize=524292 CPUtime=1061.99 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16765 0 0 0 106181 18 0 0 25 0 4 0 502337343 536875008 90345 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=524292 CPUtime=1056.45 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 22701 0 0 0 105636 9 0 0 25 0 4 0 502337343 536875008 90345 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=524292 CPUtime=1062.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 32118 0 0 0 106184 30 0 0 25 0 4 0 502337343 536875008 90345 33554432000 4194304 4964704 140735668886144 18446744073709551615 4332387 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.91
Current children cumulated vsize (KiB) 524292

[startup+1122.3 s]
/proc/loadavg: 8.02 8.08 8.02 10/184 8494
/proc/meminfo: memFree=30578536/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=524292 CPUtime=4482.59 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 93776 0 0 0 448183 76 0 0 25 0 4 0 502337326 536875008 90836 33554432000 4194304 4964704 140735668886144 18446744073709551615 4683994 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 131073 90836 460 189 0 125422 0
[pid=8390/tid=8392] ppid=8388 vsize=524292 CPUtime=1121.99 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 16953 0 0 0 112181 18 0 0 25 0 4 0 502337343 536875008 90836 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=524292 CPUtime=1116.12 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 23035 0 0 0 111603 9 0 0 25 0 4 0 502337343 536875008 90836 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=524292 CPUtime=1122.14 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 32150 0 0 0 112184 30 0 0 25 0 4 0 502337343 536875008 90836 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.59
Current children cumulated vsize (KiB) 524292

[startup+1182.3 s]
/proc/loadavg: 8.01 8.06 8.01 10/184 8496
/proc/meminfo: memFree=30553212/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=524292 CPUtime=4722.27 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 95119 0 0 0 472149 78 0 0 25 0 4 0 502337326 536875008 92019 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 131073 92019 460 189 0 125422 0
[pid=8390/tid=8392] ppid=8388 vsize=524292 CPUtime=1181.99 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 17343 0 0 0 118181 18 0 0 25 0 4 0 502337343 536875008 92019 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=524292 CPUtime=1175.79 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 23259 0 0 0 117570 9 0 0 25 0 4 0 502337343 536875008 92019 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=524292 CPUtime=1182.15 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 32153 0 0 0 118185 30 0 0 25 0 4 0 502337343 536875008 92019 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.27
Current children cumulated vsize (KiB) 524292



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.01 8.06 8.01 9/184 8496
/proc/meminfo: memFree=30549356/32951124 swapFree=67111356/67111528
[pid=8390] ppid=8388 vsize=524292 CPUtime=4800.18 cores=1,3,5,7
/proc/8390/stat : 8390 (claspmt) R 8388 8390 8286 0 -1 4202496 95231 0 0 0 479940 78 0 0 25 0 4 0 502337326 536875008 92131 33554432000 4194304 4964704 140735668886144 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/8390/statm: 131073 92131 460 189 0 125422 0
[pid=8390/tid=8392] ppid=8388 vsize=524292 CPUtime=1201.49 cores=1,3,5,7
/proc/8390/task/8392/stat : 8392 (claspmt) R 8388 8390 8286 0 -1 4202560 17346 0 0 0 120131 18 0 0 25 0 4 0 502337343 536875008 92131 33554432000 4194304 4964704 140735668886144 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8390/tid=8393] ppid=8388 vsize=524292 CPUtime=1195.19 cores=1,3,5,7
/proc/8390/task/8393/stat : 8393 (claspmt) R 8388 8390 8286 0 -1 4202560 23368 0 0 0 119509 10 0 0 25 0 4 0 502337343 536875008 92131 33554432000 4194304 4964704 140735668886144 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8390/tid=8394] ppid=8388 vsize=524292 CPUtime=1201.65 cores=1,3,5,7
/proc/8390/task/8394/stat : 8394 (claspmt) R 8388 8390 8286 0 -1 4202560 32153 0 0 0 120135 30 0 0 25 0 4 0 502337343 536875008 92131 33554432000 4194304 4964704 140735668886144 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 524292

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1201.87
CPU time (s): 4800.27
CPU user time (s): 4799.47
CPU system time (s): 0.799878
CPU usage (%): 399.399
Max. virtual memory (cumulated for all children) (KiB): 524292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.47
system time used= 0.799878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 95243
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 19241
involuntary context switches= 31168

runsolver used 1.91971 second user time and 4.53531 second system time

The end

Launcher Data

Begin job on node143 at 2011-04-29 19:46:57
IDJOB=3299505
IDBENCH=83945
IDSOLVER=1683
FILE ID=node143/3299505-1304099217
RUNJOBID= node143-1304098013-8305
PBS_JOBID= 13170617
Free space on /tmp= 72924 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_18_80_10-dir.shuffled-as.sat03-140.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299505-1304099217/watcher-3299505-1304099217 -o /tmp/evaluation-result-3299505-1304099217/solver-3299505-1304099217 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299505-1304099217.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1037a2754a0a53f62ba8ec901741c9e9
RANDOM SEED=170911326

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31188880 kB
Buffers:        225920 kB
Cached:        1010812 kB
SwapCached:        168 kB
Active:         463836 kB
Inactive:      1023688 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31188880 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:            1196 kB
Writeback:           0 kB
AnonPages:      250800 kB
Mapped:          15908 kB
Slab:           212136 kB
PageTables:       5136 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   413580 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72924 MiB
End job on node143 at 2011-04-29 20:07:01