Trace number 3299475

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.42 1201.86

General information on the benchmark

NameSAT04/handmade/kexu/frb-0.6/
frb80-14-2.used-as.sat04-880.cnf
MD5SUM1242f0037df1c3d888415aeb418b77ed
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.696893
Satisfiable
(Un)Satisfiability was proved
Number of variables1120
Number of clauses43179
Sum of the clauses size87318
Maximum clause length14
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 243099
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data 

0.00/0.01	c clasp version 2.0.0-RC2
0.00/0.01	c Reading from ...654091/instance-3299475-1307654091.cnf
0.08/0.10	c Solving...
4800.34/1201.81	
4800.34/1201.81	*** INTERRUPTED! ***
4800.34/1201.81	*** Shutting down threads...
4800.34/1201.85	s UNKNOWN
4800.34/1201.85	
4800.34/1201.85	c INTERRUPTED   : 1
4800.34/1201.85	c Models        : 0+    
4800.34/1201.85	c Time          : 1201.795s (Solving: 1201.71s 1st Model: 0.00s Unsat: 0.00s)
4800.34/1201.85	c CPU Time      : 4800.360s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299475-1307654091/watcher-3299475-1307654091 -o /tmp/evaluation-result-3299475-1307654091/solver-3299475-1307654091 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299475-1307654091.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 1.97 1.93 3/175 12259
/proc/meminfo: memFree=32596624/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=20924 CPUtime=0 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) D 12257 12259 10687 0 -1 4194304 362 0 1 0 0 0 0 0 18 0 1 0 877009592 21426176 298 33554432000 4194304 4964704 140735016926320 18446744073709551615 230804242055 0 0 4096 0 18446744071562154983 0 0 17 5 0 0 0
/proc/12259/statm: 5231 298 252 189 0 92 0

[startup+0.0891179 s]
/proc/loadavg: 1.84 1.97 1.93 3/175 12259
/proc/meminfo: memFree=32596624/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=24408 CPUtime=0.07 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 1558 0 1 0 7 0 0 0 18 0 1 0 877009592 24993792 1299 33554432000 4194304 4964704 140735016926320 18446744073709551615 230808826565 0 0 4096 18946 0 0 0 17 5 0 0 1
/proc/12259/statm: 6102 1299 399 189 0 976 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 24408

[startup+0.101129 s]
/proc/loadavg: 1.84 1.97 1.93 3/175 12259
/proc/meminfo: memFree=32596624/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=24724 CPUtime=0.08 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 1641 0 1 0 8 0 0 0 18 0 1 0 877009592 25317376 1382 33554432000 4194304 4964704 140735016926320 18446744073709551615 230808820736 0 0 4096 18946 0 0 0 17 5 0 0 1
/proc/12259/statm: 6181 1382 402 189 0 1055 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 24724

[startup+0.301045 s]
/proc/loadavg: 1.84 1.97 1.93 3/175 12259
/proc/meminfo: memFree=32596624/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=171484 CPUtime=0.84 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 2658 0 2 0 84 0 0 0 18 0 4 0 877009592 175599616 2306 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627937 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 42871 2306 458 189 0 37220 0
Current children cumulated CPU time (s) 0.84
Current children cumulated vsize (KiB) 171484

[startup+0.700973 s]
/proc/loadavg: 1.84 1.97 1.93 3/175 12259
/proc/meminfo: memFree=32596624/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=173240 CPUtime=2.45 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 3966 0 2 0 244 1 0 0 18 0 4 0 877009592 177397760 3614 33554432000 4194304 4964704 140735016926320 18446744073709551615 4688683 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 43310 3614 458 189 0 37659 0
Current children cumulated CPU time (s) 2.45
Current children cumulated vsize (KiB) 173240

[startup+1.50083 s]
/proc/loadavg: 1.84 1.97 1.93 9/184 12271
/proc/meminfo: memFree=32566504/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=174292 CPUtime=5.64 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 4814 0 2 0 563 1 0 0 19 0 4 0 877009592 178475008 4462 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 43573 4462 458 189 0 37922 0
[pid=12259/tid=12266] ppid=12257 vsize=174292 CPUtime=1.38 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 776 0 0 0 138 0 0 0 19 0 4 0 877009603 178475008 4462 33554432000 4194304 4964704 140735016926320 18446744073709551615 4654500 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=174292 CPUtime=1.38 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 899 0 0 0 138 0 0 0 23 0 4 0 877009603 178475008 4462 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=174292 CPUtime=1.38 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 728 0 0 0 138 0 0 0 22 0 4 0 877009603 178475008 4462 33554432000 4194304 4964704 140735016926320 18446744073709551615 230808826913 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.64
Current children cumulated vsize (KiB) 174292

[startup+3.10054 s]
/proc/loadavg: 1.84 1.97 1.93 10/184 12271
/proc/meminfo: memFree=32554912/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=175460 CPUtime=12.03 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 6006 0 2 0 1202 1 0 0 24 0 4 0 877009592 179671040 5654 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 43865 5654 460 189 0 38214 0
[pid=12259/tid=12266] ppid=12257 vsize=175460 CPUtime=2.98 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 1117 0 0 0 298 0 0 0 25 0 4 0 877009603 179671040 5654 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=175460 CPUtime=2.97 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 1236 0 0 0 297 0 0 0 25 0 4 0 877009603 179671040 5654 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670064 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=175460 CPUtime=2.98 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 1032 0 0 0 298 0 0 0 25 0 4 0 877009603 179671040 5654 33554432000 4194304 4964704 140735016926320 18446744073709551615 4363370 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.03
Current children cumulated vsize (KiB) 175460

[startup+6.30095 s]
/proc/loadavg: 2.33 2.07 1.96 9/184 12272
/proc/meminfo: memFree=32538644/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=176912 CPUtime=24.81 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 7276 0 2 0 2479 2 0 0 25 0 4 0 877009592 181157888 6924 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 44228 6924 460 189 0 38577 0
[pid=12259/tid=12266] ppid=12257 vsize=176912 CPUtime=6.18 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 1459 0 0 0 618 0 0 0 25 0 4 0 877009603 181157888 6924 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=176912 CPUtime=6.15 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 1680 0 0 0 615 0 0 0 25 0 4 0 877009603 181157888 6924 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=176912 CPUtime=6.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 1277 0 0 0 618 0 0 0 25 0 4 0 877009603 181157888 6924 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627170 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.81
Current children cumulated vsize (KiB) 176912

[startup+12.7008 s]
/proc/loadavg: 2.79 2.16 1.99 9/184 12272
/proc/meminfo: memFree=32505832/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=183556 CPUtime=50.37 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 10765 0 2 0 5034 3 0 0 25 0 4 0 877009592 187961344 10413 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670243 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 45889 10413 460 189 0 40238 0
[pid=12259/tid=12266] ppid=12257 vsize=183556 CPUtime=12.58 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 2368 0 0 0 1257 1 0 0 23 0 4 0 877009603 187961344 10413 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=183556 CPUtime=12.51 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 2917 0 0 0 1251 0 0 0 25 0 4 0 877009603 187961344 10413 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627168 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=183556 CPUtime=12.57 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 2041 0 0 0 1257 0 0 0 25 0 4 0 877009603 187961344 10413 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627257 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.37
Current children cumulated vsize (KiB) 183556

[startup+25.5004 s]
/proc/loadavg: 3.94 2.45 2.09 9/184 12272
/proc/meminfo: memFree=32480044/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=186276 CPUtime=101.5 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 13294 0 2 0 10144 6 0 0 25 0 4 0 877009592 190746624 12942 33554432000 4194304 4964704 140735016926320 18446744073709551615 4320848 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 46569 12942 460 189 0 40918 0
[pid=12259/tid=12266] ppid=12257 vsize=186276 CPUtime=25.38 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 3048 0 0 0 2537 1 0 0 25 0 4 0 877009603 190746624 12942 33554432000 4194304 4964704 140735016926320 18446744073709551615 4660156 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=186276 CPUtime=25.25 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 3623 0 0 0 2524 1 0 0 25 0 4 0 877009603 190746624 12942 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=186276 CPUtime=25.38 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 2539 0 0 0 2536 2 0 0 25 0 4 0 877009603 190746624 12942 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.5
Current children cumulated vsize (KiB) 186276

[startup+51.1008 s]
/proc/loadavg: 5.32 2.89 2.24 9/184 12273
/proc/meminfo: memFree=32420736/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=195476 CPUtime=203.76 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 19941 0 2 0 20366 10 0 0 25 0 4 0 877009592 200167424 19369 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 48869 19369 460 189 0 43218 0
[pid=12259/tid=12266] ppid=12257 vsize=195476 CPUtime=50.97 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 4609 0 0 0 5095 2 0 0 25 0 4 0 877009603 200167424 19369 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=195476 CPUtime=50.71 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 5549 0 0 0 5070 1 0 0 25 0 4 0 877009603 200167424 19369 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=195476 CPUtime=50.98 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 4143 0 0 0 5095 3 0 0 25 0 4 0 877009603 200167424 19369 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321061 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.76
Current children cumulated vsize (KiB) 195476

[startup+102.306 s]
/proc/loadavg: 6.88 3.69 2.55 9/184 12274
/proc/meminfo: memFree=32358832/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=203320 CPUtime=408.28 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 25569 0 2 0 40812 16 0 0 25 0 4 0 877009592 208199680 24949 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 50830 24949 460 189 0 45179 0
[pid=12259/tid=12266] ppid=12257 vsize=203320 CPUtime=102.17 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 6186 0 0 0 10213 4 0 0 25 0 4 0 877009603 208199680 24949 33554432000 4194304 4964704 140735016926320 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=203320 CPUtime=101.63 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 6894 0 0 0 10161 2 0 0 25 0 4 0 877009603 208199680 24949 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=203320 CPUtime=102.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 5193 0 0 0 10214 4 0 0 25 0 4 0 877009603 208199680 24949 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.28
Current children cumulated vsize (KiB) 203320

[startup+162.3 s]
/proc/loadavg: 7.62 4.49 2.89 9/184 12276
/proc/meminfo: memFree=32327920/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=207228 CPUtime=647.92 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 29096 0 2 0 64773 19 0 0 25 0 4 0 877009592 212201472 28301 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 51807 28301 460 189 0 46156 0
[pid=12259/tid=12266] ppid=12257 vsize=207228 CPUtime=162.15 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 7211 0 0 0 16210 5 0 0 25 0 4 0 877009603 212201472 28301 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=207228 CPUtime=161.3 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 8235 0 0 0 16127 3 0 0 25 0 4 0 877009603 212201472 28301 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=207228 CPUtime=162.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 5579 0 0 0 16213 5 0 0 25 0 4 0 877009603 212201472 28301 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.92
Current children cumulated vsize (KiB) 207228

[startup+222.301 s]
/proc/loadavg: 8.00 5.17 3.22 9/184 12277
/proc/meminfo: memFree=32291184/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=211748 CPUtime=887.58 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 32941 0 2 0 88735 23 0 0 25 0 4 0 877009592 216829952 32067 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670293 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 52937 32067 460 189 0 47286 0
[pid=12259/tid=12266] ppid=12257 vsize=211748 CPUtime=222.14 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 7937 0 0 0 22209 5 0 0 25 0 4 0 877009603 216829952 32067 33554432000 4194304 4964704 140735016926320 18446744073709551615 4668492 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=211748 CPUtime=220.96 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 9418 0 0 0 22093 3 0 0 25 0 4 0 877009603 216829952 32067 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670187 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=211748 CPUtime=222.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 6638 0 0 0 22211 7 0 0 25 0 4 0 877009603 216829952 32067 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627275 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 887.58
Current children cumulated vsize (KiB) 211748

[startup+282.301 s]

################
# More data... #
################

[pid=12259] ppid=12257 vsize=226636 CPUtime=2565.25 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 43030 0 2 0 256494 31 0 0 25 0 4 0 877009592 232075264 41163 33554432000 4194304 4964704 140735016926320 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 56659 41163 460 189 0 51008 0
[pid=12259/tid=12266] ppid=12257 vsize=226636 CPUtime=642.08 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 11146 0 0 0 64200 8 0 0 25 0 4 0 877009603 232075264 41163 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=226636 CPUtime=638.69 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 13610 0 0 0 63863 6 0 0 25 0 4 0 877009603 232075264 41163 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=226636 CPUtime=642.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 7938 0 0 0 64210 8 0 0 25 0 4 0 877009603 232075264 41163 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2565.25
Current children cumulated vsize (KiB) 226636

[startup+702.301 s]
/proc/loadavg: 6.34 7.06 5.02 5/175 12314
/proc/meminfo: memFree=32430028/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=227796 CPUtime=2804.91 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 44383 0 2 0 280458 33 0 0 25 0 4 0 877009592 233263104 42419 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627290 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 56949 42419 460 189 0 51298 0
[pid=12259/tid=12266] ppid=12257 vsize=227796 CPUtime=702.06 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 11541 0 0 0 70198 8 0 0 25 0 4 0 877009603 233263104 42419 33554432000 4194304 4964704 140735016926320 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=227796 CPUtime=698.38 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 14276 0 0 0 69832 6 0 0 25 0 4 0 877009603 233263104 42419 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=227796 CPUtime=702.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8068 0 0 0 70209 9 0 0 25 0 4 0 877009603 233263104 42419 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2804.91
Current children cumulated vsize (KiB) 227796

[startup+762.307 s]
/proc/loadavg: 4.91 6.52 4.96 5/175 12316
/proc/meminfo: memFree=32423920/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=231116 CPUtime=3044.63 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 45902 0 2 0 304429 34 0 0 25 0 4 0 877009592 236662784 43771 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670269 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 57779 43771 460 189 0 52128 0
[pid=12259/tid=12266] ppid=12257 vsize=231116 CPUtime=762.06 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 11880 0 0 0 76197 9 0 0 25 0 4 0 877009603 236662784 43771 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=231116 CPUtime=758.08 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 15347 0 0 0 75802 6 0 0 25 0 4 0 877009603 236662784 43771 33554432000 4194304 4964704 140735016926320 18446744073709551615 4668942 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=231116 CPUtime=762.19 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8071 0 0 0 76210 9 0 0 25 0 4 0 877009603 236662784 43771 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.63
Current children cumulated vsize (KiB) 231116

[startup+822.301 s]
/proc/loadavg: 4.38 6.07 4.90 5/175 12317
/proc/meminfo: memFree=32421656/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=232692 CPUtime=3284.3 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 46626 0 2 0 328395 35 0 0 25 0 4 0 877009592 238276608 44364 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627211 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 58173 44364 460 189 0 52522 0
[pid=12259/tid=12266] ppid=12257 vsize=232692 CPUtime=822.05 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 12204 0 0 0 82196 9 0 0 25 0 4 0 877009603 238276608 44364 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=232692 CPUtime=817.78 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 15595 0 0 0 81771 7 0 0 25 0 4 0 877009603 238276608 44364 33554432000 4194304 4964704 140735016926320 18446744073709551615 230808863315 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=232692 CPUtime=822.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8211 0 0 0 82209 9 0 0 25 0 4 0 877009603 238276608 44364 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.3
Current children cumulated vsize (KiB) 232692

[startup+882.301 s]
/proc/loadavg: 4.14 5.69 4.84 5/175 12319
/proc/meminfo: memFree=32418636/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=233764 CPUtime=3523.98 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 47448 0 2 0 352362 36 0 0 25 0 4 0 877009592 239374336 45186 33554432000 4194304 4964704 140735016926320 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 58441 45186 460 189 0 52790 0
[pid=12259/tid=12266] ppid=12257 vsize=233764 CPUtime=882.04 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 12696 0 0 0 88195 9 0 0 25 0 4 0 877009603 239374336 45186 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=233764 CPUtime=877.46 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 15773 0 0 0 87739 7 0 0 25 0 4 0 877009603 239374336 45186 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=233764 CPUtime=882.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8301 0 0 0 88209 9 0 0 25 0 4 0 877009603 239374336 45186 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3523.98
Current children cumulated vsize (KiB) 233764

[startup+942.301 s]
/proc/loadavg: 4.09 5.40 4.79 5/175 12320
/proc/meminfo: memFree=32415128/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=234972 CPUtime=3763.67 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 48478 0 2 0 376331 36 0 0 25 0 4 0 877009592 240611328 46017 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 58743 46017 460 189 0 53092 0
[pid=12259/tid=12266] ppid=12257 vsize=234972 CPUtime=942.03 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 13160 0 0 0 94194 9 0 0 25 0 4 0 877009603 240611328 46017 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=234972 CPUtime=937.16 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 16244 0 0 0 93709 7 0 0 25 0 4 0 877009603 240611328 46017 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=234972 CPUtime=942.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8333 0 0 0 94209 9 0 0 25 0 4 0 877009603 240611328 46017 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3763.67
Current children cumulated vsize (KiB) 234972

[startup+1002.3 s]
/proc/loadavg: 4.03 5.14 4.74 5/175 12322
/proc/meminfo: memFree=32410020/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=236316 CPUtime=4003.34 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 50054 0 2 0 400296 38 0 0 25 0 4 0 877009592 241987584 47360 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 59079 47360 460 189 0 53428 0
[pid=12259/tid=12266] ppid=12257 vsize=236316 CPUtime=1002.02 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 13822 0 0 0 100192 10 0 0 25 0 4 0 877009603 241987584 47360 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=236316 CPUtime=996.86 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 17053 0 0 0 99678 8 0 0 25 0 4 0 877009603 241987584 47360 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=236316 CPUtime=1002.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8365 0 0 0 100209 9 0 0 25 0 4 0 877009603 241987584 47360 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.34
Current children cumulated vsize (KiB) 236316

[startup+1062.3 s]
/proc/loadavg: 4.01 4.93 4.69 5/175 12324
/proc/meminfo: memFree=32405896/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=302068 CPUtime=4243.05 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 51241 0 2 0 424265 40 0 0 25 0 4 0 877009592 309317632 48379 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 75517 48379 460 189 0 69866 0
[pid=12259/tid=12266] ppid=12257 vsize=302068 CPUtime=1062 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 14046 0 0 0 106190 10 0 0 25 0 4 0 877009603 309317632 48379 33554432000 4194304 4964704 140735016926320 18446744073709551615 4668998 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=302068 CPUtime=1056.57 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 17845 0 0 0 105648 9 0 0 25 0 4 0 877009603 309317632 48379 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=302068 CPUtime=1062.17 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8503 0 0 0 106208 9 0 0 25 0 4 0 877009603 309317632 48379 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.05
Current children cumulated vsize (KiB) 302068

[startup+1122.3 s]
/proc/loadavg: 4.04 4.77 4.65 5/175 12325
/proc/meminfo: memFree=32401276/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=304188 CPUtime=4482.75 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 52534 0 2 0 448234 41 0 0 25 0 4 0 877009592 311488512 49541 33554432000 4194304 4964704 140735016926320 18446744073709551615 4627978 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 76047 49541 460 189 0 70396 0
[pid=12259/tid=12266] ppid=12257 vsize=304188 CPUtime=1122.01 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 14498 0 0 0 112190 11 0 0 25 0 4 0 877009603 311488512 49541 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=304188 CPUtime=1116.28 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 18508 0 0 0 111618 10 0 0 25 0 4 0 877009603 311488512 49541 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=304188 CPUtime=1122.17 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8533 0 0 0 112208 9 0 0 25 0 4 0 877009603 311488512 49541 33554432000 4194304 4964704 140735016926320 18446744073709551615 4660755 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4482.75
Current children cumulated vsize (KiB) 304188

[startup+1182.3 s]
/proc/loadavg: 4.12 4.66 4.62 5/175 12327
/proc/meminfo: memFree=32399496/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=304568 CPUtime=4722.43 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 53109 0 2 0 472201 42 0 0 25 0 4 0 877009592 311877632 49973 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670263 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 76142 49973 460 189 0 70491 0
[pid=12259/tid=12266] ppid=12257 vsize=304568 CPUtime=1182 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 14823 0 0 0 118189 11 0 0 25 0 4 0 877009603 311877632 49973 33554432000 4194304 4964704 140735016926320 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=304568 CPUtime=1175.96 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 18710 0 0 0 117586 10 0 0 25 0 4 0 877009603 311877632 49973 33554432000 4194304 4964704 140735016926320 18446744073709551615 4668472 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=304568 CPUtime=1182.18 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8566 0 0 0 118208 10 0 0 25 0 4 0 877009603 311877632 49973 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 304568



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 4.09 4.61 4.60 5/175 12327
/proc/meminfo: memFree=32398244/32951124 swapFree=67052920/67111528
[pid=12259] ppid=12257 vsize=305504 CPUtime=4800.34 cores=1,3,5,7
/proc/12259/stat : 12259 (claspmt) R 12257 12259 10687 0 -1 4202496 53471 0 2 0 479992 42 0 0 25 0 4 0 877009592 312836096 50335 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670422 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 1
/proc/12259/statm: 76376 50335 460 189 0 70725 0
[pid=12259/tid=12266] ppid=12257 vsize=305504 CPUtime=1201.5 cores=1,3,5,7
/proc/12259/task/12266/stat : 12266 (claspmt) R 12257 12259 10687 0 -1 4202560 14970 0 0 0 120139 11 0 0 25 0 4 0 877009603 312836096 50335 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=12259/tid=12267] ppid=12257 vsize=305504 CPUtime=1195.36 cores=1,3,5,7
/proc/12259/task/12267/stat : 12267 (claspmt) R 12257 12259 10687 0 -1 4202560 18907 0 0 0 119526 10 0 0 25 0 4 0 877009603 312836096 50335 33554432000 4194304 4964704 140735016926320 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=12259/tid=12268] ppid=12257 vsize=305504 CPUtime=1201.69 cores=1,3,5,7
/proc/12259/task/12268/stat : 12268 (claspmt) R 12257 12259 10687 0 -1 4202560 8584 0 0 0 120159 10 0 0 25 0 4 0 877009603 312836096 50335 33554432000 4194304 4964704 140735016926320 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 305504

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1201.86
CPU time (s): 4800.42
CPU user time (s): 4799.98
CPU system time (s): 0.433934
CPU usage (%): 399.417
Max. virtual memory (cumulated for all children) (KiB): 305504

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.98
system time used= 0.433934
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 53483
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6340
involuntary context switches= 33005

runsolver used 1.73374 second user time and 4.6103 second system time

The end

Launcher Data 

Begin job on node104 at 2011-06-09 23:14:51
IDJOB=3299475
IDBENCH=84554
IDSOLVER=1683
FILE ID=node104/3299475-1307654091
RUNJOBID= node104-1307654091-12237
PBS_JOBID= 13549387
Free space on /tmp= 74184 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT04/handmade/kexu/frb-0.6/frb80-14-2.used-as.sat04-880.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299475-1307654091/watcher-3299475-1307654091 -o /tmp/evaluation-result-3299475-1307654091/solver-3299475-1307654091 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299475-1307654091.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1242f0037df1c3d888415aeb418b77ed
RANDOM SEED=931052838

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32597696 kB
Buffers:         40032 kB
Cached:         157744 kB
SwapCached:      10316 kB
Active:          90492 kB
Inactive:       124480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32597696 kB
SwapTotal:    67111528 kB
SwapFree:     67052920 kB
Dirty:            1996 kB
Writeback:          36 kB
AnonPages:       14828 kB
Mapped:           8412 kB
Slab:            73652 kB
PageTables:       5000 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74180 MiB
End job on node104 at 2011-06-09 23:34:55