Trace number 3299386

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.26 1204.78

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m52-q1041.25-n50-p15-s99099953.cnf
MD5SUMdda220d08783aabf4e7a9e99eeeccae6
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2444
Number of clauses498568
Sum of the clauses size999480
Maximum clause length52
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2498518
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...115927/instance-3299386-1304115927.cnf
3.99/4.00	c Solving...
4800.06/1204.61	
4800.06/1204.61	*** INTERRUPTED! ***
4800.06/1204.61	*** Shutting down threads...
4800.18/1204.77	s UNKNOWN
4800.18/1204.77	
4800.18/1204.77	c INTERRUPTED   : 1
4800.18/1204.77	c Models        : 0+    
4800.18/1204.77	c Time          : 1204.614s (Solving: 1200.62s 1st Model: 0.00s Unsat: 0.00s)
4800.18/1204.77	c CPU Time      : 4800.090s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299386-1304115927/watcher-3299386-1304115927 -o /tmp/evaluation-result-3299386-1304115927/solver-3299386-1304115927 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299386-1304115927.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.86 7.97 7.55 5/180 27154
/proc/meminfo: memFree=23481824/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=21836 CPUtime=0 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 753 0 0 0 0 0 0 0 25 0 1 0 601823434 22360064 664 33554432000 4194304 4964704 140736438332672 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 5459 665 385 189 0 333 0

[startup+0.0915629 s]
/proc/loadavg: 7.86 7.97 7.55 5/180 27154
/proc/meminfo: memFree=23481824/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=38024 CPUtime=0.08 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 6462 0 0 0 8 0 0 0 25 0 1 0 601823434 38936576 4615 33554432000 4194304 4964704 140736438332672 18446744073709551615 216734839493 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 9506 4618 385 189 0 4380 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 38024

[startup+0.100558 s]
/proc/loadavg: 7.86 7.97 7.55 5/180 27154
/proc/meminfo: memFree=23481824/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=39344 CPUtime=0.09 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 6896 0 0 0 9 0 0 0 25 0 1 0 601823434 40288256 5049 33554432000 4194304 4964704 140736438332672 18446744073709551615 216735178496 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 9836 5050 385 189 0 4710 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 39344

[startup+0.300525 s]
/proc/loadavg: 7.86 7.97 7.55 5/180 27154
/proc/meminfo: memFree=23481824/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=54704 CPUtime=0.29 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 11084 0 0 0 28 1 0 0 25 0 1 0 601823434 56016896 8303 33554432000 4194304 4964704 140736438332672 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 13676 8303 398 189 0 8550 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 54704

[startup+0.700461 s]
/proc/loadavg: 7.86 7.97 7.55 5/180 27154
/proc/meminfo: memFree=23481824/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=54704 CPUtime=0.69 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 11084 0 0 0 68 1 0 0 25 0 1 0 601823434 56016896 8303 33554432000 4194304 4964704 140736438332672 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 13676 8303 398 189 0 8550 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 54704

[startup+1.50032 s]
/proc/loadavg: 7.86 7.97 7.55 6/181 27155
/proc/meminfo: memFree=23449896/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=54704 CPUtime=1.49 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 11084 0 0 0 148 1 0 0 25 0 1 0 601823434 56016896 8303 33554432000 4194304 4964704 140736438332672 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 13676 8303 398 189 0 8550 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 54704

[startup+3.10104 s]
/proc/loadavg: 7.86 7.97 7.55 6/181 27155
/proc/meminfo: memFree=23449276/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=55628 CPUtime=3.09 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 11332 0 0 0 308 1 0 0 25 0 1 0 601823434 56963072 8551 33554432000 4194304 4964704 140736438332672 18446744073709551615 4600360 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27154/statm: 13907 8551 399 189 0 8781 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 55628

[startup+6.30045 s]
/proc/loadavg: 7.87 7.97 7.55 9/184 27158
/proc/meminfo: memFree=23423692/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=199368 CPUtime=13.13 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 21875 0 0 0 1306 7 0 0 21 0 4 0 601823434 204152832 18119 33554432000 4194304 4964704 140736438332672 18446744073709551615 4342208 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 49842 18120 458 189 0 44191 0
[pid=27154/tid=27156] ppid=27152 vsize=199368 CPUtime=2.27 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 2475 0 0 0 226 1 0 0 25 0 4 0 601823834 204152832 18120 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=199368 CPUtime=2.28 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 2066 0 0 0 228 0 0 0 25 0 4 0 601823834 204152832 18120 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=199368 CPUtime=2.28 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 2668 0 0 0 227 1 0 0 25 0 4 0 601823834 204152832 18120 33554432000 4194304 4964704 140736438332672 18446744073709551615 216734839841 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 13.13
Current children cumulated vsize (KiB) 199368

[startup+12.7003 s]
/proc/loadavg: 7.88 7.97 7.56 9/184 27158
/proc/meminfo: memFree=23344052/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=222692 CPUtime=38.69 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 39492 0 0 0 3854 15 0 0 25 0 4 0 601823434 228036608 35736 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 55673 35736 460 189 0 50022 0
[pid=27154/tid=27156] ppid=27152 vsize=222692 CPUtime=8.67 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 7056 0 0 0 863 4 0 0 25 0 4 0 601823834 228036608 35736 33554432000 4194304 4964704 140736438332672 18446744073709551615 4343187 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=222692 CPUtime=8.68 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 5104 0 0 0 867 1 0 0 25 0 4 0 601823834 228036608 35736 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=222692 CPUtime=8.68 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 7269 0 0 0 864 4 0 0 25 0 4 0 601823834 228036608 35736 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38.69
Current children cumulated vsize (KiB) 222692

[startup+25.5011 s]
/proc/loadavg: 8.05 8.00 7.57 10/184 27158
/proc/meminfo: memFree=23243856/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=385164 CPUtime=89.81 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 62950 0 0 0 8955 26 0 0 25 0 4 0 601823434 394407936 59194 33554432000 4194304 4964704 140736438332672 18446744073709551615 4627910 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 96291 59194 460 189 0 90640 0
[pid=27154/tid=27156] ppid=27152 vsize=385164 CPUtime=21.46 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 12181 0 0 0 2140 6 0 0 19 0 4 0 601823834 394407936 59194 33554432000 4194304 4964704 140736438332672 18446744073709551615 4627269 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=385164 CPUtime=21.48 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 7817 0 0 0 2146 2 0 0 25 0 4 0 601823834 394407936 59194 33554432000 4194304 4964704 140736438332672 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=385164 CPUtime=21.48 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 14442 0 0 0 2141 7 0 0 25 0 4 0 601823834 394407936 59194 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 89.81
Current children cumulated vsize (KiB) 385164

[startup+51.1006 s]
/proc/loadavg: 8.03 8.00 7.58 9/184 27159
/proc/meminfo: memFree=23102860/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=496792 CPUtime=192.07 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 98709 0 0 0 19158 49 0 0 25 0 4 0 601823434 508715008 94946 33554432000 4194304 4964704 140736438332672 18446744073709551615 4627365 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 124198 94946 460 189 0 118547 0
[pid=27154/tid=27156] ppid=27152 vsize=496792 CPUtime=47.05 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 25182 0 0 0 4689 16 0 0 25 0 4 0 601823834 508715008 94946 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=496792 CPUtime=47.09 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 12557 0 0 0 4704 5 0 0 25 0 4 0 601823834 508715008 94946 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=496792 CPUtime=47.08 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 23867 0 0 0 4696 12 0 0 25 0 4 0 601823834 508715008 94946 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 192.07
Current children cumulated vsize (KiB) 496792

[startup+102.307 s]
/proc/loadavg: 8.07 8.01 7.61 9/184 27160
/proc/meminfo: memFree=22993192/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=647320 CPUtime=396.59 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 124993 0 0 0 39589 70 0 0 25 0 4 0 601823434 662855680 121149 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 161830 121149 460 189 0 156179 0
[pid=27154/tid=27156] ppid=27152 vsize=647320 CPUtime=98.26 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 38804 0 0 0 9795 31 0 0 25 0 4 0 601823834 662855680 121149 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=647320 CPUtime=98.3 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 13441 0 0 0 9825 5 0 0 25 0 4 0 601823834 662855680 121149 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=647320 CPUtime=98.29 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 24843 0 0 0 9816 13 0 0 25 0 4 0 601823834 662855680 121149 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 396.59
Current children cumulated vsize (KiB) 647320

[startup+162.3 s]
/proc/loadavg: 8.13 8.04 7.64 9/184 27162
/proc/meminfo: memFree=22858604/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=732752 CPUtime=636.22 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 153738 0 0 0 63528 94 0 0 25 0 4 0 601823434 750338048 149764 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 183188 149764 460 189 0 177537 0
[pid=27154/tid=27156] ppid=27152 vsize=732752 CPUtime=158.23 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 44573 0 0 0 15787 36 0 0 25 0 4 0 601823834 750338048 149764 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=732752 CPUtime=158.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 15467 0 0 0 15824 5 0 0 25 0 4 0 601823834 750338048 149764 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=732752 CPUtime=158.27 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 32100 0 0 0 15807 20 0 0 25 0 4 0 601823834 750338048 149764 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 636.22
Current children cumulated vsize (KiB) 732752

[startup+222.301 s]
/proc/loadavg: 8.10 8.04 7.66 9/184 27164
/proc/meminfo: memFree=22759700/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=802956 CPUtime=875.89 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 171118 0 0 0 87476 113 0 0 25 0 4 0 601823434 822226944 167083 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 200739 167083 460 189 0 195088 0
[pid=27154/tid=27156] ppid=27152 vsize=802956 CPUtime=218.23 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 52298 0 0 0 21778 45 0 0 25 0 4 0 601823834 822226944 167083 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=802956 CPUtime=218.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 16589 0 0 0 21823 6 0 0 25 0 4 0 601823834 822226944 167083 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=802956 CPUtime=218.28 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 34118 0 0 0 21806 22 0 0 25 0 4 0 601823834 822226944 167083 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 875.89
Current children cumulated vsize (KiB) 802956

[startup+282.3 s]
/proc/loadavg: 8.08 8.05 7.69 9/184 27165
/proc/meminfo: memFree=22630444/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=971368 CPUtime=1115.54 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 202288 0 0 0 111415 139 0 0 25 0 4 0 601823434 994680832 198187 33554432000 4194304 4964704 140736438332672 18446744073709551615 4342228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 242842 198187 460 189 0 237191 0
[pid=27154/tid=27156] ppid=27152 vsize=971368 CPUtime=278.21 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 64041 0 0 0 27770 51 0 0 25 0 4 0 601823834 994680832 198187 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=971368 CPUtime=278.3 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 19108 0 0 0 27823 7 0 0 25 0 4 0 601823834 994680832 198187 33554432000 4194304 4964704 140736438332672 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=971368 CPUtime=278.27 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 47864 0 0 0 27789 38 0 0 25 0 4 0 601823834 994680832 198187 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1115.54

################
# More data... #
################

Current children cumulated CPU time (s) 2553.63
Current children cumulated vsize (KiB) 1274084

[startup+702.301 s]
/proc/loadavg: 4.11 5.85 6.90 5/175 27194
/proc/meminfo: memFree=23260692/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1279620 CPUtime=2793.35 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 285770 0 0 0 279065 270 0 0 25 0 4 0 601823434 1310330880 281367 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 319905 281367 460 189 0 314254 0
[pid=27154/tid=27156] ppid=27152 vsize=1279620 CPUtime=698.18 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 85307 0 0 0 69717 101 0 0 25 0 4 0 601823834 1310330880 281367 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1279620 CPUtime=698.3 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 32136 0 0 0 69817 13 0 0 25 0 4 0 601823834 1310330880 281367 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1279620 CPUtime=698.26 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 86064 0 0 0 69720 106 0 0 25 0 4 0 601823834 1310330880 281367 33554432000 4194304 4964704 140736438332672 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2793.35
Current children cumulated vsize (KiB) 1279620

[startup+762.307 s]
/proc/loadavg: 4.04 5.51 6.72 5/175 27196
/proc/meminfo: memFree=23158744/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1412144 CPUtime=3033.06 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 311479 0 0 0 302985 321 0 0 25 0 4 0 601823434 1446035456 306866 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 353036 306866 460 189 0 347385 0
[pid=27154/tid=27156] ppid=27152 vsize=1412144 CPUtime=758.17 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 93850 0 0 0 75700 117 0 0 25 0 4 0 601823834 1446035456 306866 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1412144 CPUtime=758.31 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 35374 0 0 0 75816 15 0 0 25 0 4 0 601823834 1446035456 306866 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1412144 CPUtime=758.27 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 93022 0 0 0 75696 131 0 0 25 0 4 0 601823834 1446035456 306866 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3033.06
Current children cumulated vsize (KiB) 1412144

[startup+822.3 s]
/proc/loadavg: 4.01 5.23 6.54 5/175 27201
/proc/meminfo: memFree=23127044/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1412144 CPUtime=3272.74 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 319460 0 0 0 326925 349 0 0 25 0 4 0 601823434 1446035456 314847 33554432000 4194304 4964704 140736438332672 18446744073709551615 4332491 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 353036 314847 460 189 0 347385 0
[pid=27154/tid=27156] ppid=27152 vsize=1412144 CPUtime=818.17 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 97884 0 0 0 81686 131 0 0 25 0 4 0 601823834 1446035456 314847 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1412144 CPUtime=818.3 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 37707 0 0 0 81805 25 0 0 25 0 4 0 601823834 1446035456 314847 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1412144 CPUtime=818.25 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 93080 0 0 0 81694 131 0 0 25 0 4 0 601823834 1446035456 314847 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3272.74
Current children cumulated vsize (KiB) 1412144

[startup+882.301 s]
/proc/loadavg: 4.00 5.01 6.38 5/175 27202
/proc/meminfo: memFree=23110140/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1426880 CPUtime=3512.45 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 323647 0 0 0 350892 353 0 0 25 0 4 0 601823434 1461125120 319034 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 356720 319034 460 189 0 351069 0
[pid=27154/tid=27156] ppid=27152 vsize=1426880 CPUtime=878.17 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 101378 0 0 0 87683 134 0 0 25 0 4 0 601823834 1461125120 319034 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1426880 CPUtime=878.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38314 0 0 0 87804 25 0 0 25 0 4 0 601823834 1461125120 319034 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1426880 CPUtime=878.25 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 93147 0 0 0 87694 131 0 0 25 0 4 0 601823834 1461125120 319034 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3512.45
Current children cumulated vsize (KiB) 1426880

[startup+942.3 s]
/proc/loadavg: 4.00 4.82 6.23 5/175 27204
/proc/meminfo: memFree=23098704/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1498388 CPUtime=3752.12 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 326498 0 0 0 374857 355 0 0 25 0 4 0 601823434 1534349312 321885 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 374597 321885 460 189 0 368946 0
[pid=27154/tid=27156] ppid=27152 vsize=1498388 CPUtime=938.13 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 102873 0 0 0 93677 136 0 0 25 0 4 0 601823834 1534349312 321885 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1498388 CPUtime=938.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38318 0 0 0 93804 25 0 0 25 0 4 0 601823834 1534349312 321885 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1498388 CPUtime=938.25 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 94496 0 0 0 93694 131 0 0 25 0 4 0 601823834 1534349312 321885 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3752.12
Current children cumulated vsize (KiB) 1498388

[startup+1002.3 s]
/proc/loadavg: 4.05 4.68 6.09 5/175 27205
/proc/meminfo: memFree=23093608/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1498388 CPUtime=3991.84 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 327750 0 0 0 398829 355 0 0 25 0 4 0 601823434 1534349312 323097 33554432000 4194304 4964704 140736438332672 18446744073709551615 4627843 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 374597 323097 460 189 0 368946 0
[pid=27154/tid=27156] ppid=27152 vsize=1498388 CPUtime=998.13 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 103371 0 0 0 99677 136 0 0 25 0 4 0 601823834 1534349312 323097 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1498388 CPUtime=998.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38326 0 0 0 99804 25 0 0 25 0 4 0 601823834 1534349312 323097 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1498388 CPUtime=998.25 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 95242 0 0 0 99694 131 0 0 25 0 4 0 601823834 1534349312 323097 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3991.84
Current children cumulated vsize (KiB) 1498388

[startup+1062.3 s]
/proc/loadavg: 4.02 4.56 5.96 5/175 27207
/proc/meminfo: memFree=23090604/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1498388 CPUtime=4231.53 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 328607 0 0 0 422796 357 0 0 25 0 4 0 601823434 1534349312 323693 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 374597 323693 460 189 0 368946 0
[pid=27154/tid=27156] ppid=27152 vsize=1498388 CPUtime=1058.12 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 103827 0 0 0 105675 137 0 0 25 0 4 0 601823834 1534349312 323693 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1498388 CPUtime=1058.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38339 0 0 0 105804 25 0 0 25 0 4 0 601823834 1534349312 323693 33554432000 4194304 4964704 140736438332672 18446744073709551615 4658318 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1498388 CPUtime=1058.24 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 95624 0 0 0 105692 132 0 0 25 0 4 0 601823834 1534349312 323693 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4231.53
Current children cumulated vsize (KiB) 1498388

[startup+1122.3 s]
/proc/loadavg: 4.05 4.47 5.84 5/175 27209
/proc/meminfo: memFree=23090448/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1499168 CPUtime=4471.25 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 328818 0 0 0 446767 358 0 0 25 0 4 0 601823434 1535148032 323904 33554432000 4194304 4964704 140736438332672 18446744073709551615 4627269 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 374792 323904 460 189 0 369141 0
[pid=27154/tid=27156] ppid=27152 vsize=1499168 CPUtime=1118.12 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 104014 0 0 0 111675 137 0 0 25 0 4 0 601823834 1535148032 323904 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1499168 CPUtime=1118.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38362 0 0 0 111804 25 0 0 25 0 4 0 601823834 1535148032 323904 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1499168 CPUtime=1118.24 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 95625 0 0 0 111692 132 0 0 25 0 4 0 601823834 1535148032 323904 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4471.25
Current children cumulated vsize (KiB) 1499168

[startup+1182.3 s]
/proc/loadavg: 4.06 4.39 5.73 5/175 27210
/proc/meminfo: memFree=23078904/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1500456 CPUtime=4710.96 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 331801 0 0 0 470729 367 0 0 25 0 4 0 601823434 1536466944 326887 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 375114 326887 460 189 0 369463 0
[pid=27154/tid=27156] ppid=27152 vsize=1500456 CPUtime=1178.11 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 104438 0 0 0 117674 137 0 0 25 0 4 0 601823834 1536466944 326887 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1500456 CPUtime=1178.29 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38566 0 0 0 117804 25 0 0 25 0 4 0 601823834 1536466944 326887 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1500456 CPUtime=1178.25 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 97980 0 0 0 117684 141 0 0 25 0 4 0 601823834 1536466944 326887 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4710.96
Current children cumulated vsize (KiB) 1500456



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.6 s]
/proc/loadavg: 4.10 4.38 5.68 5/175 27211
/proc/meminfo: memFree=23076548/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1500456 CPUtime=4800.06 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 332336 0 0 0 479639 367 0 0 25 0 4 0 601823434 1536466944 327422 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27154/statm: 375114 327422 460 189 0 369463 0
[pid=27154/tid=27156] ppid=27152 vsize=1500456 CPUtime=1200.41 cores=1,3,5,7
/proc/27154/task/27156/stat : 27156 (claspmt) R 27152 27154 26610 0 -1 4202560 104442 0 0 0 119904 137 0 0 25 0 4 0 601823834 1536466944 327422 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27154/tid=27157] ppid=27152 vsize=1500456 CPUtime=1200.6 cores=1,3,5,7
/proc/27154/task/27157/stat : 27157 (claspmt) R 27152 27154 26610 0 -1 4202560 38824 0 0 0 120035 25 0 0 25 0 4 0 601823834 1536466944 327422 33554432000 4194304 4964704 140736438332672 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27154/tid=27158] ppid=27152 vsize=1500456 CPUtime=1200.55 cores=1,3,5,7
/proc/27154/task/27158/stat : 27158 (claspmt) R 27152 27154 26610 0 -1 4202560 98253 0 0 0 119914 141 0 0 25 0 4 0 601823834 1536466944 327422 33554432000 4194304 4964704 140736438332672 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 1500456

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.71 s]
/proc/loadavg: 4.10 4.38 5.68 5/175 27211
/proc/meminfo: memFree=23076548/32951124 swapFree=67102140/67111528
[pid=27154] ppid=27152 vsize=1500148 CPUtime=4800.18 cores=1,3,5,7
/proc/27154/stat : 27154 (claspmt) R 27152 27154 26610 0 -1 4202496 332346 0 0 0 479651 367 0 0 25 0 1 0 601823434 1536151552 326430 33554432000 4194304 4964704 140736438332672 18446744073709551615 216734834843 0 0 4096 18946 0 0 0 17 7 0 0 0
/proc/27154/statm: 375037 326430 470 189 0 369386 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 1500148

Child status: 0
Real time (s): 1204.78
CPU time (s): 4800.26
CPU user time (s): 4796.53
CPU system time (s): 3.73343
CPU usage (%): 398.435
Max. virtual memory (cumulated for all children) (KiB): 1500456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.53
system time used= 3.73343
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 332348
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11676
involuntary context switches= 33227

runsolver used 1.69474 second user time and 4.37933 second system time

The end

Launcher Data 

Begin job on node119 at 2011-04-30 00:25:28
IDJOB=3299386
IDBENCH=88226
IDSOLVER=1683
FILE ID=node119/3299386-1304115927
RUNJOBID= node119-1304114722-27038
PBS_JOBID= 13170679
Free space on /tmp= 71808 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m52-q1041.25-n50-p15-s99099953.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299386-1304115927/watcher-3299386-1304115927 -o /tmp/evaluation-result-3299386-1304115927/solver-3299386-1304115927 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299386-1304115927.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dda220d08783aabf4e7a9e99eeeccae6
RANDOM SEED=347697830

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23481980 kB
Buffers:       1912612 kB
Cached:        6033804 kB
SwapCached:       3688 kB
Active:        1070448 kB
Inactive:      7835772 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23481980 kB
SwapTotal:    67111528 kB
SwapFree:     67102140 kB
Dirty:            7036 kB
Writeback:           0 kB
AnonPages:      958936 kB
Mapped:          15532 kB
Slab:           498908 kB
PageTables:       6576 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1133996 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71808 MiB
End job on node119 at 2011-04-30 00:45:34