Trace number 3322394

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40001 5013.23

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-13x32.cnf
MD5SUM73c8ae5bbdfe41463e8e40ea211c5e14
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1664
Number of clauses157664
Sum of the clauses size625664
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22496
Number of clauses of size 30
Number of clauses of size 4155168
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...382616/instance-3322394-1304382616.cnf
6.19/6.24	c Solving...
40000.23/5012.51	
40000.23/5012.51	*** INTERRUPTED! ***
40000.23/5012.51	*** Shutting down threads...
40000.98/5013.22	s UNKNOWN
40000.98/5013.22	
40000.98/5013.22	c INTERRUPTED   : 1
40000.98/5013.22	c Models        : 0+    
40000.98/5013.22	c Time          : 5012.516s (Solving: 5006.27s 1st Model: 0.00s Unsat: 0.00s)
40000.98/5013.22	c CPU Time      : 40000.300s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322394-1304382616/watcher-3322394-1304382616 -o /tmp/evaluation-result-3322394-1304382616/solver-3322394-1304382616 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322394-1304382616.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 9.06 8.68 1/297 2336
/proc/meminfo: memFree=12033332/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=21908 CPUtime=0 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 790 0 0 0 0 0 0 0 22 0 1 0 549859486 22433792 707 33554432000 4194304 4964704 140733728740256 18446744073709551615 255377301248 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 5477 708 386 189 0 351 0

[startup+0.033862 s]
/proc/loadavg: 8.06 9.06 8.68 1/297 2336
/proc/meminfo: memFree=12033332/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=26940 CPUtime=0.03 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 2428 0 0 0 3 0 0 0 22 0 1 0 549859486 27586560 1872 33554432000 4194304 4964704 140733728740256 18446744073709551615 255376962245 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 6735 1874 386 189 0 1609 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 26940

[startup+0.100852 s]
/proc/loadavg: 8.06 9.06 8.68 1/297 2336
/proc/meminfo: memFree=12033332/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=35444 CPUtime=0.09 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 4780 0 0 0 9 0 0 0 22 0 1 0 549859486 36294656 3937 33554432000 4194304 4964704 140733728740256 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 8861 3937 399 189 0 3735 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 35444

[startup+0.300812 s]
/proc/loadavg: 8.06 9.06 8.68 1/297 2336
/proc/meminfo: memFree=12033332/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=35444 CPUtime=0.29 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 4780 0 0 0 29 0 0 0 23 0 1 0 549859486 36294656 3937 33554432000 4194304 4964704 140733728740256 18446744073709551615 4607585 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 8861 3937 399 189 0 3735 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 35444

[startup+0.700736 s]
/proc/loadavg: 8.06 9.06 8.68 1/297 2336
/proc/meminfo: memFree=12033332/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=35444 CPUtime=0.69 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 4780 0 0 0 69 0 0 0 25 0 1 0 549859486 36294656 3937 33554432000 4194304 4964704 140733728740256 18446744073709551615 4607477 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 8861 3937 399 189 0 3735 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 35444

[startup+1.50059 s]
/proc/loadavg: 8.06 9.06 8.68 2/298 2337
/proc/meminfo: memFree=12018700/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=38612 CPUtime=1.49 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 5578 0 0 0 149 0 0 0 25 0 1 0 549859486 39538688 4735 33554432000 4194304 4964704 140733728740256 18446744073709551615 4600366 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 9653 4735 400 189 0 4527 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 38612

[startup+3.10031 s]
/proc/loadavg: 8.06 9.06 8.68 2/298 2337
/proc/meminfo: memFree=12013208/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=44556 CPUtime=3.09 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 7082 0 0 0 309 0 0 0 25 0 1 0 549859486 45625344 6239 33554432000 4194304 4964704 140733728740256 18446744073709551615 4600389 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/2336/statm: 11139 6239 400 189 0 6013 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 44556

[startup+6.30075 s]
/proc/loadavg: 7.50 8.93 8.64 2/298 2337
/proc/meminfo: memFree=12007404/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=420676 CPUtime=6.35 cores=0-7
/proc/2336/stat : 2336 (claspmt) S 2334 2336 342 0 -1 4202496 17963 0 0 0 630 5 0 0 25 0 8 0 549859486 430772224 16747 33554432000 4194304 4964704 140733728740256 18446744073709551615 255389117337 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2336/statm: 105169 16763 433 189 0 99518 0
Current children cumulated CPU time (s) 6.35
Current children cumulated vsize (KiB) 420676

[startup+12.7005 s]
/proc/loadavg: 7.54 8.91 8.64 9/305 2344
/proc/meminfo: memFree=11805656/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=439508 CPUtime=57.02 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 59938 0 0 0 5672 30 0 0 25 0 8 0 549859486 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/2336/statm: 109877 58721 466 189 0 104226 0
[pid=2336/tid=2338] ppid=2334 vsize=439508 CPUtime=6.35 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 6034 0 0 0 631 4 0 0 20 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4647541 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=439508 CPUtime=6.37 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 6452 0 0 0 634 3 0 0 25 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4361321 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=439508 CPUtime=6.32 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 5741 0 0 0 629 3 0 0 22 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=439508 CPUtime=6.34 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 6783 0 0 0 631 3 0 0 25 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=439508 CPUtime=6.4 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 6437 0 0 0 637 3 0 0 25 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=439508 CPUtime=6.34 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 6046 0 0 0 631 3 0 0 25 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=439508 CPUtime=6.35 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 7864 0 0 0 631 4 0 0 25 0 8 0 549860111 450056192 58721 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 57.02
Current children cumulated vsize (KiB) 439508

[startup+25.5011 s]
/proc/loadavg: 7.64 8.87 8.63 9/305 2344
/proc/meminfo: memFree=11715192/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=519576 CPUtime=159.24 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 83794 0 0 0 15876 48 0 0 25 0 8 0 549859486 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4684024 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/2336/statm: 129894 82574 466 189 0 124243 0
[pid=2336/tid=2338] ppid=2334 vsize=519576 CPUtime=19.04 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 9082 0 0 0 1897 7 0 0 25 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=519576 CPUtime=19.17 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 9971 0 0 0 1910 7 0 0 25 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=519576 CPUtime=19.11 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 8903 0 0 0 1905 6 0 0 24 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=519576 CPUtime=19.14 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 9853 0 0 0 1909 5 0 0 25 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=519576 CPUtime=19.2 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 9161 0 0 0 1916 4 0 0 25 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=519576 CPUtime=19.13 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 8386 0 0 0 1908 5 0 0 25 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=519576 CPUtime=19.14 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 10955 0 0 0 1908 6 0 0 25 0 8 0 549860111 532045824 82574 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 159.24
Current children cumulated vsize (KiB) 519576

[startup+51.1004 s]
/proc/loadavg: 7.83 8.81 8.62 9/305 2345
/proc/meminfo: memFree=11599788/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=598768 CPUtime=363.74 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 114525 0 0 0 36303 71 0 0 25 0 8 0 549859486 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/2336/statm: 149692 113244 466 189 0 144041 0
[pid=2336/tid=2338] ppid=2334 vsize=598768 CPUtime=44.37 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 13896 0 0 0 4427 10 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4334301 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=598768 CPUtime=44.75 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 14077 0 0 0 4465 10 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4660043 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=598768 CPUtime=44.71 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 12709 0 0 0 4462 9 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=598768 CPUtime=44.73 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 13145 0 0 0 4466 7 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=598768 CPUtime=44.79 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 12276 0 0 0 4473 6 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=598768 CPUtime=44.73 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 11503 0 0 0 4466 7 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=598768 CPUtime=44.72 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 16518 0 0 0 4462 10 0 0 25 0 8 0 549860111 613138432 113244 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320947 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 363.74
Current children cumulated vsize (KiB) 598768

[startup+102.312 s]
/proc/loadavg: 7.92 8.69 8.58 9/305 2347
/proc/meminfo: memFree=11386028/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=954608 CPUtime=772.8 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 165744 0 0 0 77167 113 0 0 20 0 8 0 549859486 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320939 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/2336/statm: 238652 163567 466 189 0 233001 0
[pid=2336/tid=2338] ppid=2334 vsize=954608 CPUtime=95.03 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 21776 0 0 0 9486 17 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=954608 CPUtime=95.95 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 19478 0 0 0 9580 15 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=954608 CPUtime=95.91 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 16771 0 0 0 9578 13 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=954608 CPUtime=95.93 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 19213 0 0 0 9582 11 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=954608 CPUtime=96 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 17660 0 0 0 9590 10 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=954608 CPUtime=95.93 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 15738 0 0 0 9582 11 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=954608 CPUtime=95.92 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 25020 0 0 0 9575 17 0 0 25 0 8 0 549860111 977518592 163567 33554432000 4194304 4964704 140733728740256 18446744073709551615 4365094 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 772.8
Current children cumulated vsize (KiB) 954608

[startup+162.301 s]
/proc/loadavg: 8.15 8.62 8.56 9/305 2348
/proc/meminfo: memFree=11292528/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=965804 CPUtime=1252.05 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 189517 0 0 0 125069 136 0 0 25 0 8 0 549859486 988983296 187330 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/2336/statm: 241451 187330 466 189 0 235800 0
[pid=2336/tid=2338] ppid=2334 vsize=965804 CPUtime=154.43 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 24134 0 0 0 15423 20 0 0 25 0 8 0 549860111 988983296 187330 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=965804 CPUtime=155.94 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 23382 0 0 0 15575 19 0 0 25 0 8 0 549860111 988983296 187330 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=965804 CPUtime=155.89 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 19210 0 0 0 15573 16 0 0 25 0 8 0 549860111 988983296 187330 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=965804 CPUtime=155.92 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 21099 0 0 0 15579 13 0 0 25 0 8 0 549860111 988983296 187330 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=965804 CPUtime=155.97 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 20811 0 0 0 15585 12 0 0 25 0 8 0 549860111 988983296 187330 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=965804 CPUtime=155.9 cores=0-7

################
# More data... #
################

[pid=2336] ppid=2334 vsize=2455028 CPUtime=37681.8 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 567942 0 0 0 3767466 711 0 0 25 0 8 0 549859486 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/2336/statm: 613757 552483 466 189 0 608106 0
[pid=2336/tid=2338] ppid=2334 vsize=2455028 CPUtime=4699.34 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 64607 0 0 0 469846 88 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=2455028 CPUtime=4710.58 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 67714 0 0 0 470968 90 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=2455028 CPUtime=4715.62 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 48836 0 0 0 471494 68 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=2455028 CPUtime=4709.49 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 54219 0 0 0 470895 54 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=2455028 CPUtime=4700.18 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 46895 0 0 0 469967 51 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=2455028 CPUtime=4715.45 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 64248 0 0 0 471459 86 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=2455028 CPUtime=4714.84 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 100497 0 0 0 471371 113 0 0 25 0 8 0 549860111 2513948672 552483 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37681.8
Current children cumulated vsize (KiB) 2455028

[startup+4782.3 s]
/proc/loadavg: 8.17 8.19 8.16 9/305 2494
/proc/meminfo: memFree=9827840/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2455028 CPUtime=38161 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 568239 0 0 0 3815384 717 0 0 25 0 8 0 549859486 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/2336/statm: 613757 552673 466 189 0 608106 0
[pid=2336/tid=2338] ppid=2334 vsize=2455028 CPUtime=4758.75 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 64696 0 0 0 475786 89 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=2455028 CPUtime=4770.55 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 67716 0 0 0 476964 91 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=2455028 CPUtime=4775.6 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 48838 0 0 0 477491 69 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=2455028 CPUtime=4769.48 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 54219 0 0 0 476894 54 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=2455028 CPUtime=4760.13 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 47095 0 0 0 475960 53 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=2455028 CPUtime=4775.44 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 64248 0 0 0 477457 87 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=2455028 CPUtime=4774.82 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 100501 0 0 0 477368 114 0 0 25 0 8 0 549860111 2513948672 552673 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38161
Current children cumulated vsize (KiB) 2455028

[startup+4842.3 s]
/proc/loadavg: 8.13 8.17 8.15 10/305 2497
/proc/meminfo: memFree=9824596/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2455028 CPUtime=38640.4 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 569372 0 0 0 3863322 717 0 0 25 0 8 0 549859486 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/2336/statm: 613757 553526 466 189 0 608106 0
[pid=2336/tid=2338] ppid=2334 vsize=2455028 CPUtime=4818.14 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 65232 0 0 0 481725 89 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=2455028 CPUtime=4830.55 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 67716 0 0 0 482964 91 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=2455028 CPUtime=4835.61 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 48838 0 0 0 483492 69 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=2455028 CPUtime=4829.49 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 54746 0 0 0 482894 55 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=2455028 CPUtime=4820.14 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 47095 0 0 0 481961 53 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=2455028 CPUtime=4835.44 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 64263 0 0 0 483457 87 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=2455028 CPUtime=4834.8 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 100555 0 0 0 483366 114 0 0 25 0 8 0 549860111 2513948672 553526 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38640.4
Current children cumulated vsize (KiB) 2455028

[startup+4902.3 s]
/proc/loadavg: 8.13 8.17 8.15 9/305 2499
/proc/meminfo: memFree=9822844/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2455028 CPUtime=39119.7 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 569885 0 0 0 3911251 721 0 0 25 0 8 0 549859486 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/2336/statm: 613757 554024 466 189 0 608106 0
[pid=2336/tid=2338] ppid=2334 vsize=2455028 CPUtime=4877.55 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 65236 0 0 0 487666 89 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=2455028 CPUtime=4890.54 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 67719 0 0 0 488963 91 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=2455028 CPUtime=4895.6 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 48859 0 0 0 489491 69 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=2455028 CPUtime=4889.45 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 54878 0 0 0 488890 55 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=2455028 CPUtime=4880.14 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 47263 0 0 0 487961 53 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=2455028 CPUtime=4895.44 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 64314 0 0 0 489456 88 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=2455028 CPUtime=4894.79 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 100655 0 0 0 489365 114 0 0 25 0 8 0 549860111 2513948672 554024 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39119.7
Current children cumulated vsize (KiB) 2455028

[startup+4962.3 s]
/proc/loadavg: 8.12 8.15 8.14 10/305 2500
/proc/meminfo: memFree=9818740/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2455028 CPUtime=39599.1 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 570900 0 0 0 3959188 722 0 0 25 0 8 0 549859486 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4321016 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/2336/statm: 613757 555039 466 189 0 608106 0
[pid=2336/tid=2338] ppid=2334 vsize=2455028 CPUtime=4936.95 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 65284 0 0 0 493606 89 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=2455028 CPUtime=4950.54 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 67925 0 0 0 494963 91 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=2455028 CPUtime=4955.59 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 48927 0 0 0 495490 69 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=2455028 CPUtime=4949.45 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 55132 0 0 0 494890 55 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=2455028 CPUtime=4940.14 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 47459 0 0 0 493961 53 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=2455028 CPUtime=4955.43 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 64465 0 0 0 495455 88 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=2455028 CPUtime=4954.77 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 100708 0 0 0 495363 114 0 0 25 0 8 0 549860111 2513948672 555039 33554432000 4194304 4964704 140733728740256 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39599.1
Current children cumulated vsize (KiB) 2455028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.5 s]
/proc/loadavg: 8.14 8.15 8.14 9/305 2502
/proc/meminfo: memFree=9815992/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2455028 CPUtime=40000.2 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 571529 0 0 0 3999300 723 0 0 25 0 8 0 549859486 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/2336/statm: 613757 555668 466 189 0 608106 0
[pid=2336/tid=2338] ppid=2334 vsize=2455028 CPUtime=4986.65 cores=0-7
/proc/2336/task/2338/stat : 2338 (claspmt) R 2334 2336 342 0 -1 4202560 65286 0 0 0 498576 89 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2336/tid=2339] ppid=2334 vsize=2455028 CPUtime=5000.74 cores=0-7
/proc/2336/task/2339/stat : 2339 (claspmt) R 2334 2336 342 0 -1 4202560 67926 0 0 0 499983 91 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4320849 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2336/tid=2340] ppid=2334 vsize=2455028 CPUtime=5005.8 cores=0-7
/proc/2336/task/2340/stat : 2340 (claspmt) R 2334 2336 342 0 -1 4202560 48988 0 0 0 500510 70 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2336/tid=2341] ppid=2334 vsize=2455028 CPUtime=4999.66 cores=0-7
/proc/2336/task/2341/stat : 2341 (claspmt) R 2334 2336 342 0 -1 4202560 55503 0 0 0 499911 55 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2336/tid=2342] ppid=2334 vsize=2455028 CPUtime=4990.35 cores=0-7
/proc/2336/task/2342/stat : 2342 (claspmt) R 2334 2336 342 0 -1 4202560 47475 0 0 0 498982 53 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2336/tid=2343] ppid=2334 vsize=2455028 CPUtime=5005.64 cores=0-7
/proc/2336/task/2343/stat : 2343 (claspmt) R 2334 2336 342 0 -1 4202560 64562 0 0 0 500476 88 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4321116 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2336/tid=2344] ppid=2334 vsize=2455028 CPUtime=5004.97 cores=0-7
/proc/2336/task/2344/stat : 2344 (claspmt) R 2334 2336 342 0 -1 4202560 100709 0 0 0 500383 114 0 0 25 0 8 0 549860111 2513948672 555668 33554432000 4194304 4964704 140733728740256 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 2455028

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.62 s]
/proc/loadavg: 8.14 8.15 8.14 2/299 2503
/proc/meminfo: memFree=9816040/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2454816 CPUtime=40000.4 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 571539 0 0 0 3999318 723 0 0 25 0 1 0 549859486 2513731584 555477 33554432000 4194304 4964704 140733728740256 18446744073709551615 255376958442 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/2336/statm: 613704 555477 476 189 0 608053 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 2454816

[startup+5013 s]
/proc/loadavg: 8.14 8.15 8.14 2/299 2503
/proc/meminfo: memFree=9816040/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=2438400 CPUtime=40000.8 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 571539 0 0 0 3999355 723 0 0 25 0 1 0 549859486 2496921600 551795 33554432000 4194304 4964704 140733728740256 18446744073709551615 255376956769 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/2336/statm: 609600 551795 476 189 0 603949 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 2438400

[startup+5013.2 s]
/proc/loadavg: 8.14 8.15 8.14 2/299 2503
/proc/meminfo: memFree=9816040/32951124 swapFree=67111352/67111528
[pid=2336] ppid=2334 vsize=939408 CPUtime=40001 cores=0-7
/proc/2336/stat : 2336 (claspmt) R 2334 2336 342 0 -1 4202496 571539 0 0 0 3999368 730 0 0 25 0 1 0 549859486 961953792 132791 33554432000 4194304 4964704 140733728740256 18446744073709551615 255377344647 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/2336/statm: 234852 132791 476 189 0 229201 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 939408

Child status: 0
Real time (s): 5013.23
CPU time (s): 40001
CPU user time (s): 39993.7
CPU system time (s): 7.33088
CPU usage (%): 797.909
Max. virtual memory (cumulated for all children) (KiB): 2455028

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.7
system time used= 7.33089
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 571540
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 247360
involuntary context switches= 394329

runsolver used 13.8599 second user time and 36.2315 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-03 02:30:16
IDJOB=3322394
IDBENCH=83159
IDSOLVER=1711
FILE ID=node135/3322394-1304382616
RUNJOBID= node135-1304366465-356
PBS_JOBID= 13181737
Free space on /tmp= 72888 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-13x32.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322394-1304382616/watcher-3322394-1304382616 -o /tmp/evaluation-result-3322394-1304382616/solver-3322394-1304382616 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322394-1304382616.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 73c8ae5bbdfe41463e8e40ea211c5e14
RANDOM SEED=1636694239

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12033612 kB
Buffers:       1004656 kB
Cached:        3892164 kB
SwapCached:        172 kB
Active:       16146492 kB
Inactive:      4182780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12033612 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:            4384 kB
Writeback:           0 kB
AnonPages:    15432316 kB
Mapped:          23804 kB
Slab:           473136 kB
PageTables:      47040 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 57062444 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72888 MiB
End job on node135 at 2011-05-03 03:53:51