Trace number 3299948

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.46 1203.01

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
MD5SUMa0ec1baa890da62d0c6df7f1e62c6af3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3057.55
Satisfiable
(Un)Satisfiability was proved
Number of variables163622
Number of clauses488120
Sum of the clauses size1138944
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2325412
Number of clauses of size 3162706
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...066742/instance-3299948-1304066742.cnf
1.29/1.38	c Solving...
4800.13/1202.71	
4800.13/1202.71	*** INTERRUPTED! ***
4800.13/1202.71	*** Shutting down threads...
4800.44/1203.01	s UNKNOWN
4800.44/1203.01	
4800.44/1203.01	c INTERRUPTED   : 1
4800.44/1203.01	c Models        : 0+    
4800.44/1203.01	c Time          : 1202.713s (Solving: 1201.33s 1st Model: 0.00s Unsat: 0.00s)
4800.44/1203.01	c CPU Time      : 4800.150s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299948-1304066742/watcher-3299948-1304066742 -o /tmp/evaluation-result-3299948-1304066742/solver-3299948-1304066742 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299948-1304066742.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.10 8.00 1/175 31118
/proc/meminfo: memFree=28683052/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=41652 CPUtime=0 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 1122 0 0 0 0 0 0 0 24 0 1 0 518274972 42651648 1052 33554432000 4194304 4964704 140735457708160 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/31118/statm: 10413 1059 375 189 0 5287 0

[startup+0.075736 s]
/proc/loadavg: 8.10 8.10 8.00 1/175 31118
/proc/meminfo: memFree=28683052/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=61136 CPUtime=0.07 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 12381 0 0 0 6 1 0 0 24 0 1 0 518274972 62603264 10288 33554432000 4194304 4964704 140735457708160 18446744073709551615 222921437893 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/31118/statm: 15284 10291 385 189 0 10158 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 61136

[startup+0.100728 s]
/proc/loadavg: 8.10 8.10 8.00 1/175 31118
/proc/meminfo: memFree=28683052/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=65376 CPUtime=0.09 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 13810 0 0 0 8 1 0 0 24 0 1 0 518274972 66945024 11311 33554432000 4194304 4964704 140735457708160 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/31118/statm: 16344 11313 385 189 0 11218 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 65376

[startup+0.300698 s]
/proc/loadavg: 8.10 8.10 8.00 1/175 31118
/proc/meminfo: memFree=28683052/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=101948 CPUtime=0.29 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 25476 0 0 0 27 2 0 0 25 0 1 0 518274972 104394752 19820 33554432000 4194304 4964704 140735457708160 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/31118/statm: 25487 19820 402 189 0 20361 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 101948

[startup+0.700624 s]
/proc/loadavg: 8.10 8.10 8.00 1/175 31118
/proc/meminfo: memFree=28683052/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=111980 CPUtime=0.69 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 28017 0 0 0 66 3 0 0 25 0 1 0 518274972 114667520 22361 33554432000 4194304 4964704 140735457708160 18446744073709551615 222921437893 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/31118/statm: 27995 22361 403 189 0 22869 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 111980

[startup+1.50044 s]
/proc/loadavg: 7.53 7.98 7.97 2/176 31119
/proc/meminfo: memFree=28589928/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=355756 CPUtime=1.78 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 48754 0 0 0 172 6 0 0 25 0 4 0 518274972 364294144 36494 33554432000 4194304 4964704 140735457708160 18446744073709551615 4370236 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 88939 36494 450 189 0 83288 0
Current children cumulated CPU time (s) 1.78
Current children cumulated vsize (KiB) 355756

[startup+3.10115 s]
/proc/loadavg: 7.53 7.98 7.97 6/181 31149
/proc/meminfo: memFree=28492164/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=355756 CPUtime=8.17 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 49415 0 0 0 810 7 0 0 25 0 4 0 518274972 364294144 37155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 88939 37155 458 189 0 83288 0
[pid=31118/tid=31137] ppid=31116 vsize=355756 CPUtime=1.69 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 5235 0 0 0 169 0 0 0 25 0 4 0 518275111 364294144 37155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=355756 CPUtime=1.7 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 6142 0 0 0 169 1 0 0 25 0 4 0 518275111 364294144 37155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=355756 CPUtime=1.7 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 7282 0 0 0 169 1 0 0 20 0 4 0 518275111 364294144 37155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668657 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.17
Current children cumulated vsize (KiB) 355756

[startup+6.30057 s]
/proc/loadavg: 7.53 7.98 7.97 9/184 31152
/proc/meminfo: memFree=28444172/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=355756 CPUtime=20.96 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 50119 0 0 0 2087 9 0 0 25 0 4 0 518274972 364294144 37859 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668907 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 88939 37859 458 189 0 83288 0
[pid=31118/tid=31137] ppid=31116 vsize=355756 CPUtime=4.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 5412 0 0 0 489 1 0 0 25 0 4 0 518275111 364294144 37859 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=355756 CPUtime=4.9 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 6143 0 0 0 489 1 0 0 25 0 4 0 518275111 364294144 37859 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669200 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=355756 CPUtime=4.88 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 7648 0 0 0 486 2 0 0 25 0 4 0 518275111 364294144 37859 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 20.96
Current children cumulated vsize (KiB) 355756

[startup+12.7004 s]
/proc/loadavg: 7.67 7.99 7.97 9/184 31152
/proc/meminfo: memFree=28427612/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=355756 CPUtime=46.52 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 51648 0 0 0 4642 10 0 0 25 0 4 0 518274972 364294144 39388 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 88939 39388 458 189 0 83288 0
[pid=31118/tid=31137] ppid=31116 vsize=355756 CPUtime=11.3 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 5526 0 0 0 1129 1 0 0 25 0 4 0 518275111 364294144 39388 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668714 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=355756 CPUtime=11.3 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 6908 0 0 0 1128 2 0 0 25 0 4 0 518275111 364294144 39388 33554432000 4194304 4964704 140735457708160 18446744073709551615 4362958 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=355756 CPUtime=11.25 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 8154 0 0 0 1123 2 0 0 25 0 4 0 518275111 364294144 39388 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 46.52
Current children cumulated vsize (KiB) 355756

[startup+25.5011 s]
/proc/loadavg: 7.72 7.99 7.97 9/184 31153
/proc/meminfo: memFree=28394272/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=358924 CPUtime=97.65 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 54921 0 0 0 9751 14 0 0 25 0 4 0 518274972 367538176 42661 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 89731 42661 460 189 0 84080 0
[pid=31118/tid=31137] ppid=31116 vsize=358924 CPUtime=24.09 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 5764 0 0 0 2408 1 0 0 25 0 4 0 518275111 367538176 42661 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668657 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=358924 CPUtime=24.1 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 8580 0 0 0 2406 4 0 0 25 0 4 0 518275111 367538176 42661 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=358924 CPUtime=23.97 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 9211 0 0 0 2394 3 0 0 25 0 4 0 518275111 367538176 42661 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670067 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 97.65
Current children cumulated vsize (KiB) 358924

[startup+51.1004 s]
/proc/loadavg: 7.83 7.99 7.97 9/184 31153
/proc/meminfo: memFree=28330108/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=361432 CPUtime=199.91 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 60542 0 0 0 19967 24 0 0 25 0 4 0 518274972 370106368 48282 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 90358 48282 460 189 0 84707 0
[pid=31118/tid=31137] ppid=31116 vsize=361432 CPUtime=49.7 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 6099 0 0 0 4968 2 0 0 25 0 4 0 518275111 370106368 48282 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=361432 CPUtime=49.7 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 12357 0 0 0 4959 11 0 0 25 0 4 0 518275111 370106368 48282 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668697 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=361432 CPUtime=49.43 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 10404 0 0 0 4938 5 0 0 25 0 4 0 518275111 370106368 48282 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668505 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 199.91
Current children cumulated vsize (KiB) 361432

[startup+102.307 s]
/proc/loadavg: 7.97 8.01 7.98 9/184 31155
/proc/meminfo: memFree=28137756/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=367660 CPUtime=404.45 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 74940 0 0 0 40402 43 0 0 25 0 4 0 518274972 376483840 62680 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668693 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 91915 62680 460 189 0 86264 0
[pid=31118/tid=31137] ppid=31116 vsize=367660 CPUtime=100.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 8124 0 0 0 10085 5 0 0 25 0 4 0 518275111 376483840 62680 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=367660 CPUtime=100.91 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 18998 0 0 0 10071 20 0 0 25 0 4 0 518275111 376483840 62680 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=367660 CPUtime=100.36 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 13943 0 0 0 10026 10 0 0 25 0 4 0 518275111 376483840 62680 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 404.45
Current children cumulated vsize (KiB) 367660

[startup+162.301 s]
/proc/loadavg: 8.02 8.02 7.98 9/184 31156
/proc/meminfo: memFree=28028224/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=384916 CPUtime=644.12 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 85939 0 0 0 64356 56 0 0 25 0 4 0 518274972 394153984 73679 33554432000 4194304 4964704 140735457708160 18446744073709551615 4362204 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 96229 73679 460 189 0 90578 0
[pid=31118/tid=31137] ppid=31116 vsize=384916 CPUtime=160.89 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 9166 0 0 0 16083 6 0 0 25 0 4 0 518275111 394153984 73679 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=384916 CPUtime=160.9 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 23829 0 0 0 16066 24 0 0 25 0 4 0 518275111 394153984 73679 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=384916 CPUtime=160.03 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 17841 0 0 0 15987 16 0 0 25 0 4 0 518275111 394153984 73679 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 644.12
Current children cumulated vsize (KiB) 384916

[startup+222.301 s]
/proc/loadavg: 8.09 8.04 7.99 9/184 31158
/proc/meminfo: memFree=27895380/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=466444 CPUtime=883.79 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 98338 0 0 0 88308 71 0 0 25 0 4 0 518274972 477638656 86073 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 116611 86074 460 189 0 110960 0
[pid=31118/tid=31137] ppid=31116 vsize=466444 CPUtime=220.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 10240 0 0 0 22082 8 0 0 25 0 4 0 518275111 477638656 86074 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669200 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=466444 CPUtime=220.91 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 29165 0 0 0 22061 30 0 0 25 0 4 0 518275111 477638656 86074 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=466444 CPUtime=219.71 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 22372 0 0 0 21949 22 0 0 25 0 4 0 518275111 477638656 86074 33554432000 4194304 4964704 140735457708160 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 883.79
Current children cumulated vsize (KiB) 466444

[startup+282.301 s]
/proc/loadavg: 8.18 8.07 8.01 9/184 31160
/proc/meminfo: memFree=27748880/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=478500 CPUtime=1123.48 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 107446 0 0 0 112267 81 0 0 25 0 4 0 518274972 489984000 95161 33554432000 4194304 4964704 140735457708160 18446744073709551615 4683929 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 119625 95161 460 189 0 113974 0
[pid=31118/tid=31137] ppid=31116 vsize=478500 CPUtime=280.9 cores=1,3,5,7

################
# More data... #
################

Current children cumulated CPU time (s) 2561.55
Current children cumulated vsize (KiB) 782436

[startup+702.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/184 31171
/proc/meminfo: memFree=26877748/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=782436 CPUtime=2801.22 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 179327 0 0 0 279943 179 0 0 25 0 4 0 518274972 801214464 166845 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 195609 166845 460 189 0 189958 0
[pid=31118/tid=31137] ppid=31116 vsize=782436 CPUtime=700.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 23316 0 0 0 70065 25 0 0 25 0 4 0 518275111 801214464 166845 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=782436 CPUtime=700.92 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 67561 0 0 0 70006 86 0 0 25 0 4 0 518275111 801214464 166845 33554432000 4194304 4964704 140735457708160 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=782436 CPUtime=697.1 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 45690 0 0 0 69659 51 0 0 25 0 4 0 518275111 801214464 166845 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2801.22
Current children cumulated vsize (KiB) 782436

[startup+762.306 s]
/proc/loadavg: 8.06 8.05 8.00 9/184 31172
/proc/meminfo: memFree=26839272/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=784160 CPUtime=3040.9 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 181813 0 0 0 303908 182 0 0 25 0 4 0 518274972 802979840 169331 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 196040 169331 460 189 0 190389 0
[pid=31118/tid=31137] ppid=31116 vsize=784160 CPUtime=760.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 23981 0 0 0 76064 26 0 0 25 0 4 0 518275111 802979840 169331 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=784160 CPUtime=760.93 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 68668 0 0 0 76005 88 0 0 25 0 4 0 518275111 802979840 169331 33554432000 4194304 4964704 140735457708160 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=784160 CPUtime=756.78 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 46404 0 0 0 75626 52 0 0 25 0 4 0 518275111 802979840 169331 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669333 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3040.9
Current children cumulated vsize (KiB) 784160

[startup+822.3 s]
/proc/loadavg: 8.12 8.07 8.01 9/184 31174
/proc/meminfo: memFree=26783556/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=784160 CPUtime=3280.57 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 182125 0 0 0 327874 183 0 0 25 0 4 0 518274972 802979840 169643 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 196040 169643 460 189 0 190389 0
[pid=31118/tid=31137] ppid=31116 vsize=784160 CPUtime=820.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 24278 0 0 0 82063 27 0 0 25 0 4 0 518275111 802979840 169643 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=784160 CPUtime=820.92 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 68675 0 0 0 82004 88 0 0 25 0 4 0 518275111 802979840 169643 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=784160 CPUtime=816.45 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 46412 0 0 0 81593 52 0 0 25 0 4 0 518275111 802979840 169643 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3280.57
Current children cumulated vsize (KiB) 784160

[startup+882.3 s]
/proc/loadavg: 8.14 8.08 8.01 9/184 31176
/proc/meminfo: memFree=26738112/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=784160 CPUtime=3520.24 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 182343 0 0 0 351841 183 0 0 25 0 4 0 518274972 802979840 169861 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 196040 169861 460 189 0 190389 0
[pid=31118/tid=31137] ppid=31116 vsize=784160 CPUtime=880.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 24278 0 0 0 88063 27 0 0 25 0 4 0 518275111 802979840 169861 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669258 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=784160 CPUtime=880.92 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 68891 0 0 0 88004 88 0 0 25 0 4 0 518275111 802979840 169861 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=784160 CPUtime=876.12 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 46414 0 0 0 87560 52 0 0 25 0 4 0 518275111 802979840 169861 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3520.24
Current children cumulated vsize (KiB) 784160

[startup+942.3 s]
/proc/loadavg: 8.13 8.09 8.02 9/184 31186
/proc/meminfo: memFree=26651028/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=849696 CPUtime=3759.9 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 187637 0 0 0 375797 193 0 0 25 0 4 0 518274972 870088704 175155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670215 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 212424 175155 460 189 0 206773 0
[pid=31118/tid=31137] ppid=31116 vsize=849696 CPUtime=940.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 24309 0 0 0 94063 27 0 0 25 0 4 0 518275111 870088704 175155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=849696 CPUtime=940.92 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 72866 0 0 0 93996 96 0 0 25 0 4 0 518275111 870088704 175155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668942 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=849696 CPUtime=935.79 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 46422 0 0 0 93527 52 0 0 25 0 4 0 518275111 870088704 175155 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668844 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3759.9
Current children cumulated vsize (KiB) 849696

[startup+1002.3 s]
/proc/loadavg: 8.09 8.09 8.02 9/184 31188
/proc/meminfo: memFree=26623472/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=849696 CPUtime=3999.58 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 194524 0 0 0 399753 205 0 0 25 0 4 0 518274972 870088704 182042 33554432000 4194304 4964704 140735457708160 18446744073709551615 4370295 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 212424 182042 460 189 0 206773 0
[pid=31118/tid=31137] ppid=31116 vsize=849696 CPUtime=1000.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 24346 0 0 0 100063 27 0 0 25 0 4 0 518275111 870088704 182042 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=849696 CPUtime=1000.92 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 79375 0 0 0 99985 107 0 0 25 0 4 0 518275111 870088704 182042 33554432000 4194304 4964704 140735457708160 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=849696 CPUtime=995.46 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 46422 0 0 0 99494 52 0 0 25 0 4 0 518275111 870088704 182042 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3999.58
Current children cumulated vsize (KiB) 849696

[startup+1062.3 s]
/proc/loadavg: 8.03 8.07 8.01 9/184 31189
/proc/meminfo: memFree=26602224/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=849696 CPUtime=4239.26 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 199901 0 0 0 423713 213 0 0 25 0 4 0 518274972 870088704 187419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 212424 187419 460 189 0 206773 0
[pid=31118/tid=31137] ppid=31116 vsize=849696 CPUtime=1060.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 24378 0 0 0 106063 27 0 0 25 0 4 0 518275111 870088704 187419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=849696 CPUtime=1060.93 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 81790 0 0 0 105982 111 0 0 25 0 4 0 518275111 870088704 187419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668714 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=849696 CPUtime=1055.14 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 49352 0 0 0 105458 56 0 0 25 0 4 0 518275111 870088704 187419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668652 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4239.26
Current children cumulated vsize (KiB) 849696

[startup+1122.3 s]
/proc/loadavg: 8.25 8.12 8.03 9/184 31194
/proc/meminfo: memFree=26596076/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=915232 CPUtime=4478.94 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 201346 0 0 0 447679 215 0 0 25 0 4 0 518274972 937197568 188864 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 228808 188864 460 189 0 223157 0
[pid=31118/tid=31137] ppid=31116 vsize=915232 CPUtime=1120.9 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 24698 0 0 0 112063 27 0 0 25 0 4 0 518275111 937197568 188864 33554432000 4194304 4964704 140735457708160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=915232 CPUtime=1120.93 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 81839 0 0 0 111982 111 0 0 25 0 4 0 518275111 937197568 188864 33554432000 4194304 4964704 140735457708160 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=915232 CPUtime=1114.81 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 50425 0 0 0 111423 58 0 0 25 0 4 0 518275111 937197568 188864 33554432000 4194304 4964704 140735457708160 18446744073709551615 4644138 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4478.94
Current children cumulated vsize (KiB) 915232

[startup+1182.3 s]
/proc/loadavg: 8.13 8.11 8.03 9/184 31196
/proc/meminfo: memFree=26555732/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=980768 CPUtime=4718.62 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 208318 0 0 0 471636 226 0 0 25 0 4 0 518274972 1004306432 195739 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669399 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 245192 195739 460 189 0 239541 0
[pid=31118/tid=31137] ppid=31116 vsize=980768 CPUtime=1180.91 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 27502 0 0 0 118060 31 0 0 25 0 4 0 518275111 1004306432 195739 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=980768 CPUtime=1180.93 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 81988 0 0 0 117982 111 0 0 25 0 4 0 518275111 1004306432 195739 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=980768 CPUtime=1174.49 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 54444 0 0 0 117384 65 0 0 25 0 4 0 518275111 1004306432 195739 33554432000 4194304 4964704 140735457708160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4718.62
Current children cumulated vsize (KiB) 980768



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.7 s]
/proc/loadavg: 8.17 8.12 8.03 9/184 31196
/proc/meminfo: memFree=26524608/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=980768 CPUtime=4800.13 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 210998 0 0 0 479782 231 0 0 25 0 4 0 518274972 1004306432 198419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4668907 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/31118/statm: 245192 198419 460 189 0 239541 0
[pid=31118/tid=31137] ppid=31116 vsize=980768 CPUtime=1201.31 cores=1,3,5,7
/proc/31118/task/31137/stat : 31137 (claspmt) R 31116 31118 30588 0 -1 4202560 27540 0 0 0 120100 31 0 0 25 0 4 0 518275111 1004306432 198419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31118/tid=31138] ppid=31116 vsize=980768 CPUtime=1201.34 cores=1,3,5,7
/proc/31118/task/31138/stat : 31138 (claspmt) R 31116 31118 30588 0 -1 4202560 84507 0 0 0 120019 115 0 0 25 0 4 0 518275111 1004306432 198419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31118/tid=31139] ppid=31116 vsize=980768 CPUtime=1194.78 cores=1,3,5,7
/proc/31118/task/31139/stat : 31139 (claspmt) R 31116 31118 30588 0 -1 4202560 54567 0 0 0 119412 66 0 0 25 0 4 0 518275111 1004306432 198419 33554432000 4194304 4964704 140735457708160 18446744073709551615 4669333 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 980768

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203 s]
/proc/loadavg: 8.17 8.12 8.03 9/184 31196
/proc/meminfo: memFree=26524608/32951124 swapFree=67111356/67111528
[pid=31118] ppid=31116 vsize=478384 CPUtime=4800.44 cores=1,3,5,7
/proc/31118/stat : 31118 (claspmt) R 31116 31118 30588 0 -1 4202496 211010 0 0 0 479811 233 0 0 25 0 1 0 518274972 489865216 75093 33554432000 4194304 4964704 140735457708160 18446744073709551615 222921820295 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/31118/statm: 119596 75080 471 189 0 113945 0
Current children cumulated CPU time (s) 4800.44
Current children cumulated vsize (KiB) 478384

Child status: 0
Real time (s): 1203.01
CPU time (s): 4800.46
CPU user time (s): 4798.11
CPU system time (s): 2.34864
CPU usage (%): 399.036
Max. virtual memory (cumulated for all children) (KiB): 980768

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.11
system time used= 2.34864
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 211011
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1929
involuntary context switches= 31233

runsolver used 1.76873 second user time and 4.80227 second system time

The end

Launcher Data 

Begin job on node109 at 2011-04-29 10:45:42
IDJOB=3299948
IDBENCH=82468
IDSOLVER=1683
FILE ID=node109/3299948-1304066742
RUNJOBID= node109-1304064292-30607
PBS_JOBID= 13170459
Free space on /tmp= 72372 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299948-1304066742/watcher-3299948-1304066742 -o /tmp/evaluation-result-3299948-1304066742/solver-3299948-1304066742 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299948-1304066742.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a0ec1baa890da62d0c6df7f1e62c6af3
RANDOM SEED=1519367047

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28683208 kB
Buffers:        889064 kB
Cached:        2882224 kB
SwapCached:        168 kB
Active:         867756 kB
Inactive:      2974316 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28683208 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:            9344 kB
Writeback:           0 kB
AnonPages:       70400 kB
Mapped:          15300 kB
Slab:           360888 kB
PageTables:       4472 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   222328 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72368 MiB
End job on node109 at 2011-04-29 11:05:47