Trace number 3299944

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.32 1202.67

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top25.cnf
MD5SUM1d36146d5d79c91e0605a19242395228
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark527.919
Satisfiable
(Un)Satisfiability was proved
Number of variables71356
Number of clauses227126
Sum of the clauses size555264
Maximum clause length2747
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2137909
Number of clauses of size 387742
Number of clauses of size 4324
Number of clauses of size 523
Number of clauses of size over 51127

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...082465/instance-3299944-1304082465.cnf
0.99/1.06	c Solving...
4800.13/1202.51	
4800.13/1202.51	*** INTERRUPTED! ***
4800.13/1202.51	*** Shutting down threads...
4800.26/1202.66	s UNKNOWN
4800.26/1202.66	
4800.26/1202.66	c INTERRUPTED   : 1
4800.26/1202.66	c Models        : 0+    
4800.26/1202.66	c Time          : 1202.509s (Solving: 1201.44s 1st Model: 0.00s Unsat: 0.00s)
4800.26/1202.66	c CPU Time      : 4800.150s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299944-1304082465/watcher-3299944-1304082465 -o /tmp/evaluation-result-3299944-1304082465/solver-3299944-1304082465 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299944-1304082465.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.37 7.94 7.99 3/174 23146
/proc/meminfo: memFree=18793224/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=29996 CPUtime=0 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 1551 0 0 0 0 0 0 0 17 0 1 0 519844490 30715904 1480 33554432000 4194304 4964704 140735995163888 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/23146/statm: 7499 1487 375 189 0 2373 0

[startup+0.100198 s]
/proc/loadavg: 7.37 7.94 7.99 3/174 23146
/proc/meminfo: memFree=18793224/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=51740 CPUtime=0.09 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 10299 0 0 0 8 1 0 0 17 0 1 0 519844490 52981760 7825 33554432000 4194304 4964704 140735995163888 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/23146/statm: 12935 7825 398 189 0 7809 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 51740

[startup+0.201188 s]
/proc/loadavg: 7.37 7.94 7.99 3/174 23146
/proc/meminfo: memFree=18793224/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=59148 CPUtime=0.19 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 12034 0 0 0 18 1 0 0 17 0 1 0 519844490 60567552 9560 33554432000 4194304 4964704 140735995163888 18446744073709551615 228122374853 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/23146/statm: 14787 9560 403 189 0 9661 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 59148

[startup+0.301157 s]
/proc/loadavg: 7.37 7.94 7.99 3/174 23146
/proc/meminfo: memFree=18793224/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=62456 CPUtime=0.29 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 12853 0 0 0 28 1 0 0 18 0 1 0 519844490 63954944 10379 33554432000 4194304 4964704 140735995163888 18446744073709551615 228122374853 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/23146/statm: 15614 10380 403 189 0 10488 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 62456

[startup+0.701083 s]
/proc/loadavg: 7.37 7.94 7.99 3/174 23146
/proc/meminfo: memFree=18793224/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=66944 CPUtime=0.69 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 14001 0 0 0 67 2 0 0 18 0 1 0 519844490 68550656 11527 33554432000 4194304 4964704 140735995163888 18446744073709551615 4622620 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/23146/statm: 16736 11527 403 189 0 11610 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 66944

[startup+1.50091 s]
/proc/loadavg: 6.94 7.84 7.96 6/181 23156
/proc/meminfo: memFree=18673888/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=221048 CPUtime=2.74 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 21797 0 0 0 271 3 0 0 20 0 4 0 519844490 226353152 16521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 55262 16521 458 189 0 49611 0
[pid=23146/tid=23154] ppid=23144 vsize=221048 CPUtime=0.42 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 1629 0 0 0 42 0 0 0 18 0 4 0 519844597 226353152 16521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=221048 CPUtime=0.41 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 2793 0 0 0 41 0 0 0 18 0 4 0 519844597 226353152 16521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=221048 CPUtime=0.41 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 2901 0 0 0 41 0 0 0 18 0 4 0 519844597 226353152 16521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4669051 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 221048

[startup+3.10062 s]
/proc/loadavg: 6.94 7.84 7.96 10/184 23159
/proc/meminfo: memFree=18642740/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=221252 CPUtime=9.14 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 23911 0 0 0 909 5 0 0 25 0 4 0 519844490 226562048 18635 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668697 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 55313 18635 458 189 0 49662 0
[pid=23146/tid=23154] ppid=23144 vsize=221252 CPUtime=2.01 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 1888 0 0 0 201 0 0 0 21 0 4 0 519844597 226562048 18635 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=221252 CPUtime=2.02 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 3537 0 0 0 201 1 0 0 21 0 4 0 519844597 226562048 18635 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=221252 CPUtime=2.01 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 3637 0 0 0 200 1 0 0 21 0 4 0 519844597 226562048 18635 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.14
Current children cumulated vsize (KiB) 221252

[startup+6.30105 s]
/proc/loadavg: 7.03 7.85 7.96 10/184 23159
/proc/meminfo: memFree=18604204/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=227276 CPUtime=21.91 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 28809 0 0 0 2184 7 0 0 25 0 4 0 519844490 232730624 23533 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320848 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 56819 23533 458 189 0 51168 0
[pid=23146/tid=23154] ppid=23144 vsize=227276 CPUtime=5.21 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 2668 0 0 0 521 0 0 0 25 0 4 0 519844597 232730624 23533 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=227276 CPUtime=5.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 4986 0 0 0 520 1 0 0 25 0 4 0 519844597 232730624 23533 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=227276 CPUtime=5.19 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 5537 0 0 0 517 2 0 0 25 0 4 0 519844597 232730624 23533 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 21.91
Current children cumulated vsize (KiB) 227276

[startup+12.7009 s]
/proc/loadavg: 7.11 7.85 7.96 10/184 23159
/proc/meminfo: memFree=18548860/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=235716 CPUtime=47.48 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 33850 0 0 0 4738 10 0 0 25 0 4 0 519844490 241373184 28574 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 58929 28574 458 189 0 53278 0
[pid=23146/tid=23154] ppid=23144 vsize=235716 CPUtime=11.62 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 3289 0 0 0 1161 1 0 0 25 0 4 0 519844597 241373184 28574 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=235716 CPUtime=11.61 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 6968 0 0 0 1159 2 0 0 25 0 4 0 519844597 241373184 28574 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=235716 CPUtime=11.55 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 7020 0 0 0 1152 3 0 0 25 0 4 0 519844597 241373184 28574 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 47.48
Current children cumulated vsize (KiB) 235716

[startup+25.5006 s]
/proc/loadavg: 7.30 7.86 7.96 10/184 23160
/proc/meminfo: memFree=18481912/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=250088 CPUtime=98.61 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 43797 0 0 0 9844 17 0 0 25 0 4 0 519844490 256090112 38521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4669196 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 62522 38521 460 189 0 56871 0
[pid=23146/tid=23154] ppid=23144 vsize=250088 CPUtime=24.42 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 5197 0 0 0 2440 2 0 0 25 0 4 0 519844597 256090112 38521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668657 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=250088 CPUtime=24.42 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 10194 0 0 0 2437 5 0 0 25 0 4 0 519844597 256090112 38521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=250088 CPUtime=24.28 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 9687 0 0 0 2423 5 0 0 25 0 4 0 519844597 256090112 38521 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 98.61
Current children cumulated vsize (KiB) 250088

[startup+51.101 s]
/proc/loadavg: 7.54 7.87 7.96 10/184 23160
/proc/meminfo: memFree=18386540/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=316452 CPUtime=200.87 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 58366 0 0 0 20055 32 0 0 25 0 4 0 519844490 324046848 53090 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670080 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 79113 53090 460 189 0 73462 0
[pid=23146/tid=23154] ppid=23144 vsize=316452 CPUtime=50.01 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 5449 0 0 0 4999 2 0 0 25 0 4 0 519844597 324046848 53090 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=316452 CPUtime=50.01 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 18464 0 0 0 4989 12 0 0 25 0 4 0 519844597 324046848 53090 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=316452 CPUtime=49.74 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 14859 0 0 0 4963 11 0 0 25 0 4 0 519844597 324046848 53090 33554432000 4194304 4964704 140735995163888 18446744073709551615 4660075 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 200.87
Current children cumulated vsize (KiB) 316452

[startup+102.301 s]
/proc/loadavg: 7.87 7.91 7.97 10/184 23162
/proc/meminfo: memFree=18215644/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=391096 CPUtime=405.41 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 74252 0 0 0 40491 50 0 0 25 0 4 0 519844490 400482304 68963 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 97774 68963 460 189 0 92123 0
[pid=23146/tid=23154] ppid=23144 vsize=391096 CPUtime=101.22 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 8031 0 0 0 10116 6 0 0 25 0 4 0 519844597 400482304 68963 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=391096 CPUtime=101.22 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 25086 0 0 0 10103 19 0 0 25 0 4 0 519844597 400482304 68963 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=391096 CPUtime=100.66 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 17661 0 0 0 10053 13 0 0 25 0 4 0 519844597 400482304 68963 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 405.41
Current children cumulated vsize (KiB) 391096

[startup+162.301 s]
/proc/loadavg: 7.99 7.94 7.97 10/184 23163
/proc/meminfo: memFree=18079568/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=422176 CPUtime=645.06 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 93832 0 0 0 64436 70 0 0 25 0 4 0 519844490 432308224 88483 33554432000 4194304 4964704 140735995163888 18446744073709551615 4342157 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 105544 88483 460 189 0 99893 0
[pid=23146/tid=23154] ppid=23144 vsize=422176 CPUtime=161.21 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 11249 0 0 0 16111 10 0 0 25 0 4 0 519844597 432308224 88483 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670054 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=422176 CPUtime=161.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 33147 0 0 0 16094 27 0 0 25 0 4 0 519844597 432308224 88483 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=422176 CPUtime=160.33 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 22912 0 0 0 16015 18 0 0 25 0 4 0 519844597 432308224 88483 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 645.06
Current children cumulated vsize (KiB) 422176

[startup+222.307 s]
/proc/loadavg: 8.03 7.96 7.98 10/184 23165
/proc/meminfo: memFree=17949580/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=568944 CPUtime=884.76 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 109580 0 0 0 88391 85 0 0 25 0 4 0 519844490 582598656 104161 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668820 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 142236 104161 460 189 0 136585 0
[pid=23146/tid=23154] ppid=23144 vsize=568944 CPUtime=221.22 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 12791 0 0 0 22111 11 0 0 25 0 4 0 519844597 582598656 104161 33554432000 4194304 4964704 140735995163888 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=568944 CPUtime=221.22 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 39877 0 0 0 22090 32 0 0 25 0 4 0 519844597 582598656 104161 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=568944 CPUtime=220.01 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 27007 0 0 0 21977 24 0 0 25 0 4 0 519844597 582598656 104161 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 884.76
Current children cumulated vsize (KiB) 568944

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2562.41
Current children cumulated vsize (KiB) 750336

[startup+702.301 s]
/proc/loadavg: 8.11 8.11 8.03 10/184 23178
/proc/meminfo: memFree=17371652/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=750336 CPUtime=2802.08 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 151103 0 0 0 280072 136 0 0 25 0 4 0 519844490 768344064 145354 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 187584 145354 460 189 0 181933 0
[pid=23146/tid=23154] ppid=23144 vsize=750336 CPUtime=701.17 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 17586 0 0 0 70103 14 0 0 25 0 4 0 519844597 768344064 145354 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=750336 CPUtime=701.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 55729 0 0 0 70073 48 0 0 25 0 4 0 519844597 768344064 145354 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=750336 CPUtime=697.39 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 42107 0 0 0 69692 47 0 0 25 0 4 0 519844597 768344064 145354 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2802.08
Current children cumulated vsize (KiB) 750336

[startup+762.301 s]
/proc/loadavg: 8.09 8.11 8.03 10/184 23179
/proc/meminfo: memFree=17347940/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=750336 CPUtime=3041.76 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 156839 0 0 0 304031 145 0 0 25 0 4 0 519844490 768344064 150956 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 187584 150956 460 189 0 181933 0
[pid=23146/tid=23154] ppid=23144 vsize=750336 CPUtime=760.97 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 18209 0 0 0 76082 15 0 0 25 0 4 0 519844597 768344064 150956 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=750336 CPUtime=761.22 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 57799 0 0 0 76070 52 0 0 25 0 4 0 519844597 768344064 150956 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=750336 CPUtime=757.27 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 42123 0 0 0 75680 47 0 0 25 0 4 0 519844597 768344064 150956 33554432000 4194304 4964704 140735995163888 18446744073709551615 4669192 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3041.76
Current children cumulated vsize (KiB) 750336

[startup+822.301 s]
/proc/loadavg: 8.08 8.10 8.03 10/184 23181
/proc/meminfo: memFree=17297560/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=3281.42 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 169526 0 0 0 327973 169 0 0 25 0 4 0 519844490 902561792 163643 33554432000 4194304 4964704 140735995163888 18446744073709551615 4653154 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 163643 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=820.64 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 18281 0 0 0 82049 15 0 0 25 0 4 0 519844597 902561792 163643 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=821.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 68017 0 0 0 82049 72 0 0 25 0 4 0 519844597 902561792 163643 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=817.27 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 44519 0 0 0 81676 51 0 0 25 0 4 0 519844597 902561792 163643 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3281.42
Current children cumulated vsize (KiB) 881408

[startup+882.306 s]
/proc/loadavg: 8.07 8.09 8.03 10/184 23182
/proc/meminfo: memFree=17293788/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=3521.1 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 169932 0 0 0 351940 170 0 0 25 0 4 0 519844490 902561792 163898 33554432000 4194304 4964704 140735995163888 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 163898 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=880.3 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 18522 0 0 0 88015 15 0 0 25 0 4 0 519844597 902561792 163898 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=881.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 68063 0 0 0 88049 72 0 0 25 0 4 0 519844597 902561792 163898 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=877.27 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 44602 0 0 0 87676 51 0 0 25 0 4 0 519844597 902561792 163898 33554432000 4194304 4964704 140735995163888 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3521.1
Current children cumulated vsize (KiB) 881408

[startup+942.301 s]
/proc/loadavg: 8.07 8.09 8.03 10/184 23184
/proc/meminfo: memFree=17267712/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=3760.76 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 170460 0 0 0 375906 170 0 0 25 0 4 0 519844490 902561792 164426 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 164426 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=939.98 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 18893 0 0 0 93983 15 0 0 25 0 4 0 519844597 902561792 164426 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=941.2 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 68074 0 0 0 94048 72 0 0 25 0 4 0 519844597 902561792 164426 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=937.26 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 44746 0 0 0 93675 51 0 0 25 0 4 0 519844597 902561792 164426 33554432000 4194304 4964704 140735995163888 18446744073709551615 4669399 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3760.76
Current children cumulated vsize (KiB) 881408

[startup+1002.3 s]
/proc/loadavg: 8.06 8.08 8.03 10/184 23186
/proc/meminfo: memFree=17250208/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=4000.42 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 170963 0 0 0 399872 170 0 0 25 0 4 0 519844490 902561792 164761 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668654 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 164761 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=999.76 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 19292 0 0 0 99961 15 0 0 25 0 4 0 519844597 902561792 164761 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=1001.2 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 68172 0 0 0 100048 72 0 0 25 0 4 0 519844597 902561792 164761 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=997.14 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 44746 0 0 0 99663 51 0 0 25 0 4 0 519844597 902561792 164761 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4000.42
Current children cumulated vsize (KiB) 881408

[startup+1062.3 s]
/proc/loadavg: 8.06 8.08 8.03 9/184 23187
/proc/meminfo: memFree=17211956/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=4240.1 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 174882 0 0 0 423833 177 0 0 25 0 4 0 519844490 902561792 168680 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 168680 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=1059.76 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 19320 0 0 0 105961 15 0 0 25 0 4 0 519844597 902561792 168680 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=1061.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 71730 0 0 0 106043 78 0 0 25 0 4 0 519844597 902561792 168680 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=1056.82 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 44860 0 0 0 105630 52 0 0 25 0 4 0 519844597 902561792 168680 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4240.1
Current children cumulated vsize (KiB) 881408

[startup+1122.3 s]
/proc/loadavg: 8.21 8.11 8.04 10/184 23189
/proc/meminfo: memFree=17175964/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=4479.77 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 178633 0 0 0 447793 184 0 0 25 0 4 0 519844490 902561792 172416 33554432000 4194304 4964704 140735995163888 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 172416 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=1119.76 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 20171 0 0 0 111959 17 0 0 25 0 4 0 519844597 902561792 172416 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=1121.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 71778 0 0 0 112043 78 0 0 25 0 4 0 519844597 902561792 172416 33554432000 4194304 4964704 140735995163888 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=1116.49 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 45023 0 0 0 111597 52 0 0 25 0 4 0 519844597 902561792 172416 33554432000 4194304 4964704 140735995163888 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4479.77
Current children cumulated vsize (KiB) 881408

[startup+1182.3 s]
/proc/loadavg: 8.22 8.12 8.05 10/184 23190
/proc/meminfo: memFree=17165016/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=4719.43 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 181599 0 0 0 471753 190 0 0 25 0 4 0 519844490 902561792 175382 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 175382 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=1179.74 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 20256 0 0 0 117957 17 0 0 25 0 4 0 519844597 902561792 175382 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668725 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=1181.21 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 74649 0 0 0 118038 83 0 0 25 0 4 0 519844597 902561792 175382 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=1176.17 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 45033 0 0 0 117565 52 0 0 25 0 4 0 519844597 902561792 175382 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4719.43
Current children cumulated vsize (KiB) 881408



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.5 s]
/proc/loadavg: 8.16 8.11 8.04 9/184 23191
/proc/meminfo: memFree=17141800/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=881408 CPUtime=4800.13 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 187048 0 0 0 479815 198 0 0 25 0 4 0 519844490 902561792 180831 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/23146/statm: 220352 180831 460 189 0 214701 0
[pid=23146/tid=23154] ppid=23144 vsize=881408 CPUtime=1199.94 cores=1,3,5,7
/proc/23146/task/23154/stat : 23154 (claspmt) R 23144 23146 22817 0 -1 4202560 20265 0 0 0 119977 17 0 0 25 0 4 0 519844597 902561792 180831 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23146/tid=23155] ppid=23144 vsize=881408 CPUtime=1201.41 cores=1,3,5,7
/proc/23146/task/23155/stat : 23155 (claspmt) R 23144 23146 22817 0 -1 4202560 80087 0 0 0 120049 92 0 0 25 0 4 0 519844597 902561792 180831 33554432000 4194304 4964704 140735995163888 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23146/tid=23156] ppid=23144 vsize=881408 CPUtime=1196.25 cores=1,3,5,7
/proc/23146/task/23156/stat : 23156 (claspmt) R 23144 23146 22817 0 -1 4202560 45033 0 0 0 119573 52 0 0 25 0 4 0 519844597 902561792 180831 33554432000 4194304 4964704 140735995163888 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 881408

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.61 s]
/proc/loadavg: 8.16 8.11 8.04 9/184 23191
/proc/meminfo: memFree=17141800/32951124 swapFree=67111528/67111528
[pid=23146] ppid=23144 vsize=862144 CPUtime=4800.26 cores=1,3,5,7
/proc/23146/stat : 23146 (claspmt) R 23144 23146 22817 0 -1 4202496 187059 0 0 0 479827 199 0 0 25 0 1 0 519844490 882835456 167915 33554432000 4194304 4964704 140735995163888 18446744073709551615 228122369147 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/23146/statm: 215536 167915 470 189 0 209885 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 862144

Child status: 0
Real time (s): 1202.67
CPU time (s): 4800.32
CPU user time (s): 4798.3
CPU system time (s): 2.02169
CPU usage (%): 399.139
Max. virtual memory (cumulated for all children) (KiB): 881408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.3
system time used= 2.02169
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 187061
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5499
involuntary context switches= 34709

runsolver used 1.82072 second user time and 4.75028 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 15:07:45
IDJOB=3299944
IDBENCH=83121
IDSOLVER=1683
FILE ID=node138/3299944-1304082465
RUNJOBID= node138-1304082465-23133
PBS_JOBID= 13170524
Free space on /tmp= 71808 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top25.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299944-1304082465/watcher-3299944-1304082465 -o /tmp/evaluation-result-3299944-1304082465/solver-3299944-1304082465 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299944-1304082465.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1d36146d5d79c91e0605a19242395228
RANDOM SEED=302570128

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18793504 kB
Buffers:       2041648 kB
Cached:       11484740 kB
SwapCached:          0 kB
Active:        3282516 kB
Inactive:     10311352 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18793504 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            7492 kB
Writeback:           0 kB
AnonPages:       67576 kB
Mapped:          14488 kB
Slab:           500512 kB
PageTables:       4348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   189572 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71804 MiB
End job on node138 at 2011-04-29 15:27:50