Trace number 3373545

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.24 1204.16

General information on the benchmark

NameAPPLICATIONS/crypto/
md5gen/gus-md5-12.cnf
MD5SUM0621e557bffdc18ca509447665adecda
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables69553
Number of clauses226752
Sum of the clauses size587624
Maximum clause length3
Minimum clause length1
Number of clauses of size 1129
Number of clauses of size 292374
Number of clauses of size 3134249
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...418552/instance-3373545-1305418552.cnf
0.49/0.56	c Solving...
4800.04/1204.01	
4800.04/1204.01	*** INTERRUPTED! ***
4800.04/1204.01	*** Shutting down threads...
4800.19/1204.15	s UNKNOWN
4800.19/1204.15	
4800.19/1204.15	c INTERRUPTED   : 1
4800.19/1204.15	c Models        : 0+    
4800.19/1204.15	c Time          : 1204.020s (Solving: 1203.46s 1st Model: 0.00s Unsat: 0.00s)
4800.19/1204.15	c CPU Time      : 4800.090s

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373545-1305418552/watcher-3373545-1305418552 -o /tmp/evaluation-result-3373545-1305418552/solver-3373545-1305418552 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373545-1305418552.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.72 5.22 6.59 5/369 6853
/proc/meminfo: memFree=18266064/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=29768 CPUtime=0 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 1518 0 0 0 0 0 0 0 21 0 1 0 732085873 30482432 1448 33554432000 4194304 4964800 140736932448368 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/6853/statm: 7442 1456 375 189 0 2316 0

[startup+0.0253779 s]
/proc/loadavg: 3.72 5.22 6.59 5/369 6853
/proc/meminfo: memFree=18266064/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=36416 CPUtime=0.01 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 4968 0 0 0 1 0 0 0 21 0 1 0 732085873 37289984 4265 33554432000 4194304 4964800 140736932448368 18446744073709551615 224284586693 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/6853/statm: 9225 4275 388 189 0 4099 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 36416

[startup+0.10036 s]
/proc/loadavg: 3.72 5.22 6.59 5/369 6853
/proc/meminfo: memFree=18266064/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=52872 CPUtime=0.09 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 10595 0 0 0 8 1 0 0 21 0 1 0 732085873 54140928 8153 33554432000 4194304 4964800 140736932448368 18446744073709551615 4617330 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/6853/statm: 13218 8153 398 189 0 8092 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 52872

[startup+0.300324 s]
/proc/loadavg: 3.72 5.22 6.59 5/369 6853
/proc/meminfo: memFree=18266064/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=61868 CPUtime=0.29 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 12797 0 0 0 28 1 0 0 22 0 1 0 732085873 63352832 10355 33554432000 4194304 4964800 140736932448368 18446744073709551615 224284586693 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/6853/statm: 15467 10356 403 189 0 10341 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 61868

[startup+0.700225 s]
/proc/loadavg: 3.72 5.22 6.59 5/369 6853
/proc/meminfo: memFree=18266064/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=224824 CPUtime=1.01 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 24735 0 0 0 98 3 0 0 24 0 4 0 732085873 230219776 19410 33554432000 4194304 4964800 140736932448368 18446744073709551615 4370259 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 56206 19410 454 189 0 50555 0
Current children cumulated CPU time (s) 1.01
Current children cumulated vsize (KiB) 224824

[startup+1.50109 s]
/proc/loadavg: 3.72 5.22 6.59 9/373 6857
/proc/meminfo: memFree=18179860/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=224824 CPUtime=4.2 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 25274 0 0 0 416 4 0 0 25 0 4 0 732085873 230219776 19949 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668672 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 56206 19949 458 189 0 50555 0
[pid=6853/tid=6855] ppid=6851 vsize=224824 CPUtime=0.92 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 3194 0 0 0 92 0 0 0 19 0 4 0 732085929 230219776 19949 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=224824 CPUtime=0.93 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 3866 0 0 0 92 1 0 0 19 0 4 0 732085929 230219776 19949 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=224824 CPUtime=0.91 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 3375 0 0 0 91 0 0 0 19 0 4 0 732085929 230219776 19949 33554432000 4194304 4964800 140736932448368 18446744073709551615 4669952 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.2
Current children cumulated vsize (KiB) 224824

[startup+3.10083 s]
/proc/loadavg: 4.06 5.27 6.60 9/373 6857
/proc/meminfo: memFree=18173036/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=224824 CPUtime=10.58 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 25509 0 0 0 1054 4 0 0 25 0 4 0 732085873 230219776 20184 33554432000 4194304 4964800 140736932448368 18446744073709551615 4362289 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 56206 20184 458 189 0 50555 0
[pid=6853/tid=6855] ppid=6851 vsize=224824 CPUtime=2.52 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 3280 0 0 0 252 0 0 0 22 0 4 0 732085929 230219776 20184 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=224824 CPUtime=2.53 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 3874 0 0 0 252 1 0 0 22 0 4 0 732085929 230219776 20184 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=224824 CPUtime=2.5 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 3451 0 0 0 250 0 0 0 22 0 4 0 732085929 230219776 20184 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.58
Current children cumulated vsize (KiB) 224824

[startup+6.30029 s]
/proc/loadavg: 4.06 5.27 6.60 9/373 6857
/proc/meminfo: memFree=18156420/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=225628 CPUtime=23.35 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 26026 0 0 0 2330 5 0 0 25 0 4 0 732085873 231043072 20701 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670437 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 56407 20701 458 189 0 50756 0
[pid=6853/tid=6855] ppid=6851 vsize=225628 CPUtime=5.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 3418 0 0 0 572 1 0 0 25 0 4 0 732085929 231043072 20701 33554432000 4194304 4964800 140736932448368 18446744073709551615 4324798 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=225628 CPUtime=5.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 3961 0 0 0 572 1 0 0 25 0 4 0 732085929 231043072 20701 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=225628 CPUtime=5.66 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 3597 0 0 0 566 0 0 0 25 0 4 0 732085929 231043072 20701 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.35
Current children cumulated vsize (KiB) 225628

[startup+12.7002 s]
/proc/loadavg: 4.66 5.36 6.61 9/373 6857
/proc/meminfo: memFree=18132108/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=228016 CPUtime=48.87 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 27637 0 0 0 4880 7 0 0 25 0 4 0 732085873 233488384 22312 33554432000 4194304 4964800 140736932448368 18446744073709551615 4669280 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 57004 22312 458 189 0 51353 0
[pid=6853/tid=6855] ppid=6851 vsize=228016 CPUtime=12.12 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 3685 0 0 0 1211 1 0 0 25 0 4 0 732085929 233488384 22312 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=228016 CPUtime=12.12 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 4450 0 0 0 1211 1 0 0 25 0 4 0 732085929 233488384 22312 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660157 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=228016 CPUtime=11.98 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 4097 0 0 0 1198 0 0 0 25 0 4 0 732085929 233488384 22312 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.87
Current children cumulated vsize (KiB) 228016

[startup+25.5011 s]
/proc/loadavg: 5.26 5.46 6.63 9/373 6857
/proc/meminfo: memFree=18098872/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=230832 CPUtime=99.92 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 30005 0 0 0 9982 10 0 0 25 0 4 0 732085873 236371968 24680 33554432000 4194304 4964800 140736932448368 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 57708 24680 458 189 0 52057 0
[pid=6853/tid=6855] ppid=6851 vsize=230832 CPUtime=24.92 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 4217 0 0 0 2491 1 0 0 25 0 4 0 732085929 236371968 24680 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668920 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=230832 CPUtime=24.93 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 5320 0 0 0 2490 3 0 0 25 0 4 0 732085929 236371968 24680 33554432000 4194304 4964800 140736932448368 18446744073709551615 4361079 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=230832 CPUtime=24.63 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 4591 0 0 0 2462 1 0 0 25 0 4 0 732085929 236371968 24680 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 99.92
Current children cumulated vsize (KiB) 230832

[startup+51.1008 s]
/proc/loadavg: 6.19 5.66 6.67 9/373 6857
/proc/meminfo: memFree=18044880/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=239324 CPUtime=202.01 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 34566 0 0 0 20187 14 0 0 25 0 4 0 732085873 245067776 29241 33554432000 4194304 4964800 140736932448368 18446744073709551615 4653507 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 59831 29241 458 189 0 54180 0
[pid=6853/tid=6855] ppid=6851 vsize=239324 CPUtime=50.52 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 5178 0 0 0 5050 2 0 0 25 0 4 0 732085929 245067776 29241 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=239324 CPUtime=50.53 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 7211 0 0 0 5049 4 0 0 25 0 4 0 732085929 245067776 29241 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=239324 CPUtime=49.93 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 5156 0 0 0 4992 1 0 0 25 0 4 0 732085929 245067776 29241 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.01
Current children cumulated vsize (KiB) 239324

[startup+102.314 s]
/proc/loadavg: 7.32 6.07 6.75 9/373 6859
/proc/meminfo: memFree=17964640/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=249952 CPUtime=406.26 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 42853 0 0 0 40602 24 0 0 25 0 4 0 732085873 255950848 37528 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668568 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 62488 37528 458 189 0 56837 0
[pid=6853/tid=6855] ppid=6851 vsize=249952 CPUtime=101.74 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 6970 0 0 0 10169 5 0 0 25 0 4 0 732085929 255950848 37528 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668683 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=249952 CPUtime=101.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 10558 0 0 0 10166 7 0 0 25 0 4 0 732085929 255950848 37528 33554432000 4194304 4964800 140736932448368 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=249952 CPUtime=100.53 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 6794 0 0 0 10050 3 0 0 25 0 4 0 732085929 255950848 37528 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.26
Current children cumulated vsize (KiB) 249952

[startup+162.3 s]
/proc/loadavg: 7.73 6.39 6.82 9/373 6861
/proc/meminfo: memFree=17877080/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=257996 CPUtime=645.5 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 46442 0 0 0 64524 26 0 0 25 0 4 0 732085873 264187904 41117 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 64499 41117 460 189 0 58848 0
[pid=6853/tid=6855] ppid=6851 vsize=257996 CPUtime=161.72 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 7612 0 0 0 16166 6 0 0 25 0 4 0 732085929 264187904 41117 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=257996 CPUtime=161.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 12458 0 0 0 16164 9 0 0 25 0 4 0 732085929 264187904 41117 33554432000 4194304 4964800 140736932448368 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=257996 CPUtime=159.81 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 6810 0 0 0 15978 3 0 0 25 0 4 0 732085929 264187904 41117 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 645.5
Current children cumulated vsize (KiB) 257996

[startup+222.3 s]
/proc/loadavg: 7.94 6.72 6.90 9/373 6863
/proc/meminfo: memFree=17854732/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=264820 CPUtime=884.79 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 51493 0 0 0 88447 32 0 0 25 0 4 0 732085873 271175680 46168 33554432000 4194304 4964800 140736932448368 18446744073709551615 4362240 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 66205 46168 460 189 0 60554 0
[pid=6853/tid=6855] ppid=6851 vsize=264820 CPUtime=221.72 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 8486 0 0 0 22166 6 0 0 25 0 4 0 732085929 271175680 46168 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=264820 CPUtime=221.72 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 14866 0 0 0 22160 12 0 0 25 0 4 0 732085929 271175680 46168 33554432000 4194304 4964800 140736932448368 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=264820 CPUtime=219.1 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 7258 0 0 0 21907 3 0 0 25 0 4 0 732085929 271175680 46168 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660305 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 884.79
Current children cumulated vsize (KiB) 264820

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2559.87
Current children cumulated vsize (KiB) 416100

[startup+702.3 s]
/proc/loadavg: 8.10 7.80 7.36 9/373 6875
/proc/meminfo: memFree=17630288/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=421172 CPUtime=2799.14 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 80866 0 0 0 279842 72 0 0 25 0 4 0 732085873 431280128 75541 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660835 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 105293 75541 460 189 0 99642 0
[pid=6853/tid=6855] ppid=6851 vsize=421172 CPUtime=701.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 10607 0 0 0 70165 8 0 0 25 0 4 0 732085929 431280128 75541 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660495 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=421172 CPUtime=701.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 29664 0 0 0 70141 32 0 0 25 0 4 0 732085929 431280128 75541 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=421172 CPUtime=693.43 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 12158 0 0 0 69333 10 0 0 25 0 4 0 732085929 431280128 75541 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2799.14
Current children cumulated vsize (KiB) 421172

[startup+762.314 s]
/proc/loadavg: 8.16 7.87 7.41 9/373 6877
/proc/meminfo: memFree=17570740/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=429144 CPUtime=3038.48 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 87720 0 0 0 303767 81 0 0 25 0 4 0 732085873 439443456 82386 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670437 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 107286 82386 460 189 0 101635 0
[pid=6853/tid=6855] ppid=6851 vsize=429144 CPUtime=761.74 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 12099 0 0 0 76164 10 0 0 25 0 4 0 732085929 439443456 82386 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670670 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=429144 CPUtime=761.74 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 33051 0 0 0 76137 37 0 0 25 0 4 0 732085929 439443456 82386 33554432000 4194304 4964800 140736932448368 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=429144 CPUtime=752.73 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 12621 0 0 0 75262 11 0 0 25 0 4 0 732085929 439443456 82386 33554432000 4194304 4964800 140736932448368 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3038.48
Current children cumulated vsize (KiB) 429144

[startup+822.3 s]
/proc/loadavg: 8.11 7.90 7.45 9/373 6879
/proc/meminfo: memFree=17569588/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=429144 CPUtime=3277.72 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 87936 0 0 0 327691 81 0 0 25 0 4 0 732085873 439443456 82602 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 107286 82602 460 189 0 101635 0
[pid=6853/tid=6855] ppid=6851 vsize=429144 CPUtime=821.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 12110 0 0 0 82163 10 0 0 25 0 4 0 732085929 439443456 82602 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=429144 CPUtime=821.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 33056 0 0 0 82136 37 0 0 25 0 4 0 732085929 439443456 82602 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=429144 CPUtime=812.02 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 12821 0 0 0 81191 11 0 0 25 0 4 0 732085929 439443456 82602 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3277.72
Current children cumulated vsize (KiB) 429144

[startup+882.3 s]
/proc/loadavg: 8.14 7.95 7.49 9/373 6879
/proc/meminfo: memFree=17569440/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=429144 CPUtime=3517.01 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 87945 0 0 0 351620 81 0 0 25 0 4 0 732085873 439443456 82611 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668822 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 107286 82611 460 189 0 101635 0
[pid=6853/tid=6855] ppid=6851 vsize=429144 CPUtime=881.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 12110 0 0 0 88163 10 0 0 25 0 4 0 732085929 439443456 82611 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=429144 CPUtime=881.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 33056 0 0 0 88136 37 0 0 25 0 4 0 732085929 439443456 82611 33554432000 4194304 4964800 140736932448368 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=429144 CPUtime=871.3 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 12830 0 0 0 87119 11 0 0 25 0 4 0 732085929 439443456 82611 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3517.01
Current children cumulated vsize (KiB) 429144

[startup+942.3 s]
/proc/loadavg: 8.10 7.97 7.52 9/373 6881
/proc/meminfo: memFree=17567920/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=429144 CPUtime=3756.31 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 88271 0 0 0 375550 81 0 0 25 0 4 0 732085873 439443456 82937 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 107286 82937 460 189 0 101635 0
[pid=6853/tid=6855] ppid=6851 vsize=429144 CPUtime=941.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 12240 0 0 0 94163 10 0 0 25 0 4 0 732085929 439443456 82937 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668636 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=429144 CPUtime=941.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 33056 0 0 0 94136 37 0 0 25 0 4 0 732085929 439443456 82937 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=429144 CPUtime=930.59 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 13026 0 0 0 93048 11 0 0 25 0 4 0 732085929 439443456 82937 33554432000 4194304 4964800 140736932448368 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3756.31
Current children cumulated vsize (KiB) 429144

[startup+1002.3 s]
/proc/loadavg: 8.16 8.02 7.57 9/373 6883
/proc/meminfo: memFree=17563680/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=433460 CPUtime=3995.6 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 89359 0 0 0 399478 82 0 0 25 0 4 0 732085873 443863040 84025 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660447 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 108365 84025 460 189 0 102714 0
[pid=6853/tid=6855] ppid=6851 vsize=433460 CPUtime=1001.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 12254 0 0 0 100163 10 0 0 25 0 4 0 732085929 443863040 84025 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=433460 CPUtime=1001.73 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 33068 0 0 0 100136 37 0 0 25 0 4 0 732085929 443863040 84025 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=433460 CPUtime=989.88 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 13097 0 0 0 98977 11 0 0 25 0 4 0 732085929 443863040 84025 33554432000 4194304 4964800 140736932448368 18446744073709551615 4342228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3995.6
Current children cumulated vsize (KiB) 433460

[startup+1062.3 s]
/proc/loadavg: 8.15 8.04 7.60 9/373 6885
/proc/meminfo: memFree=17543936/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=440216 CPUtime=4234.9 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 92821 0 0 0 423404 86 0 0 25 0 4 0 732085873 450781184 87487 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 110054 87487 460 189 0 104403 0
[pid=6853/tid=6855] ppid=6851 vsize=440216 CPUtime=1061.72 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 12770 0 0 0 106162 10 0 0 25 0 4 0 732085929 450781184 87487 33554432000 4194304 4964800 140736932448368 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=440216 CPUtime=1061.74 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 34598 0 0 0 106135 39 0 0 25 0 4 0 732085929 450781184 87487 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=440216 CPUtime=1049.18 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 14152 0 0 0 104905 13 0 0 25 0 4 0 732085929 450781184 87487 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668741 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4234.9
Current children cumulated vsize (KiB) 440216

[startup+1122.3 s]
/proc/loadavg: 8.13 8.06 7.64 9/373 6887
/proc/meminfo: memFree=17523332/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=449536 CPUtime=4474.18 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 97763 0 0 0 447325 93 0 0 25 0 4 0 732085873 460324864 92429 33554432000 4194304 4964800 140736932448368 18446744073709551615 4660832 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 112384 92429 460 189 0 106733 0
[pid=6853/tid=6855] ppid=6851 vsize=449536 CPUtime=1121.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 14067 0 0 0 112161 12 0 0 25 0 4 0 732085929 460324864 92429 33554432000 4194304 4964800 140736932448368 18446744073709551615 4324766 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=449536 CPUtime=1121.74 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 37465 0 0 0 112131 43 0 0 25 0 4 0 732085929 460324864 92429 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=449536 CPUtime=1108.46 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 14513 0 0 0 110833 13 0 0 25 0 4 0 732085929 460324864 92429 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4474.18
Current children cumulated vsize (KiB) 449536

[startup+1182.3 s]
/proc/loadavg: 8.05 8.05 7.65 9/373 6887
/proc/meminfo: memFree=17509540/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=454264 CPUtime=4713.48 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 98950 0 0 0 471254 94 0 0 25 0 4 0 732085873 465166336 93616 33554432000 4194304 4964800 140736932448368 18446744073709551615 4332103 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 113566 93616 460 189 0 107915 0
[pid=6853/tid=6855] ppid=6851 vsize=454264 CPUtime=1181.73 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 15129 0 0 0 118160 13 0 0 25 0 4 0 732085929 465166336 93616 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668822 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=454264 CPUtime=1181.74 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 37481 0 0 0 118131 43 0 0 25 0 4 0 732085929 465166336 93616 33554432000 4194304 4964800 140736932448368 18446744073709551615 4361114 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=454264 CPUtime=1167.76 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 14621 0 0 0 116763 13 0 0 25 0 4 0 732085929 465166336 93616 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4713.48
Current children cumulated vsize (KiB) 454264



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204 s]
/proc/loadavg: 8.17 8.07 7.67 5/368 6890
/proc/meminfo: memFree=17898432/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=457432 CPUtime=4800.04 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 99753 0 0 0 479909 95 0 0 25 0 4 0 732085873 468410368 94419 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668568 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/6853/statm: 114358 94419 460 189 0 108707 0
[pid=6853/tid=6855] ppid=6851 vsize=457432 CPUtime=1203.45 cores=1,3,5,7
/proc/6853/task/6855/stat : 6855 (claspmt) R 6851 6853 5935 0 -1 4202560 15642 0 0 0 120331 14 0 0 25 0 4 0 732085929 468410368 94419 33554432000 4194304 4964800 140736932448368 18446744073709551615 4670440 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6853/tid=6856] ppid=6851 vsize=457432 CPUtime=1203.45 cores=1,3,5,7
/proc/6853/task/6856/stat : 6856 (claspmt) R 6851 6853 5935 0 -1 4202560 37679 0 0 0 120302 43 0 0 25 0 4 0 732085929 468410368 94419 33554432000 4194304 4964800 140736932448368 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6853/tid=6857] ppid=6851 vsize=457432 CPUtime=1189.2 cores=1,3,5,7
/proc/6853/task/6857/stat : 6857 (claspmt) R 6851 6853 5935 0 -1 4202560 14621 0 0 0 118907 13 0 0 25 0 4 0 732085929 468410368 94419 33554432000 4194304 4964800 140736932448368 18446744073709551615 4361114 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.04
Current children cumulated vsize (KiB) 457432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.12 s]
/proc/loadavg: 8.17 8.07 7.67 5/368 6890
/proc/meminfo: memFree=17898432/32951124 swapFree=45193364/67111528
[pid=6853] ppid=6851 vsize=442208 CPUtime=4800.19 cores=1,3,5,7
/proc/6853/stat : 6853 (claspmt) R 6851 6853 5935 0 -1 4202496 99767 0 0 0 479924 95 0 0 25 0 1 0 732085873 452820992 90625 33554432000 4194304 4964800 140736932448368 18446744073709551615 224284581145 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/6853/statm: 110552 90625 470 189 0 104901 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 442208

Child status: 0
Real time (s): 1204.16
CPU time (s): 4800.24
CPU user time (s): 4799.26
CPU system time (s): 0.970852
CPU usage (%): 398.639
Max. virtual memory (cumulated for all children) (KiB): 457432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.26
system time used= 0.970852
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 99769
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1506
involuntary context switches= 34307

runsolver used 3.90241 second user time and 10.3464 second system time

The end

Launcher Data

Begin job on node118 at 2011-05-15 02:15:52
IDJOB=3373545
IDBENCH=70829
IDSOLVER=1853
FILE ID=node118/3373545-1305418552
RUNJOBID= node118-1305418552-6831
PBS_JOBID= 13324527
Free space on /tmp= 73044 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/APPLICATIONS/crypto/md5gen/gus-md5-12.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373545-1305418552/watcher-3373545-1305418552 -o /tmp/evaluation-result-3373545-1305418552/solver-3373545-1305418552 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373545-1305418552.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0621e557bffdc18ca509447665adecda
RANDOM SEED=234849034

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18266096 kB
Buffers:        279636 kB
Cached:        4393512 kB
SwapCached:      22084 kB
Active:       11793836 kB
Inactive:      2587608 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18266096 kB
SwapTotal:    67111528 kB
SwapFree:     45193364 kB
Dirty:            5892 kB
Writeback:           8 kB
AnonPages:     9698720 kB
Mapped:          15348 kB
Slab:           148684 kB
PageTables:      89764 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 88675768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73044 MiB
End job on node118 at 2011-05-15 02:35:58