Trace number 3321393

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40002 5022.11

General information on the benchmark

NameAPPLICATIONS/
bitverif/maxxor/maxxor128.cnf
MD5SUM065c126f0d55807310a398728b44423f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark37756.2
Satisfiable
(Un)Satisfiability was proved
Number of variables200440
Number of clauses599015
Sum of the clauses size1397699
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2399342
Number of clauses of size 3199671
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...337881/instance-3321393-1304337881.cnf
2.19/2.26	c Solving...
40000.23/5020.42	
40000.23/5020.42	*** INTERRUPTED! ***
40000.23/5020.42	*** Shutting down threads...
40001.86/5022.06	s UNKNOWN
40001.86/5022.06	
40001.86/5022.06	c INTERRUPTED   : 1
40001.86/5022.06	c Models        : 0+    
40001.86/5022.06	c Time          : 5020.429s (Solving: 5018.17s 1st Model: 0.00s Unsat: 0.00s)
40001.86/5022.06	c CPU Time      : 40000.290s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321393-1304337881/watcher-3321393-1304337881 -o /tmp/evaluation-result-3321393-1304337881/solver-3321393-1304337881 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321393-1304337881.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 7.34 7.56 2/252 20983
/proc/meminfo: memFree=23386560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=46324 CPUtime=0 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2298 0 0 0 0 0 0 0 21 0 1 0 526203965 47435776 2228 33554432000 4194304 4964704 140734193792384 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/20983/statm: 11581 2235 376 189 0 6455 0

[startup+0.013267 s]
/proc/loadavg: 8.10 7.34 7.56 2/252 20983
/proc/meminfo: memFree=23386560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=46324 CPUtime=0 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 3546 0 0 0 0 0 0 0 21 0 1 0 526203965 47435776 3475 33554432000 4194304 4964704 140734193792384 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/20983/statm: 11581 3491 376 189 0 6455 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 46324

[startup+0.100242 s]
/proc/loadavg: 8.10 7.34 7.56 2/252 20983
/proc/meminfo: memFree=23386560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=71452 CPUtime=0.09 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 15528 0 0 0 7 2 0 0 21 0 1 0 526203965 73166848 12742 33554432000 4194304 4964704 140734193792384 18446744073709551615 4583487 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/20983/statm: 17863 12744 386 189 0 12737 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 71452

[startup+0.300217 s]
/proc/loadavg: 8.10 7.34 7.56 2/252 20983
/proc/meminfo: memFree=23386560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=109220 CPUtime=0.29 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 28267 0 0 0 25 4 0 0 22 0 1 0 526203965 111841280 21955 33554432000 4194304 4964704 140734193792384 18446744073709551615 233509956752 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/20983/statm: 27305 21955 399 189 0 22179 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 109220

[startup+0.700133 s]
/proc/loadavg: 8.10 7.34 7.56 2/252 20983
/proc/meminfo: memFree=23386560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=136148 CPUtime=0.69 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 35048 0 0 0 64 5 0 0 23 0 1 0 526203965 139415552 28736 33554432000 4194304 4964704 140734193792384 18446744073709551615 4600585 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/20983/statm: 34037 28738 404 189 0 28911 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 136148

[startup+1.50099 s]
/proc/loadavg: 8.10 7.34 7.56 2/253 20984
/proc/meminfo: memFree=23261320/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=154680 CPUtime=1.49 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 39661 0 0 0 144 5 0 0 25 0 1 0 526203965 158392320 33349 33554432000 4194304 4964704 140734193792384 18446744073709551615 4621545 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/20983/statm: 38670 33349 404 189 0 33544 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 154680

[startup+3.10071 s]
/proc/loadavg: 7.54 7.24 7.52 2/253 20984
/proc/meminfo: memFree=23254252/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=642212 CPUtime=3.3 cores=0-7
/proc/20983/stat : 20983 (claspmt) S 20981 20983 20879 0 -1 4202496 89751 0 0 0 304 26 0 0 25 0 8 0 526203965 657625088 69354 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/20983/statm: 160553 69354 438 189 0 154902 0
Current children cumulated CPU time (s) 3.3
Current children cumulated vsize (KiB) 642212

[startup+6.30113 s]
/proc/loadavg: 7.54 7.24 7.52 2/260 20991
/proc/meminfo: memFree=23112180/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=642212 CPUtime=6.5 cores=0-7
/proc/20983/stat : 20983 (claspmt) S 20981 20983 20879 0 -1 4202496 89769 0 0 0 624 26 0 0 25 0 8 0 526203965 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/20983/statm: 160553 69372 438 189 0 154902 0
[pid=20983/tid=20985] ppid=20981 vsize=642212 CPUtime=0.04 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) S 20981 20983 20879 0 -1 4202560 5320 0 0 0 2 2 0 0 18 0 8 0 526204191 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 1 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=642212 CPUtime=0.03 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) S 20981 20983 20879 0 -1 4202560 7985 0 0 0 0 3 0 0 18 0 8 0 526204191 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=642212 CPUtime=0.03 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) S 20981 20983 20879 0 -1 4202560 7539 0 0 0 1 2 0 0 18 0 8 0 526204191 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 4 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=642212 CPUtime=0.03 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) S 20981 20983 20879 0 -1 4202560 6102 0 0 0 1 2 0 0 18 0 8 0 526204192 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 3 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=642212 CPUtime=3.92 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 7230 0 0 0 389 3 0 0 25 0 8 0 526204192 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=642212 CPUtime=0.05 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) S 20981 20983 20879 0 -1 4202560 7925 0 0 0 3 2 0 0 18 0 8 0 526204192 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=642212 CPUtime=0.07 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) S 20981 20983 20879 0 -1 4202560 7175 0 0 0 4 3 0 0 18 0 8 0 526204192 657625088 69372 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.5
Current children cumulated vsize (KiB) 642212

[startup+12.701 s]
/proc/loadavg: 6.53 7.03 7.45 2/260 20991
/proc/meminfo: memFree=23112956/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=642212 CPUtime=12.9 cores=0-7
/proc/20983/stat : 20983 (claspmt) S 20981 20983 20879 0 -1 4202496 89824 0 0 0 1264 26 0 0 25 0 8 0 526203965 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/20983/statm: 160553 69427 438 189 0 154902 0
[pid=20983/tid=20985] ppid=20981 vsize=642212 CPUtime=0.04 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) S 20981 20983 20879 0 -1 4202560 5320 0 0 0 2 2 0 0 18 0 8 0 526204191 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 1 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=642212 CPUtime=0.03 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) S 20981 20983 20879 0 -1 4202560 7985 0 0 0 0 3 0 0 18 0 8 0 526204191 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=642212 CPUtime=0.03 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) S 20981 20983 20879 0 -1 4202560 7539 0 0 0 1 2 0 0 18 0 8 0 526204191 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 4 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=642212 CPUtime=0.03 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) S 20981 20983 20879 0 -1 4202560 6102 0 0 0 1 2 0 0 18 0 8 0 526204192 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 3 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=642212 CPUtime=10.33 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 7285 0 0 0 1029 4 0 0 25 0 8 0 526204192 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668635 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=642212 CPUtime=0.05 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) S 20981 20983 20879 0 -1 4202560 7925 0 0 0 3 2 0 0 18 0 8 0 526204192 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=642212 CPUtime=0.07 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) S 20981 20983 20879 0 -1 4202560 7175 0 0 0 4 3 0 0 18 0 8 0 526204192 657625088 69427 33554432000 4194304 4964704 140734193792384 18446744073709551615 233522113433 0 0 4096 18946 18446604453934716736 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.9
Current children cumulated vsize (KiB) 642212

[startup+25.5007 s]
/proc/loadavg: 6.24 6.95 7.42 9/260 20991
/proc/meminfo: memFree=23081652/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=642212 CPUtime=84.69 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 98617 0 0 0 8433 36 0 0 25 0 8 0 526203965 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 160553 78220 464 189 0 154902 0
[pid=20983/tid=20985] ppid=20981 vsize=642212 CPUtime=8.49 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 6034 0 0 0 846 3 0 0 25 0 8 0 526204191 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=642212 CPUtime=8.47 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 9620 0 0 0 842 5 0 0 25 0 8 0 526204191 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=642212 CPUtime=8.37 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 8772 0 0 0 833 4 0 0 25 0 8 0 526204191 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=642212 CPUtime=8.48 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 6662 0 0 0 845 3 0 0 25 0 8 0 526204192 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4652163 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=642212 CPUtime=23.13 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 7340 0 0 0 2309 4 0 0 25 0 8 0 526204192 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4399407 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=642212 CPUtime=8.49 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 9351 0 0 0 846 3 0 0 25 0 8 0 526204192 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=642212 CPUtime=8.51 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 9406 0 0 0 846 5 0 0 25 0 8 0 526204192 657625088 78220 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669218 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 84.69
Current children cumulated vsize (KiB) 642212

[startup+51.1011 s]
/proc/loadavg: 6.84 7.03 7.43 9/260 20992
/proc/meminfo: memFree=23007416/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=642648 CPUtime=289.29 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 117141 0 0 0 28868 61 0 0 25 0 8 0 526203965 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 160662 96744 464 189 0 155011 0
[pid=20983/tid=20985] ppid=20981 vsize=642648 CPUtime=34.09 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 6762 0 0 0 3406 3 0 0 25 0 8 0 526204191 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=642648 CPUtime=34.06 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 13639 0 0 0 3396 10 0 0 25 0 8 0 526204191 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669200 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=642648 CPUtime=33.77 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 10729 0 0 0 3370 7 0 0 25 0 8 0 526204191 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 233509957082 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=642648 CPUtime=34.09 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 7559 0 0 0 3404 5 0 0 25 0 8 0 526204192 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669391 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=642648 CPUtime=48.73 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 7354 0 0 0 4869 4 0 0 25 0 8 0 526204192 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=642648 CPUtime=34.1 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 12693 0 0 0 3402 8 0 0 25 0 8 0 526204192 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669214 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=642648 CPUtime=34.11 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 16595 0 0 0 3396 15 0 0 25 0 8 0 526204192 658071552 96744 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668657 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 289.29
Current children cumulated vsize (KiB) 642648

[startup+102.31 s]
/proc/loadavg: 7.54 7.19 7.46 9/260 20993
/proc/meminfo: memFree=22861700/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=714528 CPUtime=698.55 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 153364 0 0 0 69752 103 0 0 25 0 8 0 526203965 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668907 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 178632 132967 466 189 0 172981 0
[pid=20983/tid=20985] ppid=20981 vsize=714528 CPUtime=85.3 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 7246 0 0 0 8526 4 0 0 25 0 8 0 526204191 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4370242 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=714528 CPUtime=85.27 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 24164 0 0 0 8505 22 0 0 25 0 8 0 526204191 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668645 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=714528 CPUtime=84.55 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 12346 0 0 0 8447 8 0 0 25 0 8 0 526204191 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4683929 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=714528 CPUtime=85.29 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 10183 0 0 0 8521 8 0 0 25 0 8 0 526204192 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=714528 CPUtime=99.94 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 7368 0 0 0 9990 4 0 0 25 0 8 0 526204192 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=714528 CPUtime=85.31 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 14796 0 0 0 8520 11 0 0 25 0 8 0 526204192 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=714528 CPUtime=85.32 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 34099 0 0 0 8498 34 0 0 25 0 8 0 526204192 731676672 132967 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 698.55
Current children cumulated vsize (KiB) 714528

[startup+162.301 s]
/proc/loadavg: 7.86 7.35 7.50 9/260 20995
/proc/meminfo: memFree=22758372/32951124 swapFree=67111524/67111528

################
# More data... #
################

Current children cumulated vsize (KiB) 8225116

[startup+4782.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/260 21130
/proc/meminfo: memFree=15417464/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8225116 CPUtime=38098.3 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012182 0 0 0 3808275 1554 0 0 25 0 8 0 526203965 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668709 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 2056279 1989659 466 189 0 2050628 0
[pid=20983/tid=20985] ppid=20981 vsize=8225116 CPUtime=4758.76 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 23807 0 0 0 475842 34 0 0 25 0 8 0 526204191 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=8225116 CPUtime=4764.54 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 165630 0 0 0 476322 132 0 0 25 0 8 0 526204191 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=8225116 CPUtime=4753.9 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 46676 0 0 0 475327 63 0 0 25 0 8 0 526204191 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4653475 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=8225116 CPUtime=4753.25 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 204258 0 0 0 475155 170 0 0 25 0 8 0 526204192 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=8225116 CPUtime=4779.83 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 158134 0 0 0 477880 103 0 0 25 0 8 0 526204192 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=8225116 CPUtime=4765.23 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 73395 0 0 0 476429 94 0 0 25 0 8 0 526204192 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=8225116 CPUtime=4755.13 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 1280731 0 0 0 474598 915 0 0 25 0 8 0 526204192 8422518784 1989659 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670594 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38098.3
Current children cumulated vsize (KiB) 8225116

[startup+4842.3 s]
/proc/loadavg: 8.41 8.13 8.03 9/260 21135
/proc/meminfo: memFree=15415656/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8225116 CPUtime=38576.9 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012183 0 0 0 3856131 1555 0 0 25 0 8 0 526203965 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669200 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 2056279 1989660 466 189 0 2050628 0
[pid=20983/tid=20985] ppid=20981 vsize=8225116 CPUtime=4818.27 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 23807 0 0 0 481793 34 0 0 25 0 8 0 526204191 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4654646 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=8225116 CPUtime=4824.44 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 165631 0 0 0 482312 132 0 0 25 0 8 0 526204191 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=8225116 CPUtime=4813.07 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 46676 0 0 0 481244 63 0 0 25 0 8 0 526204191 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=8225116 CPUtime=4813.25 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 204258 0 0 0 481155 170 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=8225116 CPUtime=4839.83 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 158134 0 0 0 483880 103 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4380234 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=8225116 CPUtime=4825.24 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 73395 0 0 0 482430 94 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4361114 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=8225116 CPUtime=4815.13 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 1280731 0 0 0 480597 916 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38576.9
Current children cumulated vsize (KiB) 8225116

[startup+4902.3 s]
/proc/loadavg: 8.20 8.12 8.03 9/260 21136
/proc/meminfo: memFree=15415968/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8225116 CPUtime=39056.4 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012183 0 0 0 3904083 1555 0 0 25 0 8 0 526203965 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668609 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 2056279 1989660 466 189 0 2050628 0
[pid=20983/tid=20985] ppid=20981 vsize=8225116 CPUtime=4877.79 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 23807 0 0 0 487744 35 0 0 25 0 8 0 526204191 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=8225116 CPUtime=4884.43 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 165631 0 0 0 488311 132 0 0 25 0 8 0 526204191 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=8225116 CPUtime=4873.07 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 46676 0 0 0 487244 63 0 0 25 0 8 0 526204191 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668657 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=8225116 CPUtime=4873.26 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 204258 0 0 0 487156 170 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=8225116 CPUtime=4899.83 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 158134 0 0 0 489880 103 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669443 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=8225116 CPUtime=4885.24 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 73395 0 0 0 488430 94 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=8225116 CPUtime=4875.13 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 1280731 0 0 0 486597 916 0 0 25 0 8 0 526204192 8422518784 1989660 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39056.4
Current children cumulated vsize (KiB) 8225116

[startup+4962.3 s]
/proc/loadavg: 8.16 8.12 8.03 9/260 21138
/proc/meminfo: memFree=15416184/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8225116 CPUtime=39535.9 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012187 0 0 0 3952034 1555 0 0 25 0 8 0 526203965 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 2056279 1989664 466 189 0 2050628 0
[pid=20983/tid=20985] ppid=20981 vsize=8225116 CPUtime=4937.3 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 23807 0 0 0 493695 35 0 0 25 0 8 0 526204191 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=8225116 CPUtime=4944.42 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 165631 0 0 0 494310 132 0 0 25 0 8 0 526204191 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=8225116 CPUtime=4933.08 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 46676 0 0 0 493245 63 0 0 25 0 8 0 526204191 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4660415 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=8225116 CPUtime=4933.26 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 204259 0 0 0 493156 170 0 0 25 0 8 0 526204192 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=8225116 CPUtime=4959.83 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 158134 0 0 0 495880 103 0 0 25 0 8 0 526204192 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4654431 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=8225116 CPUtime=4945.24 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 73398 0 0 0 494430 94 0 0 25 0 8 0 526204192 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4668840 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=8225116 CPUtime=4935.13 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 1280731 0 0 0 492597 916 0 0 25 0 8 0 526204192 8422518784 1989664 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39535.9
Current children cumulated vsize (KiB) 8225116



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5020.41 s]
/proc/loadavg: 8.06 8.10 8.03 9/260 21139
/proc/meminfo: memFree=15415900/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8225116 CPUtime=40000.2 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012205 0 0 0 3998468 1555 0 0 25 0 8 0 526203965 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 2056279 1989682 466 189 0 2050628 0
[pid=20983/tid=20985] ppid=20981 vsize=8225116 CPUtime=4994.84 cores=0-7
/proc/20983/task/20985/stat : 20985 (claspmt) R 20981 20983 20879 0 -1 4202560 23807 0 0 0 499449 35 0 0 25 0 8 0 526204191 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20983/tid=20986] ppid=20981 vsize=8225116 CPUtime=5002.52 cores=0-7
/proc/20983/task/20986/stat : 20986 (claspmt) R 20981 20983 20879 0 -1 4202560 165631 0 0 0 500120 132 0 0 25 0 8 0 526204191 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20983/tid=20987] ppid=20981 vsize=8225116 CPUtime=4991.19 cores=0-7
/proc/20983/task/20987/stat : 20987 (claspmt) R 20981 20983 20879 0 -1 4202560 46676 0 0 0 499056 63 0 0 25 0 8 0 526204191 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20983/tid=20988] ppid=20981 vsize=8225116 CPUtime=4991.38 cores=0-7
/proc/20983/task/20988/stat : 20988 (claspmt) R 20981 20983 20879 0 -1 4202560 204261 0 0 0 498968 170 0 0 25 0 8 0 526204192 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4683929 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20983/tid=20989] ppid=20981 vsize=8225116 CPUtime=5017.95 cores=0-7
/proc/20983/task/20989/stat : 20989 (claspmt) R 20981 20983 20879 0 -1 4202560 158146 0 0 0 501692 103 0 0 25 0 8 0 526204192 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20983/tid=20990] ppid=20981 vsize=8225116 CPUtime=5003.34 cores=0-7
/proc/20983/task/20990/stat : 20990 (claspmt) R 20981 20983 20879 0 -1 4202560 73398 0 0 0 500240 94 0 0 25 0 8 0 526204192 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669309 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20983/tid=20991] ppid=20981 vsize=8225116 CPUtime=4993.25 cores=0-7
/proc/20983/task/20991/stat : 20991 (claspmt) R 20981 20983 20879 0 -1 4202560 1280732 0 0 0 498409 916 0 0 25 0 8 0 526204192 8422518784 1989682 33554432000 4194304 4964704 140734193792384 18446744073709551615 4669391 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 8225116

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5020.6 s]
/proc/loadavg: 8.06 8.10 8.03 9/260 21139
/proc/meminfo: memFree=15415900/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8199864 CPUtime=40000.5 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012215 0 0 0 3998491 1555 0 0 25 0 1 0 526203965 8396660736 1983379 33554432000 4194304 4964704 140734193792384 18446744073709551615 233509954538 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20983/statm: 2049966 1983379 476 189 0 2044315 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 8199864

[startup+5021.4 s]
/proc/loadavg: 8.06 8.10 8.03 2/254 21141
/proc/meminfo: memFree=15510560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=8075044 CPUtime=40001.3 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012215 0 0 0 3998571 1556 0 0 25 0 1 0 526203965 8268845056 1965938 33554432000 4194304 4964704 140734193792384 18446744073709551615 233509952865 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20983/statm: 2018761 1965938 476 189 0 2013110 0
Current children cumulated CPU time (s) 40001.3
Current children cumulated vsize (KiB) 8075044

[startup+5021.8 s]
/proc/loadavg: 8.06 8.10 8.03 2/254 21141
/proc/meminfo: memFree=15510560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=6864300 CPUtime=40001.7 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012215 0 0 0 3998604 1562 0 0 25 0 1 0 526203965 7029043200 1634927 33554432000 4194304 4964704 140734193792384 18446744073709551615 233510340743 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20983/statm: 1716075 1634927 476 189 0 1710424 0
Current children cumulated CPU time (s) 40001.7
Current children cumulated vsize (KiB) 6864300

[startup+5022 s]
/proc/loadavg: 8.06 8.10 8.03 2/254 21141
/proc/meminfo: memFree=15510560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=2660600 CPUtime=40001.9 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202496 2012215 0 0 0 3998604 1582 0 0 25 0 1 0 526203965 2724454400 566482 33554432000 4194304 4964704 140734193792384 18446744073709551615 233510340743 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20983/statm: 665150 565979 476 189 0 659499 0
Current children cumulated CPU time (s) 40001.9
Current children cumulated vsize (KiB) 2660600

[startup+5022.1 s]
/proc/loadavg: 8.06 8.10 8.03 2/254 21141
/proc/meminfo: memFree=15510560/32951124 swapFree=67111524/67111528
[pid=20983] ppid=20981 vsize=0 CPUtime=40002 cores=0-7
/proc/20983/stat : 20983 (claspmt) R 20981 20983 20879 0 -1 4202500 2012216 0 0 0 3998604 1592 0 0 25 0 1 0 526203965 0 0 33554432000 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20983/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40002
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 5022.11
CPU time (s): 40002
CPU user time (s): 39986
CPU system time (s): 15.9296
CPU usage (%): 796.517
Max. virtual memory (cumulated for all children) (KiB): 8225116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39986
system time used= 15.9296
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2012216
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 36509
involuntary context switches= 189843

runsolver used 11.1343 second user time and 29.9484 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-02 14:04:41
IDJOB=3321393
IDBENCH=70815
IDSOLVER=1711
FILE ID=node145/3321393-1304337881
RUNJOBID= node145-1304337555-20893
PBS_JOBID= 13178037
Free space on /tmp= 73696 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxxor/maxxor128.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321393-1304337881/watcher-3321393-1304337881 -o /tmp/evaluation-result-3321393-1304337881/solver-3321393-1304337881 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321393-1304337881.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 065c126f0d55807310a398728b44423f
RANDOM SEED=130895782

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23386840 kB
Buffers:       1319312 kB
Cached:        5800104 kB
SwapCached:          4 kB
Active:        2944052 kB
Inactive:      6063856 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23386840 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           11212 kB
Writeback:           0 kB
AnonPages:     1888336 kB
Mapped:          20400 kB
Slab:           473788 kB
PageTables:      17208 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38154544 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73692 MiB
End job on node145 at 2011-05-02 15:28:24