Trace number 3380988

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.3 5018.62

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n130-s30940966-unsat.cnf
MD5SUMca44a78076b8228fbb99ecc0147f157f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of clauses276
Sum of the clauses size828
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3276
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...499114/instance-3380988-1305499114.cnf
0.00/0.00	c Solving...
40000.19/5018.61	
40000.19/5018.61	*** INTERRUPTED! ***
40000.19/5018.61	*** Shutting down threads...
40000.19/5018.62	s UNKNOWN
40000.19/5018.62	
40000.19/5018.62	c INTERRUPTED   : 1
40000.19/5018.62	c Models        : 0+    
40000.19/5018.62	c Time          : 5018.615s (Solving: 5018.61s 1st Model: 0.00s Unsat: 0.00s)
40000.19/5018.62	c CPU Time      : 40000.240s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380988-1305499114/watcher-3380988-1305499114 -o /tmp/evaluation-result-3380988-1305499114/solver-3380988-1305499114 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380988-1305499114.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.06 8.00 1/345 30052
/proc/meminfo: memFree=13515832/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=315424 CPUtime=0.02 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 844 0 0 0 2 0 0 0 25 0 8 0 661510204 322994176 771 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971630 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 78856 771 464 189 0 73205 0
[pid=30052/tid=30053] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 50 0 0 0 0 0 0 0 25 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 28 0 0 0 0 0 0 0 25 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 22 0 0 0 0 0 0 0 25 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971630 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 19 0 0 0 0 0 0 0 25 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 18 0 0 0 0 0 0 0 25 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 4324956 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 22 0 0 0 0 0 0 0 17 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=315424 CPUtime=0 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 80 0 0 0 0 0 0 0 25 0 8 0 661510204 322994176 785 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660435 0 0 4096 18946 0 0 0 -1 2 0 0 0

[startup+0.060929 s]
/proc/loadavg: 8.07 8.06 8.00 1/345 30052
/proc/meminfo: memFree=13515832/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=315556 CPUtime=0.39 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 1055 0 0 0 39 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594533890 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 78889 982 464 189 0 73238 0
[pid=30052/tid=30053] ppid=30050 vsize=315556 CPUtime=0.04 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 72 0 0 0 4 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 4362240 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=315556 CPUtime=0.05 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 63 0 0 0 5 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=315556 CPUtime=0.04 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 29 0 0 0 4 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=315556 CPUtime=0.05 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 35 0 0 0 5 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=315556 CPUtime=0.04 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 31 0 0 0 4 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=315556 CPUtime=0.05 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 43 0 0 0 5 0 0 0 18 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=315556 CPUtime=0.05 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 126 0 0 0 5 0 0 0 25 0 8 0 661510204 323129344 982 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670378 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 315556

[startup+0.100921 s]
/proc/loadavg: 8.07 8.06 8.00 1/345 30052
/proc/meminfo: memFree=13515832/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=315556 CPUtime=0.7 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 1177 0 0 0 70 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670412 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 78889 1104 464 189 0 73238 0
[pid=30052/tid=30053] ppid=30050 vsize=315556 CPUtime=0.07 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 96 0 0 0 7 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=315556 CPUtime=0.09 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 81 0 0 0 9 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=315556 CPUtime=0.07 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 41 0 0 0 7 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=315556 CPUtime=0.08 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 54 0 0 0 8 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=315556 CPUtime=0.08 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 37 0 0 0 8 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 4369958 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=315556 CPUtime=0.08 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 49 0 0 0 8 0 0 0 18 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=315556 CPUtime=0.09 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 145 0 0 0 9 0 0 0 25 0 8 0 661510204 323129344 1104 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 315556

[startup+0.300886 s]
/proc/loadavg: 8.07 8.06 8.00 1/345 30052
/proc/meminfo: memFree=13515832/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=315820 CPUtime=2.29 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 1532 0 0 0 228 1 0 0 25 0 8 0 661510204 323399680 1459 33554432000 4194304 4964800 140734026103232 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 78955 1459 464 189 0 73304 0
[pid=30052/tid=30053] ppid=30050 vsize=315820 CPUtime=0.27 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 169 0 0 0 27 0 0 0 18 0 8 0 661510204 323399680 1459 33554432000 4194304 4964800 140734026103232 18446744073709551615 4338784 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=315820 CPUtime=0.28 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 121 0 0 0 28 0 0 0 25 0 8 0 661510204 323399680 1459 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=315820 CPUtime=0.27 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 62 0 0 0 27 0 0 0 18 0 8 0 661510204 323399680 1459 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670905 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=315820 CPUtime=0.28 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 94 0 0 0 28 0 0 0 25 0 8 0 661510204 323399680 1459 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=315820 CPUtime=0.28 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 51 0 0 0 28 0 0 0 25 0 8 0 661510204 323399680 1459 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660130 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=315820 CPUtime=0.28 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 66 0 0 0 28 0 0 0 18 0 8 0 661510204 323399680 1460 33554432000 4194304 4964800 140734026103232 18446744073709551615 4653311 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=315820 CPUtime=0.29 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 232 0 0 0 29 0 0 0 25 0 8 0 661510204 323399680 1460 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594527429 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.29
Current children cumulated vsize (KiB) 315820

[startup+0.700816 s]
/proc/loadavg: 8.07 8.06 8.00 1/345 30052
/proc/meminfo: memFree=13515832/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=316084 CPUtime=5.49 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 1832 0 0 0 545 4 0 0 25 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 4659398 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 79021 1759 464 189 0 73370 0
[pid=30052/tid=30053] ppid=30050 vsize=316084 CPUtime=0.67 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 231 0 0 0 67 0 0 0 18 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=316084 CPUtime=0.68 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 157 0 0 0 67 1 0 0 25 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 4326417 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=316084 CPUtime=0.67 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 70 0 0 0 67 0 0 0 18 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=316084 CPUtime=0.68 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 123 0 0 0 68 0 0 0 25 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=316084 CPUtime=0.68 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 58 0 0 0 68 0 0 0 25 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668725 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=316084 CPUtime=0.68 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 77 0 0 0 68 0 0 0 18 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=316084 CPUtime=0.68 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 328 0 0 0 68 0 0 0 25 0 8 0 661510204 323670016 1759 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.49
Current children cumulated vsize (KiB) 316084

[startup+1.50067 s]
/proc/loadavg: 8.07 8.06 8.00 9/353 30060
/proc/meminfo: memFree=13510320/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=316348 CPUtime=11.85 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 2142 0 0 0 1177 8 0 0 25 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670343 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 79087 2069 464 189 0 73436 0
[pid=30052/tid=30053] ppid=30050 vsize=316348 CPUtime=1.46 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 313 0 0 0 145 1 0 0 18 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=316348 CPUtime=1.48 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) S 30050 30052 29772 0 -1 4202560 190 0 0 0 147 1 0 0 25 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971630 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=316348 CPUtime=1.46 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 77 0 0 0 146 0 0 0 19 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=316348 CPUtime=1.47 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 141 0 0 0 147 0 0 0 18 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=316348 CPUtime=1.46 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 62 0 0 0 146 0 0 0 18 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 4370269 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=316348 CPUtime=1.47 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 86 0 0 0 147 0 0 0 18 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 4363366 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=316348 CPUtime=1.48 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 398 0 0 0 147 1 0 0 25 0 8 0 661510204 323940352 2069 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594971679 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.85
Current children cumulated vsize (KiB) 316348

[startup+3.10039 s]
/proc/loadavg: 8.07 8.06 8.00 9/353 30060
/proc/meminfo: memFree=13507964/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=382148 CPUtime=24.59 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 2553 0 0 0 2443 16 0 0 25 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660442 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 95537 2480 464 189 0 89886 0
[pid=30052/tid=30053] ppid=30050 vsize=382148 CPUtime=3.04 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 425 0 0 0 303 1 0 0 19 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=382148 CPUtime=3.06 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 229 0 0 0 304 2 0 0 18 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668732 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=382148 CPUtime=3.07 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 94 0 0 0 305 2 0 0 18 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4332113 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=382148 CPUtime=3.08 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 171 0 0 0 306 2 0 0 18 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4334279 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=382148 CPUtime=3.05 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 76 0 0 0 303 2 0 0 21 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660557 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=382148 CPUtime=3.06 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 103 0 0 0 305 1 0 0 18 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342149 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=382148 CPUtime=3.07 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 508 0 0 0 305 2 0 0 25 0 8 0 661510204 391319552 2480 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342167 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.59
Current children cumulated vsize (KiB) 382148

[startup+6.30083 s]
/proc/loadavg: 8.07 8.06 8.00 9/353 30060
/proc/meminfo: memFree=13506548/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=382280 CPUtime=50.09 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 2914 0 0 0 4981 28 0 0 19 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4651371 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30052/statm: 95570 2841 464 189 0 89919 0
[pid=30052/tid=30053] ppid=30050 vsize=382280 CPUtime=6.23 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 550 0 0 0 621 2 0 0 18 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4364717 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=382280 CPUtime=6.25 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 244 0 0 0 621 4 0 0 18 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=382280 CPUtime=6.26 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 103 0 0 0 623 3 0 0 25 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670546 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=382280 CPUtime=6.28 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 184 0 0 0 624 4 0 0 19 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670259 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=382280 CPUtime=6.2 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 94 0 0 0 617 3 0 0 23 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668672 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=382280 CPUtime=6.26 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 114 0 0 0 623 3 0 0 18 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4332641 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=382280 CPUtime=6.26 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 602 0 0 0 623 3 0 0 18 0 8 0 661510204 391454720 2841 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 8.04 8.04 8.00 9/353 30213
/proc/meminfo: memFree=13490428/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=37159.1 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5736 0 0 0 3703022 12890 0 0 18 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4653216 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/30052/statm: 112421 5663 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=4648.42 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1742 0 0 0 463504 1338 0 0 19 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4642.74 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 327 0 0 0 462508 1766 0 0 25 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660155 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4641.52 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 462411 1741 0 0 23 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4644.95 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 233 0 0 0 462732 1763 0 0 19 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4645.19 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 462782 1737 0 0 25 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4643.19 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 462564 1755 0 0 25 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=4646.84 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 463153 1531 0 0 18 0 8 0 661510204 460476416 5663 33554432000 4194304 4964800 140734026103232 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37159.1
Current children cumulated vsize (KiB) 449684

[startup+4722.31 s]
/proc/loadavg: 8.01 8.03 8.00 9/353 30215
/proc/meminfo: memFree=13490516/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=37637.6 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5739 0 0 0 3750728 13035 0 0 25 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4312137 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/30052/statm: 112421 5666 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=4708.37 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1742 0 0 0 469485 1352 0 0 25 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670546 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4702.56 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 327 0 0 0 468466 1790 0 0 20 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4700.8 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 468321 1759 0 0 25 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660449 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4704.79 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 233 0 0 0 468699 1780 0 0 18 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670658 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4705.13 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 468756 1757 0 0 18 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4703.03 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 468529 1774 0 0 18 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=4706.75 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 469127 1548 0 0 25 0 8 0 661510204 460476416 5666 33554432000 4194304 4964800 140734026103232 18446744073709551615 4365981 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37637.6
Current children cumulated vsize (KiB) 449684

[startup+4782.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/353 30217
/proc/meminfo: memFree=13490464/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=38115.9 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5740 0 0 0 3798406 13187 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4321076 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/30052/statm: 112421 5667 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=4768.32 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1743 0 0 0 475465 1367 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4362080 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4762.35 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 327 0 0 0 474423 1812 0 0 19 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4342186 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4760.66 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 474289 1777 0 0 18 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670147 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4764.6 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 233 0 0 0 474658 1802 0 0 18 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660064 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4764.74 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 474698 1776 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4654437 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4762.84 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 474487 1797 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4661184 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=4766.66 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 475099 1567 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38115.9
Current children cumulated vsize (KiB) 449684

[startup+4842.3 s]
/proc/loadavg: 7.94 8.01 7.99 9/353 30219
/proc/meminfo: memFree=13490536/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=38594.4 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5740 0 0 0 3846113 13325 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4362488 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/30052/statm: 112421 5667 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=4828.27 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1743 0 0 0 481447 1380 0 0 19 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4822.14 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 327 0 0 0 480380 1834 0 0 19 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594521803 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4820.24 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 480229 1795 0 0 18 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660163 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4824.44 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 233 0 0 0 480625 1819 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4824.47 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 480653 1794 0 0 19 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4822.7 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 480454 1816 0 0 18 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4627299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=4826.57 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 481073 1584 0 0 25 0 8 0 661510204 460476416 5667 33554432000 4194304 4964800 140734026103232 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38594.4
Current children cumulated vsize (KiB) 449684

[startup+4902.3 s]
/proc/loadavg: 7.98 8.00 7.99 9/353 30221
/proc/meminfo: memFree=13490368/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=39072.8 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5749 0 0 0 3893807 13475 0 0 22 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/30052/statm: 112421 5676 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=4888.22 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1744 0 0 0 487429 1393 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4654540 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4881.94 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 328 0 0 0 486338 1856 0 0 22 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4879.51 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 486134 1817 0 0 18 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4884.3 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 240 0 0 0 486592 1838 0 0 21 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668851 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4884.39 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 486622 1817 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4882.52 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 486418 1834 0 0 19 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4321093 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=4886.49 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 487046 1603 0 0 21 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4345261 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39072.8
Current children cumulated vsize (KiB) 449684

[startup+4962.3 s]
/proc/loadavg: 7.99 8.00 7.99 9/353 30233
/proc/meminfo: memFree=13488696/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=39551.2 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5749 0 0 0 3941496 13623 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/30052/statm: 112421 5676 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=4948.18 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1744 0 0 0 493413 1405 0 0 22 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4941.69 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 328 0 0 0 492293 1876 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4939.44 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 492107 1837 0 0 18 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4944.15 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 240 0 0 0 492555 1860 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4362377 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4943.62 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 492525 1837 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4325321 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4942.37 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 492383 1854 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=4946.39 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 493018 1621 0 0 18 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39551.2
Current children cumulated vsize (KiB) 449684



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5018.6 s]
/proc/loadavg: 7.99 8.00 7.99 9/353 30235
/proc/meminfo: memFree=13488760/32950928 swapFree=54713408/67111528
[pid=30052] ppid=30050 vsize=449684 CPUtime=40000.2 cores=0-7
/proc/30052/stat : 30052 (claspmt) R 30050 30052 29772 0 -1 4202496 5749 0 0 0 3986258 13761 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670282 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/30052/statm: 112421 5676 468 189 0 106770 0
[pid=30052/tid=30053] ppid=30050 vsize=449684 CPUtime=5004.45 cores=0-7
/proc/30052/task/30053/stat : 30053 (claspmt) R 30050 30052 29772 0 -1 4202560 1744 0 0 0 499027 1418 0 0 19 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30052/tid=30054] ppid=30050 vsize=449684 CPUtime=4997.82 cores=0-7
/proc/30052/task/30054/stat : 30054 (claspmt) R 30050 30052 29772 0 -1 4202560 328 0 0 0 497886 1896 0 0 18 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4660139 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30052/tid=30055] ppid=30050 vsize=449684 CPUtime=4995.7 cores=0-7
/proc/30052/task/30055/stat : 30055 (claspmt) R 30050 30052 29772 0 -1 4202560 150 0 0 0 497714 1856 0 0 18 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=30052/tid=30056] ppid=30050 vsize=449684 CPUtime=4999.77 cores=0-7
/proc/30052/task/30056/stat : 30056 (claspmt) R 30050 30052 29772 0 -1 4202560 240 0 0 0 498099 1878 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 235594533890 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30052/tid=30057] ppid=30050 vsize=449684 CPUtime=4999.74 cores=0-7
/proc/30052/task/30057/stat : 30057 (claspmt) R 30050 30052 29772 0 -1 4202560 154 0 0 0 498119 1855 0 0 18 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4379983 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30052/tid=30058] ppid=30050 vsize=449684 CPUtime=4998.54 cores=0-7
/proc/30052/task/30058/stat : 30058 (claspmt) R 30050 30052 29772 0 -1 4202560 195 0 0 0 497982 1872 0 0 19 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30052/tid=30059] ppid=30050 vsize=449684 CPUtime=5002.61 cores=0-7
/proc/30052/task/30059/stat : 30059 (claspmt) R 30050 30052 29772 0 -1 4202560 1373 0 0 0 498623 1638 0 0 25 0 8 0 661510204 460476416 5676 33554432000 4194304 4964800 140734026103232 18446744073709551615 4365088 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 449684

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5018.62
CPU time (s): 40000.3
CPU user time (s): 39862.6
CPU system time (s): 137.621
CPU usage (%): 797.037
Max. virtual memory (cumulated for all children) (KiB): 449684

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39862.6
system time used= 137.621
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18813397
involuntary context switches= 185994

runsolver used 16.4105 second user time and 38.3562 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-16 00:38:34
IDJOB=3380988
IDBENCH=83148
IDSOLVER=1865
FILE ID=node120/3380988-1305499114
RUNJOBID= node120-1305493750-29786
PBS_JOBID= 13325429
Free space on /tmp= 73632 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n130-s30940966-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380988-1305499114/watcher-3380988-1305499114 -o /tmp/evaluation-result-3380988-1305499114/solver-3380988-1305499114 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380988-1305499114.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ca44a78076b8228fbb99ecc0147f157f
RANDOM SEED=38387070

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13516236 kB
Buffers:         70692 kB
Cached:         995504 kB
SwapCached:      31880 kB
Active:        6463676 kB
Inactive:     12761344 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13516236 kB
SwapTotal:    67111528 kB
SwapFree:     54713408 kB
Dirty:             796 kB
Writeback:           0 kB
AnonPages:    18133636 kB
Mapped:          19948 kB
Slab:            63616 kB
PageTables:      77504 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 66187184 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73632 MiB
End job on node120 at 2011-05-16 02:02:15