Trace number 3380990

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.4 5018.72

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n140-s20078956-unsat.cnf
MD5SUM8d05c170d9e6ebfc370bd1d7f7c63d86
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables141
Number of clauses292
Sum of the clauses size876
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3292
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...499115/instance-3380990-1305499115.cnf
0.00/0.00	c Solving...
40000.30/5018.71	
40000.30/5018.71	*** INTERRUPTED! ***
40000.30/5018.71	*** Shutting down threads...
40000.30/5018.72	s UNKNOWN
40000.30/5018.72	
40000.30/5018.72	c INTERRUPTED   : 1
40000.30/5018.72	c Models        : 0+    
40000.30/5018.72	c Time          : 5018.713s (Solving: 5018.71s 1st Model: 0.00s Unsat: 0.00s)
40000.30/5018.72	c CPU Time      : 40000.400s

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380990-1305499115/watcher-3380990-1305499115 -o /tmp/evaluation-result-3380990-1305499115/solver-3380990-1305499115 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380990-1305499115.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.14 8.07 8.07 2/305 609
/proc/meminfo: memFree=17752340/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=20872 CPUtime=0 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 436 0 0 0 0 0 0 0 23 0 1 0 661509710 21372928 366 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516495045 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/609/statm: 5218 369 318 189 0 92 0
[pid=609/tid=610] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 42 0 0 0 0 0 0 0 18 0 8 0 661509710 255774720 732 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 27 0 0 0 0 0 0 0 18 0 8 0 661509710 255774720 732 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 24 0 0 0 0 0 0 0 25 0 8 0 661509710 255774720 732 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=613] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 23 0 0 0 0 0 0 0 18 0 8 0 661509710 255774720 732 33554432000 4194304 4964800 140735445818944 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) S 607 609 535 0 -1 4202560 10 0 0 0 0 0 0 0 25 0 8 0 661509710 255774720 732 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939246 0 0 4096 18946 18446604449487457152 0 0 -1 2 0 0 0
[pid=609/tid=615] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 6 0 0 0 0 0 0 0 25 0 8 0 661509710 255774720 732 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516877402 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=616] ppid=607 vsize=249780 CPUtime=0 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) S 607 609 535 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 8 0 661509710 255774720 733 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939246 0 0 4096 18946 18446604449487457152 0 0 -1 0 0 0 0

[startup+0.103665 s]
/proc/loadavg: 8.14 8.07 8.07 2/305 609
/proc/meminfo: memFree=17752340/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=315584 CPUtime=0.69 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 1198 0 0 0 68 1 0 0 18 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670654 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 78896 1123 464 189 0 73245 0
[pid=609/tid=610] ppid=607 vsize=315584 CPUtime=0.09 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 114 0 0 0 9 0 0 0 18 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=315584 CPUtime=0.09 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 96 0 0 0 9 0 0 0 18 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660123 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=315584 CPUtime=0.08 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 48 0 0 0 8 0 0 0 18 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516501506 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=315584 CPUtime=0.09 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 64 0 0 0 9 0 0 0 18 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 4321121 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=315584 CPUtime=0.07 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 45 0 0 0 7 0 0 0 18 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=315584 CPUtime=0.06 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 39 0 0 0 6 0 0 0 25 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 4342154 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=315584 CPUtime=0.08 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 77 0 0 0 8 0 0 0 25 0 8 0 661509710 323158016 1123 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670670 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 315584

[startup+0.200647 s]
/proc/loadavg: 8.14 8.07 8.07 2/305 609
/proc/meminfo: memFree=17752340/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=315856 CPUtime=1.45 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 1414 0 0 0 144 1 0 0 18 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 78964 1339 464 189 0 73313 0
[pid=609/tid=610] ppid=607 vsize=315856 CPUtime=0.19 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 140 0 0 0 19 0 0 0 18 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4684742 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=315856 CPUtime=0.18 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 128 0 0 0 18 0 0 0 18 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4678045 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=315856 CPUtime=0.17 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 64 0 0 0 17 0 0 0 18 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668763 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=315856 CPUtime=0.18 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 89 0 0 0 18 0 0 0 18 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670351 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=315856 CPUtime=0.16 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 56 0 0 0 16 0 0 0 18 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668672 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=315856 CPUtime=0.16 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 55 0 0 0 16 0 0 0 25 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=315856 CPUtime=0.17 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 127 0 0 0 17 0 0 0 25 0 8 0 661509710 323436544 1339 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.45
Current children cumulated vsize (KiB) 315856

[startup+0.300629 s]
/proc/loadavg: 8.14 8.07 8.07 2/305 609
/proc/meminfo: memFree=17752340/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=315856 CPUtime=2.25 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 1547 0 0 0 223 2 0 0 18 0 8 0 661509710 323436544 1472 33554432000 4194304 4964800 140735445818944 18446744073709551615 4362184 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 78964 1472 464 189 0 73313 0
[pid=609/tid=610] ppid=607 vsize=315856 CPUtime=0.29 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 171 0 0 0 29 0 0 0 18 0 8 0 661509710 323436544 1472 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=315856 CPUtime=0.28 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 141 0 0 0 28 0 0 0 18 0 8 0 661509710 323436544 1472 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=315856 CPUtime=0.27 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 73 0 0 0 27 0 0 0 18 0 8 0 661509710 323436544 1472 33554432000 4194304 4964800 140735445818944 18446744073709551615 4342228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=315856 CPUtime=0.28 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 105 0 0 0 28 0 0 0 18 0 8 0 661509710 323436544 1472 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516501506 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=315856 CPUtime=0.26 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 58 0 0 0 26 0 0 0 18 0 8 0 661509710 323436544 1472 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660384 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=315856 CPUtime=0.26 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 63 0 0 0 26 0 0 0 25 0 8 0 661509710 323436544 1473 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668725 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=315856 CPUtime=0.27 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 156 0 0 0 27 0 0 0 25 0 8 0 661509710 323436544 1473 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.25
Current children cumulated vsize (KiB) 315856

[startup+0.700557 s]
/proc/loadavg: 8.14 8.07 8.07 2/305 609
/proc/meminfo: memFree=17752340/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=316120 CPUtime=5.44 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 1889 0 0 0 540 4 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 79030 1814 464 189 0 73379 0
[pid=609/tid=610] ppid=607 vsize=316120 CPUtime=0.68 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 238 0 0 0 68 0 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=316120 CPUtime=0.68 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 166 0 0 0 68 0 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4363332 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=316120 CPUtime=0.67 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 84 0 0 0 67 0 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660139 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=316120 CPUtime=0.68 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 139 0 0 0 68 0 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4321088 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=316120 CPUtime=0.65 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 75 0 0 0 65 0 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516501506 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=316120 CPUtime=0.65 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 77 0 0 0 65 0 0 0 25 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670403 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=316120 CPUtime=0.67 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 265 0 0 0 67 0 0 0 18 0 8 0 661509710 323706880 1814 33554432000 4194304 4964800 140735445818944 18446744073709551615 4651488 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.44
Current children cumulated vsize (KiB) 316120

[startup+1.50041 s]
/proc/loadavg: 8.14 8.07 8.07 9/313 617
/proc/meminfo: memFree=17746084/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=381916 CPUtime=11.82 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 2286 0 0 0 1175 7 0 0 18 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668732 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 95479 2211 464 189 0 89828 0
[pid=609/tid=610] ppid=607 vsize=381916 CPUtime=1.48 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 345 0 0 0 147 1 0 0 18 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4627254 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=381916 CPUtime=1.48 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 200 0 0 0 147 1 0 0 19 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4320963 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=381916 CPUtime=1.47 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 90 0 0 0 147 0 0 0 19 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=381916 CPUtime=1.48 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 176 0 0 0 147 1 0 0 18 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=381916 CPUtime=1.45 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 100 0 0 0 145 0 0 0 18 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4326368 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=381916 CPUtime=1.44 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 89 0 0 0 144 0 0 0 18 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660463 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=381916 CPUtime=1.46 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 363 0 0 0 146 0 0 0 19 0 8 0 661509710 391081984 2211 33554432000 4194304 4964800 140735445818944 18446744073709551615 4342154 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.82
Current children cumulated vsize (KiB) 381916

[startup+3.10112 s]
/proc/loadavg: 8.14 8.07 8.07 9/313 617
/proc/meminfo: memFree=17744104/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=382044 CPUtime=24.57 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 2695 0 0 0 2446 11 0 0 20 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 95511 2620 464 189 0 89860 0
[pid=609/tid=610] ppid=607 vsize=382044 CPUtime=3.08 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 462 0 0 0 307 1 0 0 21 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 4324768 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=382044 CPUtime=3.07 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 227 0 0 0 306 1 0 0 19 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=382044 CPUtime=3.07 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 113 0 0 0 306 1 0 0 18 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=382044 CPUtime=3.07 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 203 0 0 0 306 1 0 0 18 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=382044 CPUtime=3.04 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 120 0 0 0 303 1 0 0 21 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=382044 CPUtime=3.02 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 114 0 0 0 302 0 0 0 18 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 4321097 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=382044 CPUtime=3.07 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 460 0 0 0 306 1 0 0 20 0 8 0 661509710 391213056 2620 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.57
Current children cumulated vsize (KiB) 382044

[startup+6.30053 s]
/proc/loadavg: 8.13 8.07 8.07 10/313 617
/proc/meminfo: memFree=17741920/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=382304 CPUtime=50.05 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 3161 0 0 0 4982 23 0 0 18 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516501466 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/609/statm: 95576 3086 464 189 0 89925 0
[pid=609/tid=610] ppid=607 vsize=382304 CPUtime=6.26 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 644 0 0 0 624 2 0 0 19 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 4627257 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=611] ppid=607 vsize=382304 CPUtime=6.26 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 263 0 0 0 623 3 0 0 19 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668763 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=609/tid=612] ppid=607 vsize=382304 CPUtime=6.26 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 132 0 0 0 623 3 0 0 18 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660157 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=382304 CPUtime=6.26 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 230 0 0 0 623 3 0 0 20 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=609/tid=614] ppid=607 vsize=382304 CPUtime=6.23 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 145 0 0 0 621 2 0 0 20 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516525008 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=382304 CPUtime=6.18 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 138 0 0 0 616 2 0 0 18 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 4689125 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=616] ppid=607 vsize=382304 CPUtime=6.26 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 540 0 0 0 624 2 0 0 18 0 8 0 661509710 391479296 3086 33554432000 4194304 4964800 140735445818944 18446744073709551615 4367139 0 0 4096 18946 0 0 0 -1 0 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 8.07 8.08 8.08 9/313 754
/proc/meminfo: memFree=17726176/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=37160.1 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6436 0 0 0 3706113 9896 0 0 19 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 4312148 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6361 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=4646.51 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 463482 1169 0 0 24 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 4637083 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=4645.35 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 463181 1354 0 0 19 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=4647.91 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 463535 1256 0 0 18 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 4627540 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4643.77 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 463067 1310 0 0 20 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516492550 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4638.34 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 224 0 0 0 462524 1310 0 0 19 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 4321013 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4641.74 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 232 0 0 0 462860 1314 0 0 25 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=4648.32 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1558 0 0 0 463746 1086 0 0 25 0 8 0 661509710 460652544 6361 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37160.1
Current children cumulated vsize (KiB) 449856

[startup+4722.3 s]
/proc/loadavg: 8.07 8.07 8.08 9/313 756
/proc/meminfo: memFree=17726132/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=37638.2 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6440 0 0 0 3753795 10030 0 0 18 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4669973 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6365 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=4706.25 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 469440 1185 0 0 20 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516492451 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=4705.24 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 469150 1374 0 0 21 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=4707.84 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 469514 1270 0 0 18 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4703.65 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 469038 1327 0 0 18 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4654559 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4697.68 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 224 0 0 0 468443 1325 0 0 18 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4701.47 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 232 0 0 0 468816 1331 0 0 25 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=4708.09 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1558 0 0 0 469704 1105 0 0 20 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37638.2
Current children cumulated vsize (KiB) 449856

[startup+4782.3 s]
/proc/loadavg: 8.11 8.09 8.08 9/313 758
/proc/meminfo: memFree=17726100/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=38116.3 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6440 0 0 0 3801482 10149 0 0 19 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4627509 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6365 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=4765.96 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 475395 1201 0 0 19 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4669973 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=4764.62 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 475071 1391 0 0 19 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660390 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=4767.75 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 475493 1282 0 0 25 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4763.52 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 475009 1343 0 0 19 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4757.49 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 224 0 0 0 474409 1340 0 0 18 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4668611 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4761.21 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 232 0 0 0 474774 1347 0 0 19 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4332324 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=4767.79 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1558 0 0 0 475658 1121 0 0 20 0 8 0 661509710 460652544 6365 33554432000 4194304 4964800 140735445818944 18446744073709551615 4366763 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38116.3
Current children cumulated vsize (KiB) 449856

[startup+4842.31 s]
/proc/loadavg: 8.12 8.10 8.08 9/313 759
/proc/meminfo: memFree=17726080/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=38594.5 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6446 0 0 0 3849175 10274 0 0 19 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670295 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6371 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=4825.68 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 481353 1215 0 0 20 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670155 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=4824.38 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 481031 1407 0 0 22 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=4827.67 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 481471 1296 0 0 25 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660114 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4823.18 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 480957 1361 0 0 19 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4817.22 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 225 0 0 0 480363 1359 0 0 19 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4820.93 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 232 0 0 0 480731 1362 0 0 18 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=4827.55 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1563 0 0 0 481619 1136 0 0 19 0 8 0 661509710 460652544 6371 33554432000 4194304 4964800 140735445818944 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38594.5
Current children cumulated vsize (KiB) 449856

[startup+4902.3 s]
/proc/loadavg: 8.04 8.08 8.08 9/313 761
/proc/meminfo: memFree=17726044/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=39072.5 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6452 0 0 0 3896859 10393 0 0 20 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670190 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6377 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=4885.42 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 487314 1228 0 0 22 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=4884.24 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 487001 1423 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=4887.39 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 487429 1310 0 0 22 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4653144 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4883.05 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 486930 1375 0 0 20 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4658592 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4876.81 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 225 0 0 0 486306 1375 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4321002 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4880.58 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 234 0 0 0 486679 1379 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4669272 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=4887.28 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1563 0 0 0 487576 1152 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39072.5
Current children cumulated vsize (KiB) 449856

[startup+4962.3 s]
/proc/loadavg: 8.09 8.09 8.08 9/313 771
/proc/meminfo: memFree=17725620/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=39550.7 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6452 0 0 0 3944559 10513 0 0 22 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4628033 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6377 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=4945.18 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 493277 1241 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=4944.08 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 492968 1440 0 0 19 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=4946.89 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 493364 1325 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4942.78 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 492886 1392 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4660572 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4936.58 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 225 0 0 0 492265 1393 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4940.48 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 234 0 0 0 492657 1391 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=4947.05 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1563 0 0 0 493540 1165 0 0 20 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39550.7
Current children cumulated vsize (KiB) 449856



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5018.7 s]
/proc/loadavg: 8.08 8.08 8.08 9/313 773
/proc/meminfo: memFree=17725872/32951124 swapFree=54450792/67111528
[pid=609] ppid=607 vsize=449856 CPUtime=40000.3 cores=0-7
/proc/609/stat : 609 (claspmt) R 607 609 535 0 -1 4202496 6452 0 0 0 3989398 10632 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/609/statm: 112464 6377 468 189 0 106813 0
[pid=609/tid=610] ppid=607 vsize=449856 CPUtime=5001.35 cores=0-7
/proc/609/task/610/stat : 610 (claspmt) R 607 609 535 0 -1 4202560 1753 0 0 0 498879 1256 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4364724 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=609/tid=611] ppid=607 vsize=449856 CPUtime=5000.26 cores=0-7
/proc/609/task/611/stat : 611 (claspmt) R 607 609 535 0 -1 4202560 368 0 0 0 498571 1455 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=609/tid=612] ppid=607 vsize=449856 CPUtime=5003.22 cores=0-7
/proc/609/task/612/stat : 612 (claspmt) R 607 609 535 0 -1 4202560 184 0 0 0 498981 1341 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=609/tid=613] ppid=607 vsize=449856 CPUtime=4998.57 cores=0-7
/proc/609/task/613/stat : 613 (claspmt) R 607 609 535 0 -1 4202560 309 0 0 0 498448 1409 0 0 25 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670678 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=609/tid=614] ppid=607 vsize=449856 CPUtime=4992.89 cores=0-7
/proc/609/task/614/stat : 614 (claspmt) R 607 609 535 0 -1 4202560 225 0 0 0 497882 1407 0 0 19 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=609/tid=615] ppid=607 vsize=449856 CPUtime=4996.8 cores=0-7
/proc/609/task/615/stat : 615 (claspmt) R 607 609 535 0 -1 4202560 234 0 0 0 498274 1406 0 0 18 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 4362864 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=609/tid=616] ppid=607 vsize=449856 CPUtime=5003.26 cores=0-7
/proc/609/task/616/stat : 616 (claspmt) R 607 609 535 0 -1 4202560 1563 0 0 0 499147 1179 0 0 21 0 8 0 661509710 460652544 6377 33554432000 4194304 4964800 140735445818944 18446744073709551615 47253833784912 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 449856

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5018.72
CPU time (s): 40000.4
CPU user time (s): 39894.1
CPU system time (s): 106.331
CPU usage (%): 797.024
Max. virtual memory (cumulated for all children) (KiB): 449856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39894.1
system time used= 106.331
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6464
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17442533
involuntary context switches= 337330

runsolver used 13.7589 second user time and 32.1601 second system time

The end

Launcher Data

Begin job on node134 at 2011-05-16 00:38:35
IDJOB=3380990
IDBENCH=83150
IDSOLVER=1865
FILE ID=node134/3380990-1305499115
RUNJOBID= node134-1305498956-549
PBS_JOBID= 13325448
Free space on /tmp= 73488 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n140-s20078956-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380990-1305499115/watcher-3380990-1305499115 -o /tmp/evaluation-result-3380990-1305499115/solver-3380990-1305499115 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380990-1305499115.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 8d05c170d9e6ebfc370bd1d7f7c63d86
RANDOM SEED=267490717

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17752620 kB
Buffers:        108772 kB
Cached:         491576 kB
SwapCached:      16428 kB
Active:        4008868 kB
Inactive:     10963336 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17752620 kB
SwapTotal:    67111528 kB
SwapFree:     54450792 kB
Dirty:             756 kB
Writeback:           0 kB
AnonPages:    14363164 kB
Mapped:          14036 kB
Slab:            89820 kB
PageTables:      72452 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 59409524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node134 at 2011-05-16 02:02:16