Trace number 3373106

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.15 1203.89

General information on the benchmark

NameCRAFTED/edgematching/
fbcolors/em_8_4_5_fbc.cnf
MD5SUM6fdce6b69c397ad71b0f25957edff1fa
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.41518
Satisfiable
(Un)Satisfiability was proved
Number of variables2420
Number of clauses33572
Sum of the clauses size97252
Maximum clause length36
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 214396
Number of clauses of size 313968
Number of clauses of size 42628
Number of clauses of size 52460
Number of clauses of size over 5120

Solver Data

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...418767/instance-3373106-1305418767.cnf
0.01/0.03	c Solving...
4800.03/1203.81	
4800.03/1203.81	*** INTERRUPTED! ***
4800.03/1203.81	*** Shutting down threads...
4800.03/1203.88	s UNKNOWN
4800.03/1203.88	
4800.03/1203.88	c INTERRUPTED   : 1
4800.03/1203.88	c Models        : 0+    
4800.03/1203.88	c Time          : 1203.817s (Solving: 1203.79s 1st Model: 0.00s Unsat: 0.00s)
4800.03/1203.88	c CPU Time      : 4800.070s

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373106-1305418767/watcher-3373106-1305418767 -o /tmp/evaluation-result-3373106-1305418767/solver-3373106-1305418767 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373106-1305418767.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.70 5.36 6.83 2/351 9620
/proc/meminfo: memFree=17789760/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=21892 CPUtime=0 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 763 0 0 0 0 0 0 0 22 0 1 0 732107337 22417408 675 33554432000 4194304 4964800 140737040789984 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/9620/statm: 5473 675 385 189 0 347 0

[startup+0.0173581 s]
/proc/loadavg: 3.70 5.36 6.83 2/351 9620
/proc/meminfo: memFree=17789760/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=24080 CPUtime=0.01 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 1412 0 0 0 1 0 0 0 22 0 1 0 732107337 24657920 1211 33554432000 4194304 4964800 140737040789984 18446744073709551615 4618011 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/9620/statm: 6020 1212 396 189 0 894 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 24080

[startup+0.100201 s]
/proc/loadavg: 3.70 5.36 6.83 2/351 9620
/proc/meminfo: memFree=17789760/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=171516 CPUtime=0.27 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 2383 0 1 0 27 0 0 0 24 0 4 0 732107337 175632384 2112 33554432000 4194304 4964800 140737040789984 18446744073709551615 256415496455 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 42879 2113 458 189 0 37228 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 171516

[startup+0.371153 s]
/proc/loadavg: 3.70 5.36 6.83 2/351 9620
/proc/meminfo: memFree=17789760/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=174624 CPUtime=1.35 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 4540 0 1 0 134 1 0 0 25 0 4 0 732107337 178814976 4269 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 43656 4269 458 189 0 38005 0
Current children cumulated CPU time (s) 1.35
Current children cumulated vsize (KiB) 174624

[startup+0.701091 s]
/proc/loadavg: 3.70 5.36 6.83 2/351 9620
/proc/meminfo: memFree=17789760/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=176824 CPUtime=2.66 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 6052 0 1 0 265 1 0 0 25 0 4 0 732107337 181067776 5781 33554432000 4194304 4964800 140737040789984 18446744073709551615 4654540 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 44206 5781 458 189 0 38555 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 176824

[startup+1.50094 s]
/proc/loadavg: 3.70 5.36 6.83 10/358 9627
/proc/meminfo: memFree=17743608/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=178508 CPUtime=5.85 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 7688 0 1 0 583 2 0 0 25 0 4 0 732107337 182792192 7417 33554432000 4194304 4964800 140737040789984 18446744073709551615 4660835 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 44627 7418 458 189 0 38976 0
[pid=9620/tid=9622] ppid=9618 vsize=178508 CPUtime=1.45 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 1190 0 0 0 145 0 0 0 20 0 4 0 732107341 182792192 7418 33554432000 4194304 4964800 140737040789984 18446744073709551615 4669476 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=178508 CPUtime=1.45 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 1839 0 0 0 145 0 0 0 20 0 4 0 732107341 182792192 7418 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670530 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=178508 CPUtime=1.44 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 1649 0 0 0 144 0 0 0 25 0 4 0 732107341 182792192 7418 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 178508

[startup+3.10064 s]
/proc/loadavg: 4.04 5.40 6.84 10/358 9627
/proc/meminfo: memFree=17725256/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=181296 CPUtime=12.24 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 9855 0 1 0 1221 3 0 0 25 0 4 0 732107337 185647104 9584 33554432000 4194304 4964800 140737040789984 18446744073709551615 4684104 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 45324 9584 460 189 0 39673 0
[pid=9620/tid=9622] ppid=9618 vsize=181296 CPUtime=3.04 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 1743 0 0 0 304 0 0 0 25 0 4 0 732107341 185647104 9584 33554432000 4194304 4964800 140737040789984 18446744073709551615 4653353 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=181296 CPUtime=3.05 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 2419 0 0 0 305 0 0 0 25 0 4 0 732107341 185647104 9584 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=181296 CPUtime=3.02 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 2195 0 0 0 302 0 0 0 25 0 4 0 732107341 185647104 9584 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321065 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.24
Current children cumulated vsize (KiB) 181296

[startup+6.30103 s]
/proc/loadavg: 4.04 5.40 6.84 9/358 9657
/proc/meminfo: memFree=17707624/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=184392 CPUtime=25 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 11949 0 1 0 2493 7 0 0 25 0 4 0 732107337 188817408 11678 33554432000 4194304 4964800 140737040789984 18446744073709551615 4653536 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 46098 11678 460 189 0 40447 0
[pid=9620/tid=9622] ppid=9618 vsize=184392 CPUtime=6.24 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 2158 0 0 0 624 0 0 0 25 0 4 0 732107341 188817408 11678 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=184392 CPUtime=6.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 3104 0 0 0 623 2 0 0 25 0 4 0 732107341 188817408 11678 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=184392 CPUtime=6.19 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 2703 0 0 0 618 1 0 0 23 0 4 0 732107341 188817408 11678 33554432000 4194304 4964800 140737040789984 18446744073709551615 4669093 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25
Current children cumulated vsize (KiB) 184392

[startup+12.7008 s]
/proc/loadavg: 4.65 5.49 6.85 9/358 9657
/proc/meminfo: memFree=17672420/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=189804 CPUtime=50.52 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 16183 0 1 0 5043 9 0 0 25 0 4 0 732107337 194359296 15912 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670371 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 47451 15912 460 189 0 41800 0
[pid=9620/tid=9622] ppid=9618 vsize=189804 CPUtime=12.64 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 3436 0 0 0 1263 1 0 0 25 0 4 0 732107341 194359296 15912 33554432000 4194304 4964800 140737040789984 18446744073709551615 4652167 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=189804 CPUtime=12.65 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 4089 0 0 0 1262 3 0 0 25 0 4 0 732107341 194359296 15912 33554432000 4194304 4964800 140737040789984 18446744073709551615 4361367 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=189804 CPUtime=12.51 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 3863 0 0 0 1250 1 0 0 25 0 4 0 732107341 194359296 15912 33554432000 4194304 4964800 140737040789984 18446744073709551615 47267184758757 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.52
Current children cumulated vsize (KiB) 189804

[startup+25.5004 s]
/proc/loadavg: 5.17 5.57 6.86 9/358 9657
/proc/meminfo: memFree=17612892/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=207104 CPUtime=101.57 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 27597 0 1 0 10143 14 0 0 25 0 4 0 732107337 212074496 27205 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 51776 27205 460 189 0 46125 0
[pid=9620/tid=9622] ppid=9618 vsize=207104 CPUtime=25.44 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 6485 0 0 0 2541 3 0 0 25 0 4 0 732107341 212074496 27205 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=207104 CPUtime=25.45 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 7352 0 0 0 2541 4 0 0 25 0 4 0 732107341 212074496 27205 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321076 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=207104 CPUtime=25.17 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 5792 0 0 0 2515 2 0 0 25 0 4 0 732107341 212074496 27205 33554432000 4194304 4964800 140737040789984 18446744073709551615 4653595 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.57
Current children cumulated vsize (KiB) 207104

[startup+51.1006 s]
/proc/loadavg: 6.13 5.76 6.89 9/358 9658
/proc/meminfo: memFree=17529904/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=283812 CPUtime=203.67 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 43799 0 1 0 20342 25 0 0 25 0 4 0 732107337 290623488 43226 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668636 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 70953 43226 460 189 0 65302 0
[pid=9620/tid=9622] ppid=9618 vsize=283812 CPUtime=51.03 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 8149 0 0 0 5099 4 0 0 25 0 4 0 732107341 290623488 43226 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=283812 CPUtime=51.05 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 13646 0 0 0 5096 9 0 0 25 0 4 0 732107341 290623488 43226 33554432000 4194304 4964800 140737040789984 18446744073709551615 4654540 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=283812 CPUtime=50.49 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 7494 0 0 0 5046 3 0 0 25 0 4 0 732107341 290623488 43226 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.67
Current children cumulated vsize (KiB) 283812

[startup+102.314 s]
/proc/loadavg: 7.30 6.15 6.96 9/358 9659
/proc/meminfo: memFree=17438376/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=353928 CPUtime=407.93 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 60375 0 1 0 40755 38 0 0 25 0 4 0 732107337 362422272 59785 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670330 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 88482 59785 460 189 0 82831 0
[pid=9620/tid=9622] ppid=9618 vsize=353928 CPUtime=102.23 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 11192 0 0 0 10217 6 0 0 25 0 4 0 732107341 362422272 59785 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=353928 CPUtime=102.27 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 19579 0 0 0 10213 14 0 0 25 0 4 0 732107341 362422272 59785 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=353928 CPUtime=101.13 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 10339 0 0 0 10108 5 0 0 25 0 4 0 732107341 362422272 59785 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.93
Current children cumulated vsize (KiB) 353928

[startup+162.301 s]
/proc/loadavg: 7.46 6.41 6.99 9/358 9721
/proc/meminfo: memFree=17240520/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=423600 CPUtime=647.16 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 74101 0 1 0 64661 55 0 0 25 0 4 0 732107337 433766400 73466 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 105900 73466 460 189 0 100249 0
[pid=9620/tid=9622] ppid=9618 vsize=423600 CPUtime=162.2 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 12615 0 0 0 16213 7 0 0 25 0 4 0 732107341 433766400 73466 33554432000 4194304 4964800 140737040789984 18446744073709551615 256415058821 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=423600 CPUtime=162.24 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 26076 0 0 0 16198 26 0 0 25 0 4 0 732107341 433766400 73466 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668789 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=423600 CPUtime=160.44 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 10535 0 0 0 16038 6 0 0 25 0 4 0 732107341 433766400 73466 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670368 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.16
Current children cumulated vsize (KiB) 423600

[startup+222.3 s]
/proc/loadavg: 7.83 6.71 7.06 9/358 9723
/proc/meminfo: memFree=17153252/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=449796 CPUtime=886.43 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 81008 0 1 0 88584 59 0 0 25 0 4 0 732107337 460591104 80373 33554432000 4194304 4964800 140737040789984 18446744073709551615 4669507 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 112449 80373 460 189 0 106798 0
[pid=9620/tid=9622] ppid=9618 vsize=449796 CPUtime=222.19 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 12781 0 0 0 22212 7 0 0 25 0 4 0 732107341 460591104 80373 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=449796 CPUtime=222.24 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 30063 0 0 0 22196 28 0 0 25 0 4 0 732107341 460591104 80373 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=449796 CPUtime=219.73 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 10734 0 0 0 21967 6 0 0 25 0 4 0 732107341 460591104 80373 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 886.43
Current children cumulated vsize (KiB) 449796

[startup+282.301 s]

################
# More data... #
################

[pid=9620] ppid=9618 vsize=548168 CPUtime=2561.49 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 108966 0 1 0 256067 82 0 0 25 0 4 0 732107337 561324032 108270 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668728 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 137042 108270 460 189 0 131391 0
[pid=9620/tid=9622] ppid=9618 vsize=548168 CPUtime=637.89 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 13467 0 0 0 63780 9 0 0 25 0 4 0 732107341 561324032 108270 33554432000 4194304 4964800 140737040789984 18446744073709551615 4654668 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=548168 CPUtime=642.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 43451 0 0 0 64188 37 0 0 25 0 4 0 732107341 561324032 108270 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=548168 CPUtime=639.15 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 22867 0 0 0 63899 16 0 0 25 0 4 0 732107341 561324032 108270 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668946 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2561.49
Current children cumulated vsize (KiB) 548168

[startup+702.301 s]
/proc/loadavg: 8.07 7.83 7.48 9/358 9735
/proc/meminfo: memFree=16328512/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=548168 CPUtime=2800.75 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 113427 0 1 0 279987 88 0 0 25 0 4 0 732107337 561324032 112710 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321016 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 137042 112710 460 189 0 131391 0
[pid=9620/tid=9622] ppid=9618 vsize=548168 CPUtime=697.18 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 13473 0 0 0 69709 9 0 0 25 0 4 0 732107341 561324032 112710 33554432000 4194304 4964800 140737040789984 18446744073709551615 4669413 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=548168 CPUtime=702.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 44055 0 0 0 70187 38 0 0 25 0 4 0 732107341 561324032 112710 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=548168 CPUtime=699.13 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 26634 0 0 0 69893 20 0 0 25 0 4 0 732107341 561324032 112710 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800.75
Current children cumulated vsize (KiB) 548168

[startup+762.313 s]
/proc/loadavg: 8.07 7.87 7.51 9/358 9737
/proc/meminfo: memFree=16254932/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=548168 CPUtime=3040.1 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 116949 0 1 0 303917 93 0 0 25 0 4 0 732107337 561324032 116192 33554432000 4194304 4964800 140737040789984 18446744073709551615 4324858 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 137042 116192 460 189 0 131391 0
[pid=9620/tid=9622] ppid=9618 vsize=548168 CPUtime=756.5 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 13545 0 0 0 75641 9 0 0 25 0 4 0 732107341 561324032 116192 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=548168 CPUtime=762.26 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 44169 0 0 0 76188 38 0 0 25 0 4 0 732107341 561324032 116192 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=548168 CPUtime=759.15 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27432 0 0 0 75893 22 0 0 25 0 4 0 732107341 561324032 116192 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3040.1
Current children cumulated vsize (KiB) 548168

[startup+822.301 s]
/proc/loadavg: 8.10 7.91 7.55 9/358 9739
/proc/meminfo: memFree=16074100/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=679240 CPUtime=3279.34 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 137738 0 1 0 327822 112 0 0 25 0 4 0 732107337 695541760 136967 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 169810 136967 460 189 0 164159 0
[pid=9620/tid=9622] ppid=9618 vsize=679240 CPUtime=815.79 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 13553 0 0 0 81569 10 0 0 25 0 4 0 732107341 695541760 136967 33554432000 4194304 4964800 140737040789984 18446744073709551615 4654549 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=679240 CPUtime=822.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 53446 0 0 0 82177 48 0 0 25 0 4 0 732107341 695541760 136967 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=679240 CPUtime=819.14 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27448 0 0 0 81892 22 0 0 25 0 4 0 732107341 695541760 136967 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3279.34
Current children cumulated vsize (KiB) 679240

[startup+882.301 s]
/proc/loadavg: 8.15 7.96 7.58 9/358 9740
/proc/meminfo: memFree=15975112/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=744776 CPUtime=3518.62 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 145988 0 1 0 351742 120 0 0 25 0 4 0 732107337 762650624 145177 33554432000 4194304 4964800 140737040789984 18446744073709551615 4651391 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 186194 145177 460 189 0 180543 0
[pid=9620/tid=9622] ppid=9618 vsize=744776 CPUtime=875.07 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 14331 0 0 0 87497 10 0 0 25 0 4 0 732107341 762650624 145177 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=744776 CPUtime=882.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 60887 0 0 0 88170 55 0 0 25 0 4 0 732107341 762650624 145177 33554432000 4194304 4964800 140737040789984 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=744776 CPUtime=879.14 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27449 0 0 0 87892 22 0 0 25 0 4 0 732107341 762650624 145177 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3518.62
Current children cumulated vsize (KiB) 744776

[startup+942.3 s]
/proc/loadavg: 8.16 7.99 7.61 9/358 9742
/proc/meminfo: memFree=15849460/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=767220 CPUtime=3757.91 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 156497 0 1 0 375664 127 0 0 25 0 4 0 732107337 785633280 155670 33554432000 4194304 4964800 140737040789984 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 191805 155670 460 189 0 186154 0
[pid=9620/tid=9622] ppid=9618 vsize=767220 CPUtime=934.39 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 19027 0 0 0 93426 13 0 0 25 0 4 0 732107341 785633280 155670 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=767220 CPUtime=942.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 62320 0 0 0 94169 56 0 0 25 0 4 0 732107341 785633280 155670 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=767220 CPUtime=939.14 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27706 0 0 0 93892 22 0 0 25 0 4 0 732107341 785633280 155670 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3757.91
Current children cumulated vsize (KiB) 767220

[startup+1002.3 s]
/proc/loadavg: 8.09 8.00 7.64 9/358 9743
/proc/meminfo: memFree=15758384/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=799932 CPUtime=3997.21 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 164615 0 1 0 399590 131 0 0 25 0 4 0 732107337 819130368 163788 33554432000 4194304 4964800 140737040789984 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 199983 163788 460 189 0 194332 0
[pid=9620/tid=9622] ppid=9618 vsize=799932 CPUtime=993.69 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 19363 0 0 0 99356 13 0 0 25 0 4 0 732107341 819130368 163788 33554432000 4194304 4964800 140737040789984 18446744073709551615 4653136 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=799932 CPUtime=1002.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 65639 0 0 0 100168 57 0 0 25 0 4 0 732107341 819130368 163788 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=799932 CPUtime=999.14 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27724 0 0 0 99891 23 0 0 25 0 4 0 732107341 819130368 163788 33554432000 4194304 4964800 140737040789984 18446744073709551615 4653388 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3997.21
Current children cumulated vsize (KiB) 799932

[startup+1062.3 s]
/proc/loadavg: 8.09 8.01 7.66 9/358 9745
/proc/meminfo: memFree=15715316/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=799932 CPUtime=4236.5 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 164635 0 1 0 423519 131 0 0 25 0 4 0 732107337 819130368 163808 33554432000 4194304 4964800 140737040789984 18446744073709551615 4334306 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 199983 163808 460 189 0 194332 0
[pid=9620/tid=9622] ppid=9618 vsize=799932 CPUtime=1052.98 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 19363 0 0 0 105285 13 0 0 25 0 4 0 732107341 819130368 163808 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=799932 CPUtime=1062.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 65647 0 0 0 106168 57 0 0 25 0 4 0 732107341 819130368 163808 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=799932 CPUtime=1059.14 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27729 0 0 0 105891 23 0 0 25 0 4 0 732107341 819130368 163808 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4236.5
Current children cumulated vsize (KiB) 799932

[startup+1122.3 s]
/proc/loadavg: 8.11 8.04 7.69 9/358 9747
/proc/meminfo: memFree=15637012/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=799932 CPUtime=4475.78 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 164643 0 1 0 447446 132 0 0 25 0 4 0 732107337 819130368 163816 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668568 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 199983 163816 460 189 0 194332 0
[pid=9620/tid=9622] ppid=9618 vsize=799932 CPUtime=1112.28 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 19363 0 0 0 111215 13 0 0 25 0 4 0 732107341 819130368 163816 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=799932 CPUtime=1122.25 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 65648 0 0 0 112168 57 0 0 25 0 4 0 732107341 819130368 163816 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=799932 CPUtime=1119.13 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27735 0 0 0 111890 23 0 0 25 0 4 0 732107341 819130368 163816 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4475.78
Current children cumulated vsize (KiB) 799932

[startup+1182.3 s]
/proc/loadavg: 8.20 8.06 7.72 11/359 9751
/proc/meminfo: memFree=15560068/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=799932 CPUtime=4714.75 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 164652 0 1 0 471343 132 0 0 25 0 4 0 732107337 819130368 163824 33554432000 4194304 4964800 140737040789984 18446744073709551615 4342206 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 199983 163824 460 189 0 194332 0
[pid=9620/tid=9622] ppid=9618 vsize=799932 CPUtime=1171.57 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 19363 0 0 0 117144 13 0 0 25 0 4 0 732107341 819130368 163824 33554432000 4194304 4964800 140737040789984 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=799932 CPUtime=1181.95 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 65648 0 0 0 118137 58 0 0 25 0 4 0 732107341 819130368 163824 33554432000 4194304 4964800 140737040789984 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=799932 CPUtime=1179.13 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27737 0 0 0 117890 23 0 0 25 0 4 0 732107341 819130368 163824 33554432000 4194304 4964800 140737040789984 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4714.75
Current children cumulated vsize (KiB) 799932



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.8 s]
/proc/loadavg: 8.38 8.12 7.75 9/358 9752
/proc/meminfo: memFree=15561892/32950928 swapFree=67111200/67111528
[pid=9620] ppid=9618 vsize=799932 CPUtime=4800.03 cores=0,2,4,6
/proc/9620/stat : 9620 (claspmt) R 9618 9620 9118 0 -1 4202496 164655 0 1 0 479871 132 0 0 25 0 4 0 732107337 819130368 163827 33554432000 4194304 4964800 140737040789984 18446744073709551615 4325407 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9620/statm: 199983 163827 460 189 0 194332 0
[pid=9620/tid=9622] ppid=9618 vsize=799932 CPUtime=1192.51 cores=0,2,4,6
/proc/9620/task/9622/stat : 9622 (claspmt) R 9618 9620 9118 0 -1 4202560 19363 0 0 0 119238 13 0 0 25 0 4 0 732107341 819130368 163827 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9620/tid=9623] ppid=9618 vsize=799932 CPUtime=1203.28 cores=0,2,4,6
/proc/9620/task/9623/stat : 9623 (claspmt) R 9618 9620 9118 0 -1 4202560 65649 0 0 0 120270 58 0 0 25 0 4 0 732107341 819130368 163827 33554432000 4194304 4964800 140737040789984 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9620/tid=9624] ppid=9618 vsize=799932 CPUtime=1200.64 cores=0,2,4,6
/proc/9620/task/9624/stat : 9624 (claspmt) R 9618 9620 9118 0 -1 4202560 27739 0 0 0 120041 23 0 0 25 0 4 0 732107341 819130368 163827 33554432000 4194304 4964800 140737040789984 18446744073709551615 4332401 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 799932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1203.89
CPU time (s): 4800.15
CPU user time (s): 4798.8
CPU system time (s): 1.35579
CPU usage (%): 398.72
Max. virtual memory (cumulated for all children) (KiB): 799932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.8
system time used= 1.35579
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 164667
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17258
involuntary context switches= 24667

runsolver used 3.98139 second user time and 9.8525 second system time

The end

Launcher Data

Begin job on node115 at 2011-05-15 02:19:27
IDJOB=3373106
IDBENCH=70930
IDSOLVER=1853
FILE ID=node115/3373106-1305418767
RUNJOBID= node115-1305418766-9600
PBS_JOBID= 13324547
Free space on /tmp= 73232 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/CRAFTED/edgematching/fbcolors/em_8_4_5_fbc.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373106-1305418767/watcher-3373106-1305418767 -o /tmp/evaluation-result-3373106-1305418767/solver-3373106-1305418767 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373106-1305418767.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6fdce6b69c397ad71b0f25957edff1fa
RANDOM SEED=355764287

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17790288 kB
Buffers:        292280 kB
Cached:        4521416 kB
SwapCached:          0 kB
Active:       11974656 kB
Inactive:      2869372 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17790288 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:            3124 kB
Writeback:           0 kB
AnonPages:    10029460 kB
Mapped:          28408 kB
Slab:           211168 kB
PageTables:      40988 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 69679628 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73208 MiB
End job on node115 at 2011-05-15 02:39:33