Trace number 3299584

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.29 1201.83

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/fphp/unsat/
harder/fphp-020-019.shuffled-as.sat05-1232.cnf
MD5SUMabb32bff5eb954e790612a6209864b5d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2.08668
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses7050
Sum of the clauses size14440
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 27030
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...105291/instance-3299584-1304105291.cnf
0.00/0.02	c Solving...
4800.24/1201.81	
4800.24/1201.81	*** INTERRUPTED! ***
4800.24/1201.81	*** Shutting down threads...
4800.24/1201.82	s UNKNOWN
4800.24/1201.82	
4800.24/1201.82	c INTERRUPTED   : 1
4800.24/1201.82	c Models        : 0+    
4800.24/1201.82	c Time          : 1201.809s (Solving: 1201.79s 1st Model: 0.00s Unsat: 0.00s)
4800.24/1201.82	c CPU Time      : 4800.260s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299584-1304105291/watcher-3299584-1304105291 -o /tmp/evaluation-result-3299584-1304105291/solver-3299584-1304105291 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299584-1304105291.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.00 7.86 5/180 29904
/proc/meminfo: memFree=30974812/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=21312 CPUtime=0 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 655 0 0 0 0 0 0 0 25 0 1 0 522125817 21823488 580 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500352709 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29904/statm: 5328 581 396 189 0 202 0

[startup+0.056697 s]
/proc/loadavg: 8.12 8.00 7.86 5/180 29904
/proc/meminfo: memFree=30974812/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=169240 CPUtime=0.14 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 1528 0 0 0 14 0 0 0 25 0 4 0 522125817 173301760 1452 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500796959 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 42409 1803 458 189 0 36758 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 169240

[startup+0.20895 s]
/proc/loadavg: 8.12 8.00 7.86 5/180 29904
/proc/meminfo: memFree=30974812/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=170296 CPUtime=0.75 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 2297 0 0 0 75 0 0 0 25 0 4 0 522125817 174383104 2221 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500796959 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 42574 2221 458 189 0 36923 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 170296

[startup+0.456019 s]
/proc/loadavg: 8.12 8.00 7.86 5/180 29904
/proc/meminfo: memFree=30974812/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=171748 CPUtime=1.74 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 3164 0 0 0 173 1 0 0 25 0 4 0 522125817 175869952 3088 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500796959 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 42937 3088 458 189 0 37286 0
Current children cumulated CPU time (s) 1.74
Current children cumulated vsize (KiB) 171748

[startup+0.870793 s]
/proc/loadavg: 8.12 8.00 7.86 5/180 29904
/proc/meminfo: memFree=30974812/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=172948 CPUtime=3.4 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 4193 0 0 0 339 1 0 0 25 0 4 0 522125817 177098752 4117 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 43237 4117 458 189 0 37586 0
Current children cumulated CPU time (s) 3.4
Current children cumulated vsize (KiB) 172948

[startup+1.50034 s]
/proc/loadavg: 8.12 8.00 7.86 9/184 29908
/proc/meminfo: memFree=30955816/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=173740 CPUtime=5.93 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 5253 0 0 0 591 2 0 0 25 0 4 0 522125817 177909760 5177 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500353057 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 43435 5177 458 189 0 37784 0
[pid=29904/tid=29906] ppid=29902 vsize=173740 CPUtime=1.46 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 1071 0 0 0 146 0 0 0 20 0 4 0 522125819 177909760 5178 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=173740 CPUtime=1.47 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 1311 0 0 0 147 0 0 0 18 0 4 0 522125819 177909760 5178 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500353057 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=173740 CPUtime=1.47 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 1249 0 0 0 147 0 0 0 25 0 4 0 522125819 177909760 5178 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 173740

[startup+3.10102 s]
/proc/loadavg: 8.12 8.00 7.86 9/184 29908
/proc/meminfo: memFree=30946516/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=242220 CPUtime=12.3 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 8017 0 0 0 1228 2 0 0 25 0 4 0 522125817 248033280 7941 33554432000 4194304 4964704 140735139422048 18446744073709551615 4658344 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 60555 7941 458 189 0 54904 0
[pid=29904/tid=29906] ppid=29902 vsize=242220 CPUtime=3.05 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 2225 0 0 0 305 0 0 0 19 0 4 0 522125819 248033280 7941 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=242220 CPUtime=3.06 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 1700 0 0 0 306 0 0 0 21 0 4 0 522125819 248033280 7941 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=242220 CPUtime=3.07 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 1749 0 0 0 307 0 0 0 25 0 4 0 522125819 248033280 7941 33554432000 4194304 4964704 140735139422048 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 242220

[startup+6.30038 s]
/proc/loadavg: 8.11 8.00 7.86 9/184 29908
/proc/meminfo: memFree=30936820/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=242220 CPUtime=25.08 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 10170 0 0 0 2505 3 0 0 25 0 4 0 522125817 248033280 10094 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 60555 10094 458 189 0 54904 0
[pid=29904/tid=29906] ppid=29902 vsize=242220 CPUtime=6.23 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 3347 0 0 0 622 1 0 0 25 0 4 0 522125819 248033280 10094 33554432000 4194304 4964704 140735139422048 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=242220 CPUtime=6.26 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 2210 0 0 0 626 0 0 0 25 0 4 0 522125819 248033280 10094 33554432000 4194304 4964704 140735139422048 18446744073709551615 4660034 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=242220 CPUtime=6.27 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 2055 0 0 0 627 0 0 0 25 0 4 0 522125819 248033280 10094 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.08
Current children cumulated vsize (KiB) 242220

[startup+12.7011 s]
/proc/loadavg: 8.10 8.00 7.86 9/184 29908
/proc/meminfo: memFree=30925920/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=246340 CPUtime=50.65 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 12580 0 0 0 5061 4 0 0 25 0 4 0 522125817 252252160 12504 33554432000 4194304 4964704 140735139422048 18446744073709551615 4654493 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 61585 12504 458 189 0 55934 0
[pid=29904/tid=29906] ppid=29902 vsize=246340 CPUtime=12.6 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 3734 0 0 0 1259 1 0 0 25 0 4 0 522125819 252252160 12504 33554432000 4194304 4964704 140735139422048 18446744073709551615 4342157 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=246340 CPUtime=12.66 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 2704 0 0 0 1266 0 0 0 25 0 4 0 522125819 252252160 12504 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=246340 CPUtime=12.67 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 3572 0 0 0 1267 0 0 0 25 0 4 0 522125819 252252160 12504 33554432000 4194304 4964704 140735139422048 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 246340

[startup+25.5006 s]
/proc/loadavg: 8.15 8.01 7.87 9/184 29909
/proc/meminfo: memFree=30916240/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=246708 CPUtime=101.78 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 15049 0 0 0 10172 6 0 0 25 0 4 0 522125817 252628992 14896 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320947 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 61677 14896 458 189 0 56026 0
[pid=29904/tid=29906] ppid=29902 vsize=246708 CPUtime=25.34 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 4751 0 0 0 2531 3 0 0 25 0 4 0 522125819 252628992 14896 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320905 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=246708 CPUtime=25.45 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 3127 0 0 0 2545 0 0 0 25 0 4 0 522125819 252628992 14896 33554432000 4194304 4964704 140735139422048 18446744073709551615 4660105 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=246708 CPUtime=25.47 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 4359 0 0 0 2546 1 0 0 25 0 4 0 522125819 252628992 14896 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.78
Current children cumulated vsize (KiB) 246708

[startup+51.1065 s]
/proc/loadavg: 8.16 8.03 7.87 9/184 29909
/proc/meminfo: memFree=30906900/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=249260 CPUtime=204.07 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 17767 0 0 0 20398 9 0 0 25 0 4 0 522125817 255242240 17229 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 62315 17229 458 189 0 56664 0
[pid=29904/tid=29906] ppid=29902 vsize=249260 CPUtime=50.82 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 5192 0 0 0 5079 3 0 0 25 0 4 0 522125819 255242240 17229 33554432000 4194304 4964704 140735139422048 18446744073709551615 4332422 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=249260 CPUtime=51.06 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 3455 0 0 0 5105 1 0 0 25 0 4 0 522125819 255242240 17229 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=249260 CPUtime=51.07 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 6153 0 0 0 5105 2 0 0 25 0 4 0 522125819 255242240 17229 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 204.07
Current children cumulated vsize (KiB) 249260

[startup+102.3 s]
/proc/loadavg: 8.17 8.05 7.89 9/184 29911
/proc/meminfo: memFree=30894588/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=252588 CPUtime=408.55 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 21490 0 0 0 40841 14 0 0 25 0 4 0 522125817 258650112 19919 33554432000 4194304 4964704 140735139422048 18446744073709551615 4653309 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 63147 19919 458 189 0 57496 0
[pid=29904/tid=29906] ppid=29902 vsize=252588 CPUtime=101.77 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 5970 0 0 0 10172 5 0 0 25 0 4 0 522125819 258650112 19919 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=252588 CPUtime=102.24 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 4852 0 0 0 10222 2 0 0 25 0 4 0 522125819 258650112 19919 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=252588 CPUtime=102.24 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 7383 0 0 0 10221 3 0 0 22 0 4 0 522125819 258650112 19919 33554432000 4194304 4964704 140735139422048 18446744073709551615 4653336 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.55
Current children cumulated vsize (KiB) 252588

[startup+162.3 s]
/proc/loadavg: 8.06 8.04 7.90 9/184 29912
/proc/meminfo: memFree=30883512/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=255468 CPUtime=648.24 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 25380 0 0 0 64805 19 0 0 25 0 4 0 522125817 261599232 22773 33554432000 4194304 4964704 140735139422048 18446744073709551615 4683916 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 63867 22773 458 189 0 58216 0
[pid=29904/tid=29906] ppid=29902 vsize=255468 CPUtime=161.48 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 6833 0 0 0 16141 7 0 0 25 0 4 0 522125819 261599232 22773 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670312 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=255468 CPUtime=162.23 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 5775 0 0 0 16220 3 0 0 25 0 4 0 522125819 261599232 22773 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=255468 CPUtime=162.24 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 8456 0 0 0 16220 4 0 0 25 0 4 0 522125819 261599232 22773 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 648.24
Current children cumulated vsize (KiB) 255468

[startup+222.3 s]
/proc/loadavg: 8.02 8.03 7.90 9/184 29914
/proc/meminfo: memFree=30875532/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=257344 CPUtime=887.9 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 28506 0 0 0 88767 23 0 0 25 0 4 0 522125817 263520256 24707 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 64336 24707 458 189 0 58685 0
[pid=29904/tid=29906] ppid=29902 vsize=257344 CPUtime=221.18 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 8058 0 0 0 22110 8 0 0 25 0 4 0 522125819 263520256 24707 33554432000 4194304 4964704 140735139422048 18446744073709551615 4647546 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=257344 CPUtime=222.21 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 6594 0 0 0 22217 4 0 0 25 0 4 0 522125819 263520256 24707 33554432000 4194304 4964704 140735139422048 18446744073709551615 254500389514 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=257344 CPUtime=222.22 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 9221 0 0 0 22217 5 0 0 25 0 4 0 522125819 263520256 24707 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 887.9
Current children cumulated vsize (KiB) 257344

[startup+282.3 s]

################
# More data... #
################

[pid=29904] ppid=29902 vsize=265704 CPUtime=2805.35 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 43290 0 0 0 280480 55 0 0 25 0 4 0 522125817 272080896 31339 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 66426 31339 458 189 0 60775 0
[pid=29904/tid=29906] ppid=29902 vsize=265704 CPUtime=699.26 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 10341 0 0 0 69908 18 0 0 25 0 4 0 522125819 272080896 31339 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=265704 CPUtime=702.13 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 11497 0 0 0 70202 11 0 0 25 0 4 0 522125819 272080896 31339 33554432000 4194304 4964704 140735139422048 18446744073709551615 4332418 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=265704 CPUtime=702.16 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 15028 0 0 0 70203 13 0 0 25 0 4 0 522125819 272080896 31339 33554432000 4194304 4964704 140735139422048 18446744073709551615 4653480 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2805.35
Current children cumulated vsize (KiB) 265704

[startup+762.301 s]
/proc/loadavg: 8.10 8.04 7.94 9/184 29959
/proc/meminfo: memFree=30812928/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=265704 CPUtime=3045.01 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 43310 0 0 0 304442 59 0 0 25 0 4 0 522125817 272080896 31359 33554432000 4194304 4964704 140735139422048 18446744073709551615 4332351 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 66426 31359 458 189 0 60775 0
[pid=29904/tid=29906] ppid=29902 vsize=265704 CPUtime=758.97 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 10344 0 0 0 75877 20 0 0 25 0 4 0 522125819 272080896 31359 33554432000 4194304 4964704 140735139422048 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=265704 CPUtime=762.12 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 11497 0 0 0 76200 12 0 0 25 0 4 0 522125819 272080896 31359 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=265704 CPUtime=762.15 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 15045 0 0 0 76200 15 0 0 25 0 4 0 522125819 272080896 31359 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3045.01
Current children cumulated vsize (KiB) 265704

[startup+822.301 s]
/proc/loadavg: 8.11 8.06 7.95 9/184 29961
/proc/meminfo: memFree=30807308/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=266088 CPUtime=3284.7 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 44364 0 0 0 328408 62 0 0 25 0 4 0 522125817 272474112 31934 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 66522 31934 458 189 0 60871 0
[pid=29904/tid=29906] ppid=29902 vsize=266088 CPUtime=818.68 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 10495 0 0 0 81847 21 0 0 21 0 4 0 522125819 272474112 31934 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=266088 CPUtime=822.1 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 11730 0 0 0 82198 12 0 0 25 0 4 0 522125819 272474112 31934 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=266088 CPUtime=822.15 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 15045 0 0 0 82199 16 0 0 25 0 4 0 522125819 272474112 31934 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3284.7
Current children cumulated vsize (KiB) 266088

[startup+882.301 s]
/proc/loadavg: 8.07 8.06 7.95 9/184 29963
/proc/meminfo: memFree=30805160/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=266316 CPUtime=3524.38 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 44490 0 0 0 352373 65 0 0 25 0 4 0 522125817 272707584 32033 33554432000 4194304 4964704 140735139422048 18446744073709551615 4321116 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 66579 32033 458 189 0 60928 0
[pid=29904/tid=29906] ppid=29902 vsize=266316 CPUtime=878.38 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 10526 0 0 0 87816 22 0 0 25 0 4 0 522125819 272707584 32033 33554432000 4194304 4964704 140735139422048 18446744073709551615 4359851 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=266316 CPUtime=882.09 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 11742 0 0 0 88196 13 0 0 25 0 4 0 522125819 272707584 32033 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=266316 CPUtime=882.15 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 15075 0 0 0 88199 16 0 0 18 0 4 0 522125819 272707584 32033 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3524.38
Current children cumulated vsize (KiB) 266316

[startup+942.301 s]
/proc/loadavg: 8.10 8.06 7.96 9/184 29964
/proc/meminfo: memFree=30798552/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=268128 CPUtime=3764.06 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 45998 0 0 0 376336 70 0 0 25 0 4 0 522125817 274563072 32804 33554432000 4194304 4964704 140735139422048 18446744073709551615 4332324 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67032 32804 458 189 0 61381 0
[pid=29904/tid=29906] ppid=29902 vsize=268128 CPUtime=938.08 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 10526 0 0 0 93785 23 0 0 25 0 4 0 522125819 274563072 32804 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=268128 CPUtime=942.08 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 12121 0 0 0 94194 14 0 0 25 0 4 0 522125819 274563072 32804 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=268128 CPUtime=942.13 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 16078 0 0 0 94196 17 0 0 25 0 4 0 522125819 274563072 32804 33554432000 4194304 4964704 140735139422048 18446744073709551615 4673180 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3764.06
Current children cumulated vsize (KiB) 268128

[startup+1002.3 s]
/proc/loadavg: 7.53 7.95 7.93 5/175 29983
/proc/meminfo: memFree=30877320/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=268128 CPUtime=4003.73 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 46730 0 0 0 400301 72 0 0 25 0 4 0 522125817 274563072 33115 33554432000 4194304 4964704 140735139422048 18446744073709551615 4362231 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67032 33115 458 189 0 61381 0
[pid=29904/tid=29906] ppid=29902 vsize=268128 CPUtime=997.9 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 10544 0 0 0 99766 24 0 0 22 0 4 0 522125819 274563072 33115 33554432000 4194304 4964704 140735139422048 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=268128 CPUtime=1001.94 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 12127 0 0 0 100180 14 0 0 25 0 4 0 522125819 274563072 33115 33554432000 4194304 4964704 140735139422048 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=268128 CPUtime=1002.13 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 16314 0 0 0 100195 18 0 0 22 0 4 0 522125819 274563072 33115 33554432000 4194304 4964704 140735139422048 18446744073709551615 4654636 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4003.73
Current children cumulated vsize (KiB) 268128

[startup+1062.3 s]
/proc/loadavg: 5.36 7.24 7.68 5/175 29984
/proc/meminfo: memFree=30876052/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=270444 CPUtime=4243.26 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 47680 0 0 0 424248 78 0 0 25 0 4 0 522125817 276934656 34060 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67611 34060 458 189 0 61960 0
[pid=29904/tid=29906] ppid=29902 vsize=270444 CPUtime=1057.79 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 11065 0 0 0 105754 25 0 0 25 0 4 0 522125819 276934656 34060 33554432000 4194304 4964704 140735139422048 18446744073709551615 4644887 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=270444 CPUtime=1061.63 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 12180 0 0 0 106148 15 0 0 25 0 4 0 522125819 276934656 34060 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=270444 CPUtime=1062.08 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 16667 0 0 0 106187 21 0 0 25 0 4 0 522125819 276934656 34060 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4243.26
Current children cumulated vsize (KiB) 270444

[startup+1122.3 s]
/proc/loadavg: 4.56 6.66 7.45 5/175 29986
/proc/meminfo: memFree=30873620/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=270532 CPUtime=4482.83 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 49315 0 0 0 448201 82 0 0 25 0 4 0 522125817 277024768 33917 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67633 33917 458 189 0 61982 0
[pid=29904/tid=29906] ppid=29902 vsize=270532 CPUtime=1117.71 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 11381 0 0 0 111745 26 0 0 25 0 4 0 522125819 277024768 33917 33554432000 4194304 4964704 140735139422048 18446744073709551615 4321146 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=270532 CPUtime=1121.33 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 12909 0 0 0 112118 15 0 0 25 0 4 0 522125819 277024768 33917 33554432000 4194304 4964704 140735139422048 18446744073709551615 4332059 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=270532 CPUtime=1122.05 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 16931 0 0 0 112182 23 0 0 25 0 4 0 522125819 277024768 33917 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4482.83
Current children cumulated vsize (KiB) 270532

[startup+1182.3 s]
/proc/loadavg: 4.20 6.18 7.24 5/175 29988
/proc/meminfo: memFree=30870576/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=270080 CPUtime=4722.37 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 51861 0 0 0 472147 90 0 0 25 0 4 0 522125817 276561920 35029 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670233 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67520 35029 458 189 0 61869 0
[pid=29904/tid=29906] ppid=29902 vsize=270080 CPUtime=1177.62 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 12093 0 0 0 117735 27 0 0 25 0 4 0 522125819 276561920 35029 33554432000 4194304 4964704 140735139422048 18446744073709551615 4653284 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=270080 CPUtime=1181.03 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 13408 0 0 0 118087 16 0 0 25 0 4 0 522125819 276561920 35029 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=270080 CPUtime=1182 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 18185 0 0 0 118170 30 0 0 25 0 4 0 522125819 276561920 35029 33554432000 4194304 4964704 140735139422048 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4722.37
Current children cumulated vsize (KiB) 270080



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 4.15 6.04 7.17 5/175 29988
/proc/meminfo: memFree=30871036/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=270784 CPUtime=4800.24 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 52055 0 0 0 479933 91 0 0 25 0 4 0 522125817 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4312415 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67696 34563 458 189 0 62045 0
[pid=29904/tid=29906] ppid=29902 vsize=270784 CPUtime=1197.09 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 12094 0 0 0 119682 27 0 0 25 0 4 0 522125819 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4660755 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=270784 CPUtime=1200.42 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 13430 0 0 0 120026 16 0 0 25 0 4 0 522125819 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=270784 CPUtime=1201.49 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 18185 0 0 0 120119 30 0 0 25 0 4 0 522125819 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 270784

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.8 s]
/proc/loadavg: 4.15 6.04 7.17 5/175 29988
/proc/meminfo: memFree=30871036/32950928 swapFree=67111464/67111528
[pid=29904] ppid=29902 vsize=270784 CPUtime=4800.24 cores=0,2,4,6
/proc/29904/stat : 29904 (claspmt) R 29902 29904 29397 0 -1 4202496 52055 0 0 0 479933 91 0 0 25 0 4 0 522125817 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4312415 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29904/statm: 67696 34563 458 189 0 62045 0
[pid=29904/tid=29906] ppid=29902 vsize=270784 CPUtime=1197.09 cores=0,2,4,6
/proc/29904/task/29906/stat : 29906 (claspmt) R 29902 29904 29397 0 -1 4202560 12094 0 0 0 119682 27 0 0 25 0 4 0 522125819 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4660755 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29904/tid=29907] ppid=29902 vsize=270784 CPUtime=1200.42 cores=0,2,4,6
/proc/29904/task/29907/stat : 29907 (claspmt) R 29902 29904 29397 0 -1 4202560 13430 0 0 0 120026 16 0 0 25 0 4 0 522125819 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29904/tid=29908] ppid=29902 vsize=270784 CPUtime=1201.49 cores=0,2,4,6
/proc/29904/task/29908/stat : 29908 (claspmt) R 29902 29904 29397 0 -1 4202560 18185 0 0 0 120119 30 0 0 25 0 4 0 522125819 277282816 34563 33554432000 4194304 4964704 140735139422048 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 270784

Child status: 0
Real time (s): 1201.83
CPU time (s): 4800.29
CPU user time (s): 4799.36
CPU system time (s): 0.925859
CPU usage (%): 399.416
Max. virtual memory (cumulated for all children) (KiB): 270908

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.36
system time used= 0.925859
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 52068
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 178187
involuntary context switches= 37232

runsolver used 1.72774 second user time and 3.76343 second system time

The end

Launcher Data 

Begin job on node149 at 2011-04-29 21:28:11
IDJOB=3299584
IDBENCH=85542
IDSOLVER=1683
FILE ID=node149/3299584-1304105291
RUNJOBID= node149-1304104540-29771
PBS_JOBID= 13170626
Free space on /tmp= 71932 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT05/crafted/sabharwal05/counting/fphp/unsat/harder/fphp-020-019.shuffled-as.sat05-1232.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299584-1304105291/watcher-3299584-1304105291 -o /tmp/evaluation-result-3299584-1304105291/solver-3299584-1304105291 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299584-1304105291.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= abb32bff5eb954e790612a6209864b5d
RANDOM SEED=1046452600

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30974976 kB
Buffers:        429740 kB
Cached:        1077880 kB
SwapCached:         60 kB
Active:         166828 kB
Inactive:      1440536 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30974976 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:             804 kB
Writeback:           0 kB
AnonPages:       99508 kB
Mapped:          15724 kB
Slab:           304968 kB
PageTables:       4648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   254144 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71932 MiB
End job on node149 at 2011-04-29 21:48:15