Trace number 3373244

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.36 1202.09

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-040-039.shuffled-as.sat05-1194.cnf
MD5SUM8c84d9b9f2d75de33656119bc03a9afb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark45.3841
Satisfiable
(Un)Satisfiability was proved
Number of variables1560
Number of clauses30460
Sum of the clauses size62400
Maximum clause length39
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 230420
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...643875/instance-3373244-1307643875.cnf
0.00/0.08	c Solving...
4800.25/1202.01	
4800.25/1202.01	*** INTERRUPTED! ***
4800.25/1202.01	*** Shutting down threads...
4800.25/1202.08	s UNKNOWN
4800.25/1202.08	
4800.25/1202.08	c INTERRUPTED   : 1
4800.25/1202.08	c Models        : 0+    
4800.25/1202.08	c Time          : 1202.010s (Solving: 1201.93s 1st Model: 0.00s Unsat: 0.00s)
4800.25/1202.08	c CPU Time      : 4800.270s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373244-1307643875/watcher-3373244-1307643875 -o /tmp/evaluation-result-3373244-1307643875/solver-3373244-1307643875 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373244-1307643875.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.18 8.12 8.09 5/175 22000
/proc/meminfo: memFree=29770508/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=21652 CPUtime=0 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 706 0 0 0 0 0 0 0 25 0 1 0 875987130 22171648 624 33554432000 4194304 4964800 140735505909696 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/22000/statm: 5413 625 385 189 0 287 0

[startup+0.00995 s]
/proc/loadavg: 8.18 8.12 8.09 5/175 22000
/proc/meminfo: memFree=29770508/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=22372 CPUtime=0 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 964 0 0 0 0 0 0 0 25 0 1 0 875987130 22908928 792 33554432000 4194304 4964800 140735505909696 18446744073709551615 210646807237 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/22000/statm: 5593 794 385 189 0 467 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 22372

[startup+0.10213 s]
/proc/loadavg: 8.18 8.12 8.09 5/175 22000
/proc/meminfo: memFree=29770508/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=105048 CPUtime=0.13 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 1659 0 0 0 13 0 0 0 25 0 4 0 875987130 107569152 1396 33554432000 4194304 4964800 140735505909696 18446744073709551615 210647251438 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 26262 1396 453 189 0 20611 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 105048

[startup+0.301505 s]
/proc/loadavg: 8.18 8.12 8.09 5/175 22000
/proc/meminfo: memFree=29770508/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=241400 CPUtime=1.24 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) D 21998 22000 21620 0 -1 4202496 7336 0 0 0 123 1 0 0 18 0 4 0 875987130 247193600 7073 33554432000 4194304 4964800 140735505909696 18446744073709551615 210647189687 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 60779 9178 458 189 0 55128 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 241400

[startup+1.09277 s]
/proc/loadavg: 8.18 8.12 8.09 5/175 22000
/proc/meminfo: memFree=29770508/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=252832 CPUtime=4.08 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 16491 0 0 0 404 4 0 0 19 0 4 0 875987130 258899968 16228 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 63208 16229 458 189 0 57557 0
Current children cumulated CPU time (s) 4.08
Current children cumulated vsize (KiB) 252832

[startup+1.50071 s]
/proc/loadavg: 8.18 8.12 8.09 5/175 22000
/proc/meminfo: memFree=29770508/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=253360 CPUtime=5.71 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 17706 0 0 0 567 4 0 0 19 0 4 0 875987130 259440640 17443 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 63340 17443 458 189 0 57689 0
Current children cumulated CPU time (s) 5.71
Current children cumulated vsize (KiB) 253360

[startup+3.10044 s]
/proc/loadavg: 8.24 8.14 8.10 9/179 22004
/proc/meminfo: memFree=29669372/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=268948 CPUtime=12.1 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 26784 0 0 0 1203 7 0 0 24 0 4 0 875987130 275402752 26521 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320939 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 67237 26521 460 189 0 61586 0
[pid=22000/tid=22002] ppid=21998 vsize=268948 CPUtime=3 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 6738 0 0 0 298 2 0 0 25 0 4 0 875987139 275402752 26521 33554432000 4194304 4964800 140735505909696 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=268948 CPUtime=3 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 9653 0 0 0 298 2 0 0 18 0 4 0 875987139 275402752 26521 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=268948 CPUtime=3 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 4534 0 0 0 299 1 0 0 25 0 4 0 875987139 275402752 26521 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332499 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.1
Current children cumulated vsize (KiB) 268948

[startup+6.3009 s]
/proc/loadavg: 8.22 8.14 8.10 9/179 22004
/proc/meminfo: memFree=29633036/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=275148 CPUtime=24.88 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 36185 0 0 0 2478 10 0 0 25 0 4 0 875987130 281751552 35922 33554432000 4194304 4964800 140735505909696 18446744073709551615 4653547 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 68787 35922 460 189 0 63136 0
[pid=22000/tid=22002] ppid=21998 vsize=275148 CPUtime=6.2 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 9890 0 0 0 617 3 0 0 25 0 4 0 875987139 281751552 35922 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=275148 CPUtime=6.2 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 13103 0 0 0 618 2 0 0 25 0 4 0 875987139 281751552 35922 33554432000 4194304 4964800 140735505909696 18446744073709551615 210646807585 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=275148 CPUtime=6.2 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 6644 0 0 0 618 2 0 0 25 0 4 0 875987139 281751552 35923 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.88
Current children cumulated vsize (KiB) 275148

[startup+12.7068 s]
/proc/loadavg: 8.20 8.13 8.10 9/179 22006
/proc/meminfo: memFree=29550712/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=288504 CPUtime=50.46 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 55616 0 0 0 5028 18 0 0 25 0 4 0 875987130 295428096 55224 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 72126 55224 460 189 0 66475 0
[pid=22000/tid=22002] ppid=21998 vsize=288504 CPUtime=12.6 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 15185 0 0 0 1255 5 0 0 25 0 4 0 875987139 295428096 55224 33554432000 4194304 4964800 140735505909696 18446744073709551615 4343516 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=288504 CPUtime=12.6 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 19542 0 0 0 1256 4 0 0 25 0 4 0 875987139 295428096 55224 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=288504 CPUtime=12.61 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 10089 0 0 0 1258 3 0 0 25 0 4 0 875987139 295428096 55224 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.46
Current children cumulated vsize (KiB) 288504

[startup+25.5007 s]
/proc/loadavg: 8.17 8.13 8.10 9/179 22006
/proc/meminfo: memFree=29464548/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=524404 CPUtime=101.56 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 80936 0 0 0 10129 27 0 0 25 0 4 0 875987130 536989696 80544 33554432000 4194304 4964800 140735505909696 18446744073709551615 4342174 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 131101 80545 460 189 0 125450 0
[pid=22000/tid=22002] ppid=21998 vsize=524404 CPUtime=25.39 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 18669 0 0 0 2532 7 0 0 25 0 4 0 875987139 536989696 80545 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=524404 CPUtime=25.39 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 32262 0 0 0 2531 8 0 0 25 0 4 0 875987139 536989696 80545 33554432000 4194304 4964800 140735505909696 18446744073709551615 210646807585 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=524404 CPUtime=25.4 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 18215 0 0 0 2534 6 0 0 25 0 4 0 875987139 536989696 80545 33554432000 4194304 4964800 140735505909696 18446744073709551615 4644138 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.56
Current children cumulated vsize (KiB) 524404

[startup+51.1004 s]
/proc/loadavg: 8.17 8.13 8.09 9/179 22006
/proc/meminfo: memFree=29387496/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=528168 CPUtime=203.82 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 96551 0 0 0 20347 35 0 0 25 0 4 0 875987130 540844032 95978 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 132042 95978 460 189 0 126391 0
[pid=22000/tid=22002] ppid=21998 vsize=528168 CPUtime=50.98 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 24487 0 0 0 5089 9 0 0 25 0 4 0 875987139 540844032 95978 33554432000 4194304 4964800 140735505909696 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=528168 CPUtime=51 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 35130 0 0 0 5090 10 0 0 25 0 4 0 875987139 540844032 95978 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=528168 CPUtime=51 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 23257 0 0 0 5091 9 0 0 25 0 4 0 875987139 540844032 95978 33554432000 4194304 4964800 140735505909696 18446744073709551615 210646807585 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.82
Current children cumulated vsize (KiB) 528168

[startup+102.301 s]
/proc/loadavg: 8.14 8.12 8.09 9/179 22008
/proc/meminfo: memFree=29221572/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=685368 CPUtime=408.3 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 137945 0 0 0 40774 56 0 0 25 0 4 0 875987130 701816832 137305 33554432000 4194304 4964800 140735505909696 18446744073709551615 4342149 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 171342 137305 460 189 0 165691 0
[pid=22000/tid=22002] ppid=21998 vsize=685368 CPUtime=101.89 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 28670 0 0 0 10178 11 0 0 25 0 4 0 875987139 701816832 137305 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=685368 CPUtime=102.19 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 46028 0 0 0 10205 14 0 0 25 0 4 0 875987139 701816832 137305 33554432000 4194304 4964800 140735505909696 18446744073709551615 4683996 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=685368 CPUtime=102.19 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 31916 0 0 0 10206 13 0 0 25 0 4 0 875987139 701816832 137305 33554432000 4194304 4964800 140735505909696 18446744073709551615 4653144 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.3
Current children cumulated vsize (KiB) 685368

[startup+162.307 s]
/proc/loadavg: 8.15 8.13 8.09 9/179 22051
/proc/meminfo: memFree=29110196/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=782548 CPUtime=647.93 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 160738 0 0 0 64726 67 0 0 25 0 4 0 875987130 801329152 159936 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332496 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/22000/statm: 195637 159936 460 189 0 189986 0
[pid=22000/tid=22002] ppid=21998 vsize=782548 CPUtime=161.54 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 28671 0 0 0 16142 12 0 0 25 0 4 0 875987139 801329152 159936 33554432000 4194304 4964800 140735505909696 18446744073709551615 4321352 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=782548 CPUtime=162.18 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 59165 0 0 0 16198 20 0 0 25 0 4 0 875987139 801329152 159936 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=782548 CPUtime=162.19 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 41011 0 0 0 16203 16 0 0 25 0 4 0 875987139 801329152 159936 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 647.93
Current children cumulated vsize (KiB) 782548

[startup+222.301 s]
/proc/loadavg: 8.16 8.13 8.09 9/179 22051
/proc/meminfo: memFree=29063296/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=783120 CPUtime=887.51 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 167353 0 0 0 88679 72 0 0 25 0 4 0 875987130 801914880 166533 33554432000 4194304 4964800 140735505909696 18446744073709551615 4321054 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 195780 166533 460 189 0 190129 0
[pid=22000/tid=22002] ppid=21998 vsize=783120 CPUtime=221.41 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 28691 0 0 0 22128 13 0 0 25 0 4 0 875987139 801914880 166533 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=783120 CPUtime=222.17 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 59184 0 0 0 22197 20 0 0 25 0 4 0 875987139 801914880 166533 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=783120 CPUtime=222.18 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 41156 0 0 0 22201 17 0 0 25 0 4 0 875987139 801914880 166533 33554432000 4194304 4964800 140735505909696 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 887.51
Current children cumulated vsize (KiB) 783120

[startup+282.301 s]
/proc/loadavg: 8.02 8.09 8.08 9/179 22053
/proc/meminfo: memFree=29024844/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=805696 CPUtime=1127.13 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 173031 0 0 0 112638 75 0 0 25 0 4 0 875987130 825032704 172201 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 201424 172201 460 189 0 195773 0
[pid=22000/tid=22002] ppid=21998 vsize=805696 CPUtime=281.03 cores=1,3,5,7

################
# More data... #
################

[pid=22000] ppid=21998 vsize=1040240 CPUtime=2564.89 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 232570 0 0 0 256373 116 0 0 25 0 4 0 875987130 1065205760 230093 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 260060 230093 460 189 0 254409 0
[pid=22000/tid=22002] ppid=21998 vsize=1040240 CPUtime=638.92 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 41950 0 0 0 63865 27 0 0 25 0 4 0 875987139 1065205760 230093 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332545 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1040240 CPUtime=642.15 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 72629 0 0 0 64186 29 0 0 25 0 4 0 875987139 1065205760 230093 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1040240 CPUtime=642.15 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 71562 0 0 0 64182 33 0 0 25 0 4 0 875987139 1065205760 230093 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2564.89
Current children cumulated vsize (KiB) 1040240

[startup+702.3 s]
/proc/loadavg: 8.13 8.10 8.09 9/179 22065
/proc/meminfo: memFree=28766808/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1040240 CPUtime=2804.53 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 232586 0 0 0 280336 117 0 0 25 0 4 0 875987130 1065205760 230109 33554432000 4194304 4964800 140735505909696 18446744073709551615 210646809044 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 260060 230109 460 189 0 254409 0
[pid=22000/tid=22002] ppid=21998 vsize=1040240 CPUtime=698.75 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 41950 0 0 0 69848 27 0 0 25 0 4 0 875987139 1065205760 230109 33554432000 4194304 4964800 140735505909696 18446744073709551615 4653216 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1040240 CPUtime=702.15 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 72638 0 0 0 70186 29 0 0 25 0 4 0 875987139 1065205760 230109 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1040240 CPUtime=701.95 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 71566 0 0 0 70162 33 0 0 25 0 4 0 875987139 1065205760 230109 33554432000 4194304 4964800 140735505909696 18446744073709551615 4343400 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2804.53
Current children cumulated vsize (KiB) 1040240

[startup+762.3 s]
/proc/loadavg: 8.16 8.11 8.09 9/179 22067
/proc/meminfo: memFree=28762324/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1040240 CPUtime=3044.15 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 232598 0 0 0 304296 119 0 0 25 0 4 0 875987130 1065205760 230121 33554432000 4194304 4964800 140735505909696 18446744073709551615 4333086 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 260060 230121 460 189 0 254409 0
[pid=22000/tid=22002] ppid=21998 vsize=1040240 CPUtime=758.71 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 41954 0 0 0 75843 28 0 0 25 0 4 0 875987139 1065205760 230121 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1040240 CPUtime=762.15 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 72638 0 0 0 76185 30 0 0 25 0 4 0 875987139 1065205760 230121 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1040240 CPUtime=761.61 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 71571 0 0 0 76128 33 0 0 25 0 4 0 875987139 1065205760 230121 33554432000 4194304 4964800 140735505909696 18446744073709551615 4342939 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.15
Current children cumulated vsize (KiB) 1040240

[startup+822.306 s]
/proc/loadavg: 8.13 8.11 8.09 9/179 22067
/proc/meminfo: memFree=28759956/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1040240 CPUtime=3283.8 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 233636 0 0 0 328260 120 0 0 25 0 4 0 875987130 1065205760 231159 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 260060 231159 460 189 0 254409 0
[pid=22000/tid=22002] ppid=21998 vsize=1040240 CPUtime=818.42 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 41954 0 0 0 81814 28 0 0 25 0 4 0 875987139 1065205760 231159 33554432000 4194304 4964800 140735505909696 18446744073709551615 4321025 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1040240 CPUtime=822.15 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 72639 0 0 0 82185 30 0 0 25 0 4 0 875987139 1065205760 231159 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1040240 CPUtime=821.55 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 72608 0 0 0 82122 33 0 0 25 0 4 0 875987139 1065205760 231159 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3283.8
Current children cumulated vsize (KiB) 1040240

[startup+882.3 s]
/proc/loadavg: 8.11 8.10 8.09 9/179 22069
/proc/meminfo: memFree=28688652/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1105776 CPUtime=3523.41 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 250507 0 0 0 352210 131 0 0 25 0 4 0 875987130 1132314624 247990 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670335 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 276444 247990 460 189 0 270793 0
[pid=22000/tid=22002] ppid=21998 vsize=1105776 CPUtime=878.06 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42342 0 0 0 87778 28 0 0 25 0 4 0 875987139 1132314624 247990 33554432000 4194304 4964800 140735505909696 18446744073709551615 4627968 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1105776 CPUtime=882.14 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 75158 0 0 0 88182 32 0 0 25 0 4 0 875987139 1132314624 247990 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1105776 CPUtime=881.54 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86572 0 0 0 88112 42 0 0 25 0 4 0 875987139 1132314624 247990 33554432000 4194304 4964800 140735505909696 18446744073709551615 4653296 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.41
Current children cumulated vsize (KiB) 1105776

[startup+942.301 s]
/proc/loadavg: 8.09 8.09 8.09 9/179 22071
/proc/meminfo: memFree=28686276/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1105776 CPUtime=3763.04 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 250509 0 0 0 376172 132 0 0 25 0 4 0 875987130 1132314624 246517 33554432000 4194304 4964800 140735505909696 18446744073709551615 4342199 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 276444 246517 460 189 0 270793 0
[pid=22000/tid=22002] ppid=21998 vsize=1105776 CPUtime=937.71 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42342 0 0 0 93742 29 0 0 25 0 4 0 875987139 1132314624 246517 33554432000 4194304 4964800 140735505909696 18446744073709551615 4362191 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1105776 CPUtime=942.14 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 75158 0 0 0 94182 32 0 0 25 0 4 0 875987139 1132314624 246517 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1105776 CPUtime=941.53 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86574 0 0 0 94111 42 0 0 25 0 4 0 875987139 1132314624 246517 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.04
Current children cumulated vsize (KiB) 1105776

[startup+1002.3 s]
/proc/loadavg: 8.03 8.07 8.08 9/179 22073
/proc/meminfo: memFree=28674248/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1171312 CPUtime=4002.68 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 254053 0 0 0 400132 136 0 0 25 0 4 0 875987130 1199423488 250061 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332462 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 292828 250061 460 189 0 287177 0
[pid=22000/tid=22002] ppid=21998 vsize=1171312 CPUtime=997.37 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42342 0 0 0 99707 30 0 0 25 0 4 0 875987139 1199423488 250061 33554432000 4194304 4964800 140735505909696 18446744073709551615 4641868 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1171312 CPUtime=1002.14 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 75168 0 0 0 100182 32 0 0 25 0 4 0 875987139 1199423488 250061 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1171312 CPUtime=1001.53 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86584 0 0 0 100111 42 0 0 25 0 4 0 875987139 1199423488 250061 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332525 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4002.68
Current children cumulated vsize (KiB) 1171312

[startup+1062.3 s]
/proc/loadavg: 8.01 8.06 8.08 9/179 22075
/proc/meminfo: memFree=28660960/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1171312 CPUtime=4242.31 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 256498 0 0 0 424093 138 0 0 25 0 4 0 875987130 1199423488 252342 33554432000 4194304 4964800 140735505909696 18446744073709551615 4653464 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 292828 252342 460 189 0 287177 0
[pid=22000/tid=22002] ppid=21998 vsize=1171312 CPUtime=1057 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42342 0 0 0 105670 30 0 0 25 0 4 0 875987139 1199423488 252342 33554432000 4194304 4964800 140735505909696 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1171312 CPUtime=1062.13 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 77613 0 0 0 106180 33 0 0 25 0 4 0 875987139 1199423488 252342 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1171312 CPUtime=1061.52 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86584 0 0 0 106110 42 0 0 25 0 4 0 875987139 1199423488 252342 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332566 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.31
Current children cumulated vsize (KiB) 1171312

[startup+1122.3 s]
/proc/loadavg: 8.04 8.06 8.08 9/179 22075
/proc/meminfo: memFree=28659952/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1171312 CPUtime=4481.94 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 256514 0 0 0 448054 140 0 0 25 0 4 0 875987130 1199423488 252358 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 292828 252358 460 189 0 287177 0
[pid=22000/tid=22002] ppid=21998 vsize=1171312 CPUtime=1116.65 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42344 0 0 0 111634 31 0 0 25 0 4 0 875987139 1199423488 252358 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1171312 CPUtime=1122.13 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 77625 0 0 0 112179 34 0 0 25 0 4 0 875987139 1199423488 252358 33554432000 4194304 4964800 140735505909696 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1171312 CPUtime=1121.51 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86586 0 0 0 112109 42 0 0 25 0 4 0 875987139 1199423488 252358 33554432000 4194304 4964800 140735505909696 18446744073709551615 4650810 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4481.94
Current children cumulated vsize (KiB) 1171312

[startup+1182.3 s]
/proc/loadavg: 8.10 8.07 8.08 9/179 22077
/proc/meminfo: memFree=28660188/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1171312 CPUtime=4721.56 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 256519 0 0 0 472014 142 0 0 25 0 4 0 875987130 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332539 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 292828 252363 460 189 0 287177 0
[pid=22000/tid=22002] ppid=21998 vsize=1171312 CPUtime=1176.28 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42344 0 0 0 117596 32 0 0 25 0 4 0 875987139 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4641872 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1171312 CPUtime=1182.12 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 77625 0 0 0 118178 34 0 0 25 0 4 0 875987139 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1171312 CPUtime=1181.51 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86587 0 0 0 118108 43 0 0 25 0 4 0 875987139 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4721.56
Current children cumulated vsize (KiB) 1171312



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202 s]
/proc/loadavg: 8.14 8.08 8.08 9/179 22077
/proc/meminfo: memFree=28654960/32951132 swapFree=67061144/67111528
[pid=22000] ppid=21998 vsize=1171312 CPUtime=4800.25 cores=1,3,5,7
/proc/22000/stat : 22000 (claspmt) R 21998 22000 21620 0 -1 4202496 256519 0 0 0 479883 142 0 0 25 0 4 0 875987130 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22000/statm: 292828 252363 460 189 0 287177 0
[pid=22000/tid=22002] ppid=21998 vsize=1171312 CPUtime=1195.87 cores=1,3,5,7
/proc/22000/task/22002/stat : 22002 (claspmt) R 21998 22000 21620 0 -1 4202560 42344 0 0 0 119555 32 0 0 25 0 4 0 875987139 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22000/tid=22003] ppid=21998 vsize=1171312 CPUtime=1201.83 cores=1,3,5,7
/proc/22000/task/22003/stat : 22003 (claspmt) R 21998 22000 21620 0 -1 4202560 77625 0 0 0 120149 34 0 0 25 0 4 0 875987139 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22000/tid=22004] ppid=21998 vsize=1171312 CPUtime=1201.22 cores=1,3,5,7
/proc/22000/task/22004/stat : 22004 (claspmt) R 21998 22000 21620 0 -1 4202560 86587 0 0 0 120079 43 0 0 25 0 4 0 875987139 1199423488 252363 33554432000 4194304 4964800 140735505909696 18446744073709551615 4332491 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 1171312

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1202.09
CPU time (s): 4800.36
CPU user time (s): 4798.89
CPU system time (s): 1.46278
CPU usage (%): 399.335
Max. virtual memory (cumulated for all children) (KiB): 1171312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.89
system time used= 1.46278
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 256531
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58364
involuntary context switches= 21727

runsolver used 2.12268 second user time and 4.40433 second system time

The end

Launcher Data 

Begin job on node129 at 2011-06-09 20:24:35
IDJOB=3373244
IDBENCH=85456
IDSOLVER=1853
FILE ID=node129/3373244-1307643875
RUNJOBID= node129-1307641250-21639
PBS_JOBID= 13549398
Free space on /tmp= 74164 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-040-039.shuffled-as.sat05-1194.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373244-1307643875/watcher-3373244-1307643875 -o /tmp/evaluation-result-3373244-1307643875/solver-3373244-1307643875 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373244-1307643875.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8c84d9b9f2d75de33656119bc03a9afb
RANDOM SEED=1924788671

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      29771176 kB
Buffers:        381100 kB
Cached:        2498628 kB
SwapCached:      13136 kB
Active:         760008 kB
Inactive:      2171740 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      29771176 kB
SwapTotal:    67111528 kB
SwapFree:     67061144 kB
Dirty:             792 kB
Writeback:           0 kB
AnonPages:       48436 kB
Mapped:           9796 kB
Slab:           186112 kB
PageTables:       4016 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   225072 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74164 MiB
End job on node129 at 2011-06-09 20:44:39