Trace number 3373144

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.21 1203.75

General information on the benchmark

NameSAT04/handmade/marijn/equilarge-l/
equilarge_l2.used-as.sat04-894.cnf
MD5SUMb3ddb2ee2bb2b83e1c98b2a9018351fc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark590.41
Satisfiable
(Un)Satisfiability was proved
Number of variables4487
Number of clauses18555
Sum of the clauses size54310
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21355
Number of clauses of size 317200
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...430498/instance-3373144-1305430498.cnf
0.03/0.04	c Solving...
4800.14/1203.71	
4800.14/1203.71	*** INTERRUPTED! ***
4800.14/1203.71	*** Shutting down threads...
4800.14/1203.74	s UNKNOWN
4800.14/1203.74	
4800.14/1203.74	c INTERRUPTED   : 1
4800.14/1203.74	c Models        : 0+    
4800.14/1203.74	c Time          : 1203.715s (Solving: 1203.68s 1st Model: 0.00s Unsat: 0.00s)
4800.14/1203.74	c CPU Time      : 4800.170s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373144-1305430498/watcher-3373144-1305430498 -o /tmp/evaluation-result-3373144-1305430498/solver-3373144-1305430498 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373144-1305430498.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 6.39 7.29 1/359 11698
/proc/meminfo: memFree=25587224/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=22632 CPUtime=0 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 964 0 0 0 0 0 0 0 18 0 1 0 635465451 23175168 860 33554432000 4194304 4964800 140733854468112 18446744073709551615 264726065861 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11698/statm: 5658 861 385 189 0 532 0

[startup+0.0351731 s]
/proc/loadavg: 3.99 6.39 7.29 1/359 11698
/proc/meminfo: memFree=25587224/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=24400 CPUtime=0.03 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 1492 0 0 0 3 0 0 0 18 0 1 0 635465451 24985600 1309 33554432000 4194304 4964800 140733854468112 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11698/statm: 6100 1309 399 189 0 974 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 24400

[startup+0.104184 s]
/proc/loadavg: 3.99 6.39 7.29 1/359 11698
/proc/meminfo: memFree=25587224/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=173076 CPUtime=0.57 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 3105 0 0 0 57 0 0 0 18 0 4 0 635465451 177229824 2726 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 43269 2726 458 189 0 37618 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 173076

[startup+0.382016 s]
/proc/loadavg: 3.99 6.39 7.29 1/359 11698
/proc/meminfo: memFree=25587224/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=173604 CPUtime=1.37 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 3570 0 0 0 137 0 0 0 19 0 4 0 635465451 177770496 3191 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670678 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 43401 3191 458 189 0 37750 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 173604

[startup+0.700958 s]
/proc/loadavg: 3.99 6.39 7.29 1/359 11698
/proc/meminfo: memFree=25587224/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=174984 CPUtime=2.64 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 4265 0 0 0 264 0 0 0 19 0 4 0 635465451 179183616 3886 33554432000 4194304 4964800 140733854468112 18446744073709551615 4364621 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 43746 3886 458 189 0 38095 0
Current children cumulated CPU time (s) 2.64
Current children cumulated vsize (KiB) 174984

[startup+1.50081 s]
/proc/loadavg: 3.99 6.39 7.29 9/371 11713
/proc/meminfo: memFree=25563512/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=175248 CPUtime=5.83 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 4857 0 0 0 582 1 0 0 21 0 4 0 635465451 179453952 4478 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 43812 4478 458 189 0 38161 0
[pid=11698/tid=11711] ppid=11696 vsize=175248 CPUtime=1.43 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 823 0 0 0 143 0 0 0 24 0 4 0 635465455 179453952 4478 33554432000 4194304 4964800 140733854468112 18446744073709551615 264726060155 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=175248 CPUtime=1.44 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 923 0 0 0 144 0 0 0 19 0 4 0 635465455 179453952 4478 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=175248 CPUtime=1.45 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 1039 0 0 0 145 0 0 0 23 0 4 0 635465455 179453952 4478 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.83
Current children cumulated vsize (KiB) 175248

[startup+3.10051 s]
/proc/loadavg: 3.99 6.39 7.29 9/371 11713
/proc/meminfo: memFree=25556196/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=176452 CPUtime=12.22 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 5986 0 0 0 1220 2 0 0 25 0 4 0 635465451 180686848 5607 33554432000 4194304 4964800 140733854468112 18446744073709551615 4653322 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 44113 5607 458 189 0 38462 0
[pid=11698/tid=11711] ppid=11696 vsize=176452 CPUtime=3.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 1013 0 0 0 301 0 0 0 25 0 4 0 635465455 180686848 5607 33554432000 4194304 4964800 140733854468112 18446744073709551615 4668794 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=176452 CPUtime=3.04 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 1279 0 0 0 304 0 0 0 25 0 4 0 635465455 180686848 5607 33554432000 4194304 4964800 140733854468112 18446744073709551615 4319906 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=176452 CPUtime=3.05 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 1399 0 0 0 305 0 0 0 25 0 4 0 635465455 180686848 5607 33554432000 4194304 4964800 140733854468112 18446744073709551615 264726065861 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.22
Current children cumulated vsize (KiB) 176452

[startup+6.3009 s]
/proc/loadavg: 4.31 6.42 7.30 9/371 11714
/proc/meminfo: memFree=25540188/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=179960 CPUtime=24.98 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 8414 0 0 0 2495 3 0 0 25 0 4 0 635465451 184279040 8035 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 44990 8035 460 189 0 39339 0
[pid=11698/tid=11711] ppid=11696 vsize=179960 CPUtime=6.17 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 1792 0 0 0 617 0 0 0 25 0 4 0 635465455 184279040 8035 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670381 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=179960 CPUtime=6.25 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 1861 0 0 0 624 1 0 0 25 0 4 0 635465455 184279040 8035 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=179960 CPUtime=6.24 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 1850 0 0 0 624 0 0 0 25 0 4 0 635465455 184279040 8035 33554432000 4194304 4964800 140733854468112 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.98
Current children cumulated vsize (KiB) 179960

[startup+12.7007 s]
/proc/loadavg: 4.61 6.44 7.30 9/371 11714
/proc/meminfo: memFree=25525044/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=184896 CPUtime=50.49 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 10710 0 0 0 5045 4 0 0 25 0 4 0 635465451 189333504 10250 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670499 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 46224 10250 460 189 0 40573 0
[pid=11698/tid=11711] ppid=11696 vsize=184896 CPUtime=12.48 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 2215 0 0 0 1248 0 0 0 25 0 4 0 635465455 189333504 10250 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=184896 CPUtime=12.65 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 2519 0 0 0 1264 1 0 0 25 0 4 0 635465455 189333504 10250 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=184896 CPUtime=12.64 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 2167 0 0 0 1264 0 0 0 25 0 4 0 635465455 189333504 10250 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.49
Current children cumulated vsize (KiB) 184896

[startup+25.5003 s]
/proc/loadavg: 5.36 6.52 7.31 9/371 11714
/proc/meminfo: memFree=25510784/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=188292 CPUtime=101.54 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 13352 0 0 0 10149 5 0 0 25 0 4 0 635465451 192811008 12892 33554432000 4194304 4964800 140733854468112 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 47073 12892 460 189 0 41422 0
[pid=11698/tid=11711] ppid=11696 vsize=188292 CPUtime=25.14 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 2756 0 0 0 2513 1 0 0 25 0 4 0 635465455 192811008 12892 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=188292 CPUtime=25.44 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 3137 0 0 0 2543 1 0 0 25 0 4 0 635465455 192811008 12892 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=188292 CPUtime=25.44 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 2797 0 0 0 2544 0 0 0 25 0 4 0 635465455 192811008 12892 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.54
Current children cumulated vsize (KiB) 188292

[startup+51.1004 s]
/proc/loadavg: 6.39 6.67 7.34 9/371 11745
/proc/meminfo: memFree=25471700/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=194796 CPUtime=203.63 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 17612 0 0 0 20355 8 0 0 25 0 4 0 635465451 199471104 17146 33554432000 4194304 4964800 140733854468112 18446744073709551615 4342180 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 48699 17146 460 189 0 43048 0
[pid=11698/tid=11711] ppid=11696 vsize=194796 CPUtime=50.43 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 3831 0 0 0 5042 1 0 0 25 0 4 0 635465455 199471104 17146 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=194796 CPUtime=51.04 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 3827 0 0 0 5103 1 0 0 25 0 4 0 635465455 199471104 17146 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=194796 CPUtime=51.04 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 3582 0 0 0 5103 1 0 0 25 0 4 0 635465455 199471104 17146 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.63
Current children cumulated vsize (KiB) 194796

[startup+102.314 s]
/proc/loadavg: 7.36 6.89 7.38 9/371 11746
/proc/meminfo: memFree=25434968/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=196956 CPUtime=407.84 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 20337 0 0 0 40774 10 0 0 25 0 4 0 635465451 201682944 19805 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 49239 19805 460 189 0 43588 0
[pid=11698/tid=11711] ppid=11696 vsize=196956 CPUtime=101 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 4579 0 0 0 10099 1 0 0 25 0 4 0 635465455 201682944 19805 33554432000 4194304 4964800 140733854468112 18446744073709551615 4668805 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=196956 CPUtime=102.25 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 4437 0 0 0 10223 2 0 0 25 0 4 0 635465455 201682944 19805 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=196956 CPUtime=102.26 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 3995 0 0 0 10224 2 0 0 25 0 4 0 635465455 201682944 19805 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.84
Current children cumulated vsize (KiB) 196956

[startup+162.3 s]
/proc/loadavg: 7.89 7.12 7.42 9/371 11748
/proc/meminfo: memFree=25414716/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=198236 CPUtime=647.08 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 21595 0 0 0 64696 12 0 0 25 0 4 0 635465451 202993664 21049 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 49559 21049 460 189 0 43908 0
[pid=11698/tid=11711] ppid=11696 vsize=198236 CPUtime=160.29 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 4903 0 0 0 16027 2 0 0 25 0 4 0 635465455 202993664 21049 33554432000 4194304 4964800 140733854468112 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=198236 CPUtime=162.24 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 4833 0 0 0 16222 2 0 0 25 0 4 0 635465455 202993664 21049 33554432000 4194304 4964800 140733854468112 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=198236 CPUtime=162.25 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 4356 0 0 0 16222 3 0 0 25 0 4 0 635465455 202993664 21049 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 647.08
Current children cumulated vsize (KiB) 198236

[startup+222.301 s]
/proc/loadavg: 8.20 7.34 7.48 9/371 11749
/proc/meminfo: memFree=25398552/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=199500 CPUtime=886.35 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 22679 0 0 0 88622 13 0 0 25 0 4 0 635465451 204288000 22061 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670361 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 49875 22061 460 189 0 44224 0
[pid=11698/tid=11711] ppid=11696 vsize=199500 CPUtime=219.55 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 5584 0 0 0 21953 2 0 0 25 0 4 0 635465455 204288000 22061 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=199500 CPUtime=222.24 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 4950 0 0 0 22221 3 0 0 25 0 4 0 635465455 204288000 22061 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=199500 CPUtime=222.24 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 4499 0 0 0 22221 3 0 0 25 0 4 0 635465455 204288000 22061 33554432000 4194304 4964800 140733854468112 18446744073709551615 4660503 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 886.35
Current children cumulated vsize (KiB) 199500

[startup+282.301 s]

################
# More data... #
################

[pid=11698] ppid=11696 vsize=211016 CPUtime=2800.56 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 31055 0 0 0 280030 26 0 0 25 0 4 0 635465451 216080384 29999 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670640 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 52754 29999 460 189 0 47103 0
[pid=11698/tid=11711] ppid=11696 vsize=211016 CPUtime=698.02 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 9141 0 0 0 69796 6 0 0 25 0 4 0 635465455 216080384 29999 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=211016 CPUtime=702.25 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 6781 0 0 0 70219 6 0 0 25 0 4 0 635465455 216080384 29999 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=211016 CPUtime=697.99 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 5997 0 0 0 69792 7 0 0 25 0 4 0 635465455 216080384 29999 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2800.56
Current children cumulated vsize (KiB) 211016

[startup+762.314 s]
/proc/loadavg: 8.19 7.98 7.73 9/371 11764
/proc/meminfo: memFree=25320252/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=211300 CPUtime=3039.88 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 32043 0 0 0 303960 28 0 0 25 0 4 0 635465451 216371200 30941 33554432000 4194304 4964800 140733854468112 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 52825 30941 460 189 0 47174 0
[pid=11698/tid=11711] ppid=11696 vsize=211300 CPUtime=758.02 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 9459 0 0 0 75796 6 0 0 25 0 4 0 635465455 216371200 30941 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=211300 CPUtime=762.26 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 7308 0 0 0 76219 7 0 0 25 0 4 0 635465455 216371200 30941 33554432000 4194304 4964800 140733854468112 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=211300 CPUtime=757.28 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6124 0 0 0 75720 8 0 0 25 0 4 0 635465455 216371200 30941 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3039.88
Current children cumulated vsize (KiB) 211300

[startup+822.301 s]
/proc/loadavg: 8.07 7.98 7.74 9/371 11765
/proc/meminfo: memFree=25314508/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=211552 CPUtime=3279.1 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 32814 0 0 0 327880 30 0 0 25 0 4 0 635465451 216629248 31667 33554432000 4194304 4964800 140733854468112 18446744073709551615 4342208 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 52888 31667 460 189 0 47237 0
[pid=11698/tid=11711] ppid=11696 vsize=211552 CPUtime=818.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 9657 0 0 0 81795 6 0 0 25 0 4 0 635465455 216629248 31667 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=211552 CPUtime=822.24 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 7582 0 0 0 82217 7 0 0 25 0 4 0 635465455 216629248 31667 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=211552 CPUtime=816.54 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6192 0 0 0 81646 8 0 0 25 0 4 0 635465455 216629248 31667 33554432000 4194304 4964800 140733854468112 18446744073709551615 4668753 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3279.1
Current children cumulated vsize (KiB) 211552

[startup+882.3 s]
/proc/loadavg: 8.14 8.01 7.76 9/371 11767
/proc/meminfo: memFree=25308496/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=212204 CPUtime=3518.37 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 33263 0 0 0 351806 31 0 0 25 0 4 0 635465451 217296896 32046 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 53051 32046 460 189 0 47400 0
[pid=11698/tid=11711] ppid=11696 vsize=212204 CPUtime=878.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 9876 0 0 0 87794 7 0 0 25 0 4 0 635465455 217296896 32046 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=212204 CPUtime=882.24 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 7584 0 0 0 88217 7 0 0 25 0 4 0 635465455 217296896 32046 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=212204 CPUtime=875.82 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6282 0 0 0 87574 8 0 0 25 0 4 0 635465455 217296896 32046 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3518.37
Current children cumulated vsize (KiB) 212204

[startup+942.301 s]
/proc/loadavg: 8.15 8.04 7.79 9/371 11769
/proc/meminfo: memFree=25299784/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=212908 CPUtime=3757.67 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 34588 0 0 0 375734 33 0 0 25 0 4 0 635465451 218017792 33311 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 53227 33311 460 189 0 47576 0
[pid=11698/tid=11711] ppid=11696 vsize=212908 CPUtime=938.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 10211 0 0 0 93794 7 0 0 25 0 4 0 635465455 218017792 33311 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=212908 CPUtime=942.25 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 7857 0 0 0 94217 8 0 0 25 0 4 0 635465455 218017792 33311 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=212908 CPUtime=935.1 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6648 0 0 0 93502 8 0 0 25 0 4 0 635465455 218017792 33311 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3757.67
Current children cumulated vsize (KiB) 212908

[startup+1002.3 s]
/proc/loadavg: 8.13 8.04 7.80 9/371 11770
/proc/meminfo: memFree=25298508/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=213636 CPUtime=3996.93 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 34901 0 0 0 399659 34 0 0 25 0 4 0 635465451 218763264 33577 33554432000 4194304 4964800 140733854468112 18446744073709551615 4342208 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 53409 33577 460 189 0 47758 0
[pid=11698/tid=11711] ppid=11696 vsize=213636 CPUtime=998.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 10385 0 0 0 99793 8 0 0 25 0 4 0 635465455 218763264 33577 33554432000 4194304 4964800 140733854468112 18446744073709551615 4668829 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=213636 CPUtime=1002.25 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 7956 0 0 0 100217 8 0 0 25 0 4 0 635465455 218763264 33577 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=213636 CPUtime=994.38 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6657 0 0 0 99429 9 0 0 25 0 4 0 635465455 218763264 33577 33554432000 4194304 4964800 140733854468112 18446744073709551615 4321038 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3996.93
Current children cumulated vsize (KiB) 213636

[startup+1062.3 s]
/proc/loadavg: 8.10 8.05 7.82 9/371 11772
/proc/meminfo: memFree=25291648/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=215424 CPUtime=4236.21 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 35933 0 0 0 423586 35 0 0 25 0 4 0 635465451 220594176 34597 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 53856 34597 460 189 0 48205 0
[pid=11698/tid=11711] ppid=11696 vsize=215424 CPUtime=1058.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 11119 0 0 0 105792 9 0 0 25 0 4 0 635465455 220594176 34597 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=215424 CPUtime=1062.25 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 7962 0 0 0 106217 8 0 0 25 0 4 0 635465455 220594176 34597 33554432000 4194304 4964800 140733854468112 18446744073709551615 264726102626 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=215424 CPUtime=1053.66 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6768 0 0 0 105357 9 0 0 25 0 4 0 635465455 220594176 34597 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670371 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4236.21
Current children cumulated vsize (KiB) 215424

[startup+1122.3 s]
/proc/loadavg: 8.16 8.07 7.84 9/371 11773
/proc/meminfo: memFree=25287000/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=217312 CPUtime=4475.49 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 36986 0 0 0 447512 37 0 0 25 0 4 0 635465451 222527488 35588 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670366 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 54328 35588 460 189 0 48677 0
[pid=11698/tid=11711] ppid=11696 vsize=217312 CPUtime=1118.01 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 11746 0 0 0 111792 9 0 0 25 0 4 0 635465455 222527488 35588 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=217312 CPUtime=1122.24 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 8173 0 0 0 112216 8 0 0 25 0 4 0 635465455 222527488 35588 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669574 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=217312 CPUtime=1112.93 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6804 0 0 0 111284 9 0 0 25 0 4 0 635465455 222527488 35588 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4475.49
Current children cumulated vsize (KiB) 217312

[startup+1182.3 s]
/proc/loadavg: 8.10 8.07 7.85 9/371 11775
/proc/meminfo: memFree=25282868/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=218308 CPUtime=4714.76 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 37558 0 0 0 471438 38 0 0 25 0 4 0 635465451 223547392 36064 33554432000 4194304 4964800 140733854468112 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 54577 36064 460 189 0 48926 0
[pid=11698/tid=11711] ppid=11696 vsize=218308 CPUtime=1178 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 12257 0 0 0 117791 9 0 0 25 0 4 0 635465455 223547392 36064 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=218308 CPUtime=1182.24 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 8194 0 0 0 118216 8 0 0 25 0 4 0 635465455 223547392 36064 33554432000 4194304 4964800 140733854468112 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=218308 CPUtime=1172.22 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6809 0 0 0 117212 10 0 0 25 0 4 0 635465455 223547392 36064 33554432000 4194304 4964800 140733854468112 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4714.76
Current children cumulated vsize (KiB) 218308



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 8.15 8.08 7.86 9/371 11775
/proc/meminfo: memFree=25279884/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=218308 CPUtime=4800.14 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 37920 0 0 0 479975 39 0 0 25 0 4 0 635465451 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4362195 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 54577 36404 460 189 0 48926 0
[pid=11698/tid=11711] ppid=11696 vsize=218308 CPUtime=1199.41 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 12354 0 0 0 119932 9 0 0 25 0 4 0 635465455 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669389 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=218308 CPUtime=1203.65 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 8393 0 0 0 120357 8 0 0 25 0 4 0 635465455 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=218308 CPUtime=1193.36 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6875 0 0 0 119326 10 0 0 25 0 4 0 635465455 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 218308

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.7 s]
/proc/loadavg: 8.15 8.08 7.86 9/371 11775
/proc/meminfo: memFree=25279884/32951124 swapFree=63083164/67111528
[pid=11698] ppid=11696 vsize=218308 CPUtime=4800.14 cores=0,2,4,6
/proc/11698/stat : 11698 (claspmt) R 11696 11698 10794 0 -1 4202496 37920 0 0 0 479975 39 0 0 25 0 4 0 635465451 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4362195 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/11698/statm: 54577 36404 460 189 0 48926 0
[pid=11698/tid=11711] ppid=11696 vsize=218308 CPUtime=1199.41 cores=0,2,4,6
/proc/11698/task/11711/stat : 11711 (claspmt) R 11696 11698 10794 0 -1 4202560 12354 0 0 0 119932 9 0 0 25 0 4 0 635465455 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669389 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11698/tid=11712] ppid=11696 vsize=218308 CPUtime=1203.65 cores=0,2,4,6
/proc/11698/task/11712/stat : 11712 (claspmt) R 11696 11698 10794 0 -1 4202560 8393 0 0 0 120357 8 0 0 25 0 4 0 635465455 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11698/tid=11713] ppid=11696 vsize=218308 CPUtime=1193.36 cores=0,2,4,6
/proc/11698/task/11713/stat : 11713 (claspmt) R 11696 11698 10794 0 -1 4202560 6875 0 0 0 119326 10 0 0 25 0 4 0 635465455 223547392 36404 33554432000 4194304 4964800 140733854468112 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 218308

Child status: 0
Real time (s): 1203.75
CPU time (s): 4800.21
CPU user time (s): 4799.81
CPU system time (s): 0.399939
CPU usage (%): 398.771
Max. virtual memory (cumulated for all children) (KiB): 218308

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.81
system time used= 0.399939
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37932
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21757
involuntary context switches= 23041

runsolver used 4.09538 second user time and 10.1505 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-15 05:34:58
IDJOB=3373144
IDBENCH=84761
IDSOLVER=1853
FILE ID=node141/3373144-1305430498
RUNJOBID= node141-1305430498-11686
PBS_JOBID= 13324603
Free space on /tmp= 73360 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT04/handmade/marijn/equilarge-l/equilarge_l2.used-as.sat04-894.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373144-1305430498/watcher-3373144-1305430498 -o /tmp/evaluation-result-3373144-1305430498/solver-3373144-1305430498 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373144-1305430498.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b3ddb2ee2bb2b83e1c98b2a9018351fc
RANDOM SEED=685802922

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25587388 kB
Buffers:        247556 kB
Cached:        4907564 kB
SwapCached:      15708 kB
Active:        2043600 kB
Inactive:      5079944 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25587388 kB
SwapTotal:    67111528 kB
SwapFree:     63083164 kB
Dirty:            1192 kB
Writeback:           0 kB
AnonPages:     1958952 kB
Mapped:          12420 kB
Slab:           136780 kB
PageTables:      37964 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 86229512 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73356 MiB
End job on node141 at 2011-05-15 05:55:04