Trace number 3373000

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.25 1204.86

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m42-q663-n40-p15-s72490337.cnf
MD5SUMab8e40d31c79e7a71114e3126a46874f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.38479
Satisfiable
(Un)Satisfiability was proved
Number of variables1649
Number of clauses256038
Sum of the clauses size513645
Maximum clause length42
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2255998
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...432817/instance-3373000-1305432817.cnf
1.39/1.40	c Solving...
4800.07/1204.71	
4800.07/1204.71	*** INTERRUPTED! ***
4800.07/1204.71	*** Shutting down threads...
4800.21/1204.85	s UNKNOWN
4800.21/1204.85	
4800.21/1204.85	c INTERRUPTED   : 1
4800.21/1204.85	c Models        : 0+    
4800.21/1204.85	c Time          : 1204.718s (Solving: 1203.32s 1st Model: 0.00s Unsat: 0.00s)
4800.21/1204.85	c CPU Time      : 4800.110s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373000-1305432817/watcher-3373000-1305432817 -o /tmp/evaluation-result-3373000-1305432817/solver-3373000-1305432817 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373000-1305432817.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.77 7.92 6.16 5/361 4631
/proc/meminfo: memFree=23898532/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=21820 CPUtime=0 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 749 0 0 0 0 0 0 0 25 0 1 0 654882087 22343680 667 33554432000 4194304 4964800 140733712816368 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4631/statm: 5455 667 385 189 0 329 0

[startup+0.080454 s]
/proc/loadavg: 7.77 7.92 6.16 5/361 4631
/proc/meminfo: memFree=23898532/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=37252 CPUtime=0.07 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 5572 0 0 0 7 0 0 0 25 0 1 0 654882087 38146048 4325 33554432000 4194304 4964800 140733712816368 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4631/statm: 9313 4325 396 189 0 4187 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 37252

[startup+0.10045 s]
/proc/loadavg: 7.77 7.92 6.16 5/361 4631
/proc/meminfo: memFree=23898532/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=37252 CPUtime=0.09 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 5619 0 0 0 9 0 0 0 25 0 1 0 654882087 38146048 4372 33554432000 4194304 4964800 140733712816368 18446744073709551615 4607549 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4631/statm: 9313 4372 398 189 0 4187 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 37252

[startup+0.300419 s]
/proc/loadavg: 7.77 7.92 6.16 5/361 4631
/proc/meminfo: memFree=23898532/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=37252 CPUtime=0.29 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 5619 0 0 0 29 0 0 0 25 0 1 0 654882087 38146048 4372 33554432000 4194304 4964800 140733712816368 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4631/statm: 9313 4372 398 189 0 4187 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 37252

[startup+0.700344 s]
/proc/loadavg: 7.77 7.92 6.16 5/361 4631
/proc/meminfo: memFree=23898532/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=37252 CPUtime=0.69 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 5619 0 0 0 69 0 0 0 25 0 1 0 654882087 38146048 4372 33554432000 4194304 4964800 140733712816368 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4631/statm: 9313 4372 398 189 0 4187 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 37252

[startup+1.50013 s]
/proc/loadavg: 7.77 7.92 6.16 7/362 4632
/proc/meminfo: memFree=23881792/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=183080 CPUtime=1.73 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 6917 0 0 0 172 1 0 0 25 0 4 0 654882087 187473920 5160 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670361 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 45770 5160 458 189 0 40119 0
Current children cumulated CPU time (s) 1.73
Current children cumulated vsize (KiB) 183080

[startup+3.10084 s]
/proc/loadavg: 7.77 7.92 6.16 10/365 4635
/proc/meminfo: memFree=23865400/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=188108 CPUtime=8.12 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 13707 0 0 0 808 4 0 0 18 0 4 0 654882087 192622592 11950 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 47027 11950 458 189 0 41376 0
[pid=4631/tid=4633] ppid=4629 vsize=188108 CPUtime=1.66 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 2158 0 0 0 166 0 0 0 25 0 4 0 654882228 192622592 11950 33554432000 4194304 4964800 140733712816368 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=188108 CPUtime=1.67 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 1209 0 0 0 167 0 0 0 25 0 4 0 654882228 192622592 11950 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=188108 CPUtime=1.67 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 1935 0 0 0 166 1 0 0 25 0 4 0 654882228 192622592 11950 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 8.12
Current children cumulated vsize (KiB) 188108

[startup+6.30026 s]
/proc/loadavg: 7.79 7.92 6.17 10/365 4635
/proc/meminfo: memFree=23830432/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=199488 CPUtime=20.87 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 22318 0 0 0 2082 5 0 0 25 0 4 0 654882087 204275712 20561 33554432000 4194304 4964800 140733712816368 18446744073709551615 4654463 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 49872 20561 460 189 0 44221 0
[pid=4631/tid=4633] ppid=4629 vsize=199488 CPUtime=4.86 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 4653 0 0 0 485 1 0 0 18 0 4 0 654882228 204275712 20561 33554432000 4194304 4964800 140733712816368 18446744073709551615 4668920 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=199488 CPUtime=4.87 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 3040 0 0 0 487 0 0 0 25 0 4 0 654882228 204275712 20561 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=199488 CPUtime=4.84 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 3947 0 0 0 482 2 0 0 25 0 4 0 654882228 204275712 20561 33554432000 4194304 4964800 140733712816368 18446744073709551615 4332355 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 20.87
Current children cumulated vsize (KiB) 199488

[startup+12.7011 s]
/proc/loadavg: 7.81 7.92 6.18 10/365 4635
/proc/meminfo: memFree=23772120/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=216432 CPUtime=46.4 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 33857 0 0 0 4629 11 0 0 25 0 4 0 654882087 221626368 32100 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 54108 32100 460 189 0 48457 0
[pid=4631/tid=4633] ppid=4629 vsize=216432 CPUtime=11.26 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 8275 0 0 0 1123 3 0 0 25 0 4 0 654882228 221626368 32100 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=216432 CPUtime=11.27 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 5332 0 0 0 1126 1 0 0 25 0 4 0 654882228 221626368 32100 33554432000 4194304 4964800 140733712816368 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=216432 CPUtime=11.16 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 5714 0 0 0 1114 2 0 0 25 0 4 0 654882228 221626368 32100 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 46.4
Current children cumulated vsize (KiB) 216432

[startup+25.5008 s]
/proc/loadavg: 7.92 7.94 6.22 9/365 4635
/proc/meminfo: memFree=23730072/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=228776 CPUtime=97.44 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 43927 0 0 0 9730 14 0 0 25 0 4 0 654882087 234266624 42170 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 57194 42170 460 189 0 51543 0
[pid=4631/tid=4633] ppid=4629 vsize=228776 CPUtime=24.06 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 10263 0 0 0 2402 4 0 0 25 0 4 0 654882228 234266624 42170 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=228776 CPUtime=24.07 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 7293 0 0 0 2406 1 0 0 25 0 4 0 654882228 234266624 42170 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=228776 CPUtime=23.81 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 7252 0 0 0 2378 3 0 0 25 0 4 0 654882228 234266624 42170 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 97.44
Current children cumulated vsize (KiB) 228776

[startup+51.1012 s]
/proc/loadavg: 7.94 7.94 6.26 9/365 4636
/proc/meminfo: memFree=23656144/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=378828 CPUtime=199.55 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 62849 0 0 0 19932 23 0 0 25 0 4 0 654882087 387919872 61088 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 94707 61088 460 189 0 89056 0
[pid=4631/tid=4633] ppid=4629 vsize=378828 CPUtime=49.64 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 12499 0 0 0 4959 5 0 0 25 0 4 0 654882228 387919872 61088 33554432000 4194304 4964800 140733712816368 18446744073709551615 4321038 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=378828 CPUtime=49.66 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 11398 0 0 0 4965 1 0 0 25 0 4 0 654882228 387919872 61088 33554432000 4194304 4964800 140733712816368 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=378828 CPUtime=49.13 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 9452 0 0 0 4909 4 0 0 25 0 4 0 654882228 387919872 61088 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 199.55
Current children cumulated vsize (KiB) 378828

[startup+102.314 s]
/proc/loadavg: 8.03 7.96 6.36 9/365 4637
/proc/meminfo: memFree=23579136/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=413700 CPUtime=403.77 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 81049 0 0 0 40344 33 0 0 25 0 4 0 654882087 423628800 79246 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 103425 79246 460 189 0 97774 0
[pid=4631/tid=4633] ppid=4629 vsize=413700 CPUtime=100.83 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 13989 0 0 0 10077 6 0 0 25 0 4 0 654882228 423628800 79246 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=413700 CPUtime=100.86 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 14968 0 0 0 10084 2 0 0 25 0 4 0 654882228 423628800 79246 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=413700 CPUtime=99.75 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 11279 0 0 0 9970 5 0 0 25 0 4 0 654882228 423628800 79246 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 403.77
Current children cumulated vsize (KiB) 413700

[startup+162.301 s]
/proc/loadavg: 8.01 7.96 6.45 9/365 4670
/proc/meminfo: memFree=23359500/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=553124 CPUtime=643.03 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 102295 0 0 0 64247 56 0 0 25 0 4 0 654882087 566398976 100375 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 138281 100375 460 189 0 132630 0
[pid=4631/tid=4633] ppid=4629 vsize=553124 CPUtime=160.8 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 19788 0 0 0 16068 12 0 0 25 0 4 0 654882228 566398976 100375 33554432000 4194304 4964800 140733712816368 18446744073709551615 4669022 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=553124 CPUtime=160.84 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 19385 0 0 0 16080 4 0 0 25 0 4 0 654882228 566398976 100375 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=553124 CPUtime=159.07 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 14709 0 0 0 15895 12 0 0 25 0 4 0 654882228 566398976 100375 33554432000 4194304 4964800 140733712816368 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 643.03
Current children cumulated vsize (KiB) 553124

[startup+222.3 s]
/proc/loadavg: 8.00 7.96 6.55 9/365 4672
/proc/meminfo: memFree=23163512/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=583860 CPUtime=882.29 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 113596 0 0 0 88168 61 0 0 25 0 4 0 654882087 597872640 111602 33554432000 4194304 4964800 140733712816368 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 145965 111602 460 189 0 140314 0
[pid=4631/tid=4633] ppid=4629 vsize=583860 CPUtime=220.78 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 21389 0 0 0 22065 13 0 0 25 0 4 0 654882228 597872640 111602 33554432000 4194304 4964800 140733712816368 18446744073709551615 4332418 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=583860 CPUtime=220.83 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 24172 0 0 0 22078 5 0 0 25 0 4 0 654882228 597872640 111602 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=583860 CPUtime=218.37 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 16325 0 0 0 21824 13 0 0 25 0 4 0 654882228 597872640 111602 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 583860

[startup+282.3 s]
/proc/loadavg: 8.15 8.01 6.65 9/365 4673
/proc/meminfo: memFree=23033876/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=621056 CPUtime=1121.58 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 126840 0 0 0 112093 65 0 0 25 0 4 0 654882087 635961344 124846 33554432000 4194304 4964800 140733712816368 18446744073709551615 4343849 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 155264 124846 460 189 0 149613 0
[pid=4631/tid=4633] ppid=4629 vsize=621056 CPUtime=280.77 cores=0,2,4,6

################
# More data... #
################

Current children cumulated CPU time (s) 2557.28
Current children cumulated vsize (KiB) 817548

[startup+702.3 s]
/proc/loadavg: 8.20 8.10 7.17 9/365 4684
/proc/meminfo: memFree=22450588/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=893908 CPUtime=2796.54 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 189514 0 0 0 279545 109 0 0 25 0 4 0 654882087 915361792 187163 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670351 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 223477 187163 460 189 0 217826 0
[pid=4631/tid=4633] ppid=4629 vsize=893908 CPUtime=700.7 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 34395 0 0 0 70046 24 0 0 25 0 4 0 654882228 915361792 187163 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=893908 CPUtime=700.76 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 43485 0 0 0 70068 8 0 0 25 0 4 0 654882228 915361792 187163 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=893908 CPUtime=692.8 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 27123 0 0 0 69255 25 0 0 25 0 4 0 654882228 915361792 187163 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2796.54
Current children cumulated vsize (KiB) 893908

[startup+762.313 s]
/proc/loadavg: 8.20 8.11 7.23 9/365 4686
/proc/meminfo: memFree=22410104/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=907984 CPUtime=3035.87 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 195209 0 0 0 303475 112 0 0 25 0 4 0 654882087 929775616 192783 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 226996 192783 460 189 0 221345 0
[pid=4631/tid=4633] ppid=4629 vsize=907984 CPUtime=760.71 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 35263 0 0 0 76047 24 0 0 25 0 4 0 654882228 929775616 192783 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=907984 CPUtime=760.76 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 45975 0 0 0 76067 9 0 0 25 0 4 0 654882228 929775616 192783 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=907984 CPUtime=752.11 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 28363 0 0 0 75185 26 0 0 25 0 4 0 654882228 929775616 192783 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3035.87
Current children cumulated vsize (KiB) 907984

[startup+822.3 s]
/proc/loadavg: 8.22 8.13 7.29 9/365 4688
/proc/meminfo: memFree=22308612/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=933308 CPUtime=3275.09 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 205447 0 0 0 327391 118 0 0 25 0 4 0 654882087 955707392 203021 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 233327 203021 460 189 0 227676 0
[pid=4631/tid=4633] ppid=4629 vsize=933308 CPUtime=820.68 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 36580 0 0 0 82043 25 0 0 25 0 4 0 654882228 955707392 203021 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=933308 CPUtime=820.74 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 49174 0 0 0 82064 10 0 0 25 0 4 0 654882228 955707392 203021 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=933308 CPUtime=811.39 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 30536 0 0 0 81112 27 0 0 25 0 4 0 654882228 955707392 203021 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3275.09
Current children cumulated vsize (KiB) 933308

[startup+882.301 s]
/proc/loadavg: 8.21 8.15 7.35 9/365 4689
/proc/meminfo: memFree=22247788/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=945396 CPUtime=3514.38 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 209614 0 0 0 351318 120 0 0 25 0 4 0 654882087 968085504 207188 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 236349 207188 460 189 0 230698 0
[pid=4631/tid=4633] ppid=4629 vsize=945396 CPUtime=880.68 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 36771 0 0 0 88043 25 0 0 25 0 4 0 654882228 968085504 207188 33554432000 4194304 4964800 140733712816368 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=945396 CPUtime=880.74 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 51692 0 0 0 88063 11 0 0 25 0 4 0 654882228 968085504 207188 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=945396 CPUtime=870.68 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 31361 0 0 0 87041 27 0 0 25 0 4 0 654882228 968085504 207188 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3514.38
Current children cumulated vsize (KiB) 945396

[startup+942.301 s]
/proc/loadavg: 8.21 8.15 7.40 9/365 4691
/proc/meminfo: memFree=22207668/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=946144 CPUtime=3753.66 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 210955 0 0 0 375244 122 0 0 25 0 4 0 654882087 968851456 208529 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 236536 208529 460 189 0 230885 0
[pid=4631/tid=4633] ppid=4629 vsize=946144 CPUtime=940.69 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 38020 0 0 0 94043 26 0 0 25 0 4 0 654882228 968851456 208529 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=946144 CPUtime=940.71 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 51696 0 0 0 94060 11 0 0 25 0 4 0 654882228 968851456 208529 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=946144 CPUtime=929.99 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 31448 0 0 0 92971 28 0 0 25 0 4 0 654882228 968851456 208529 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3753.66
Current children cumulated vsize (KiB) 946144

[startup+1002.3 s]
/proc/loadavg: 8.15 8.14 7.44 9/365 4692
/proc/meminfo: memFree=22041324/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=1077500 CPUtime=3992.97 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 235373 0 0 0 399150 147 0 0 25 0 4 0 654882087 1103360000 232947 33554432000 4194304 4964800 140733712816368 18446744073709551615 4321016 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 269375 232947 460 189 0 263724 0
[pid=4631/tid=4633] ppid=4629 vsize=1077500 CPUtime=1000.68 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 40921 0 0 0 100041 27 0 0 25 0 4 0 654882228 1103360000 232947 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=1077500 CPUtime=1000.7 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 52001 0 0 0 100059 11 0 0 25 0 4 0 654882228 1103360000 232947 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=1077500 CPUtime=989.29 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 42555 0 0 0 98888 41 0 0 25 0 4 0 654882228 1103360000 232947 33554432000 4194304 4964800 140733712816368 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3992.97
Current children cumulated vsize (KiB) 1077500

[startup+1062.3 s]
/proc/loadavg: 8.17 8.14 7.48 9/365 4694
/proc/meminfo: memFree=21887872/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=1082956 CPUtime=4232.19 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 249782 0 0 0 423058 161 0 0 25 0 4 0 654882087 1108946944 247089 33554432000 4194304 4964800 140733712816368 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 270739 247089 460 189 0 265088 0
[pid=4631/tid=4633] ppid=4629 vsize=1082956 CPUtime=1060.43 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 42569 0 0 0 106015 28 0 0 25 0 4 0 654882228 1108946944 247089 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=1082956 CPUtime=1060.7 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 52108 0 0 0 106058 12 0 0 25 0 4 0 654882228 1108946944 247089 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=1082956 CPUtime=1048.77 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 45293 0 0 0 104833 44 0 0 25 0 4 0 654882228 1108946944 247089 33554432000 4194304 4964800 140733712816368 18446744073709551615 4669136 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4232.19
Current children cumulated vsize (KiB) 1082956

[startup+1122.3 s]
/proc/loadavg: 8.14 8.14 7.52 9/365 4696
/proc/meminfo: memFree=21836232/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=1082956 CPUtime=4471.46 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 249953 0 0 0 446985 161 0 0 25 0 4 0 654882087 1108946944 247256 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670129 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 270739 247256 460 189 0 265088 0
[pid=4631/tid=4633] ppid=4629 vsize=1082956 CPUtime=1119.73 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 42724 0 0 0 111944 29 0 0 25 0 4 0 654882228 1108946944 247256 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=1082956 CPUtime=1120.69 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 52109 0 0 0 112057 12 0 0 25 0 4 0 654882228 1108946944 247256 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=1082956 CPUtime=1108.77 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 45303 0 0 0 110833 44 0 0 25 0 4 0 654882228 1108946944 247256 33554432000 4194304 4964800 140733712816368 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4471.46
Current children cumulated vsize (KiB) 1082956

[startup+1182.3 s]
/proc/loadavg: 8.10 8.13 7.55 9/365 4697
/proc/meminfo: memFree=21827360/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=1084556 CPUtime=4710.77 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 250423 0 0 0 470915 162 0 0 25 0 4 0 654882087 1110585344 247566 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 271139 247566 460 189 0 265488 0
[pid=4631/tid=4633] ppid=4629 vsize=1084556 CPUtime=1179.04 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 43129 0 0 0 117875 29 0 0 25 0 4 0 654882228 1110585344 247566 33554432000 4194304 4964800 140733712816368 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=1084556 CPUtime=1180.68 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 52125 0 0 0 118056 12 0 0 25 0 4 0 654882228 1110585344 247566 33554432000 4194304 4964800 140733712816368 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=1084556 CPUtime=1168.77 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 45350 0 0 0 116833 44 0 0 25 0 4 0 654882228 1110585344 247566 33554432000 4194304 4964800 140733712816368 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4710.77
Current children cumulated vsize (KiB) 1084556



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.7 s]
/proc/loadavg: 8.07 8.12 7.56 10/365 4698
/proc/meminfo: memFree=21801284/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=1085728 CPUtime=4800.07 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 250730 0 0 0 479844 163 0 0 25 0 4 0 654882087 1111785472 247873 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4631/statm: 271432 247873 460 189 0 265781 0
[pid=4631/tid=4633] ppid=4629 vsize=1085728 CPUtime=1201.13 cores=0,2,4,6
/proc/4631/task/4633/stat : 4633 (claspmt) R 4629 4631 29873 0 -1 4202560 43433 0 0 0 120083 30 0 0 25 0 4 0 654882228 1111785472 247873 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4631/tid=4634] ppid=4629 vsize=1085728 CPUtime=1203.08 cores=0,2,4,6
/proc/4631/task/4634/stat : 4634 (claspmt) R 4629 4631 29873 0 -1 4202560 52125 0 0 0 120296 12 0 0 25 0 4 0 654882228 1111785472 247873 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4631/tid=4635] ppid=4629 vsize=1085728 CPUtime=1191.18 cores=0,2,4,6
/proc/4631/task/4635/stat : 4635 (claspmt) R 4629 4631 29873 0 -1 4202560 45353 0 0 0 119074 44 0 0 25 0 4 0 654882228 1111785472 247873 33554432000 4194304 4964800 140733712816368 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.07
Current children cumulated vsize (KiB) 1085728

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.82 s]
/proc/loadavg: 8.07 8.12 7.56 10/365 4698
/proc/meminfo: memFree=21801284/32951124 swapFree=56449224/67111528
[pid=4631] ppid=4629 vsize=1068420 CPUtime=4800.21 cores=0,2,4,6
/proc/4631/stat : 4631 (claspmt) R 4629 4631 29873 0 -1 4202496 250741 0 0 0 479858 163 0 0 25 0 1 0 654882087 1094062080 228205 33554432000 4194304 4964800 140733712816368 18446744073709551615 253640902791 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/4631/statm: 267105 227693 471 189 0 261454 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 1068420

Child status: 0
Real time (s): 1204.86
CPU time (s): 4800.25
CPU user time (s): 4798.58
CPU system time (s): 1.67075
CPU usage (%): 398.409
Max. virtual memory (cumulated for all children) (KiB): 1148492

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.58
system time used= 1.67075
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 250742
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21502
involuntary context switches= 20720

runsolver used 4.14337 second user time and 9.80951 second system time

The end

Launcher Data 

Begin job on node106 at 2011-05-15 06:13:37
IDJOB=3373000
IDBENCH=88223
IDSOLVER=1853
FILE ID=node106/3373000-1305432817
RUNJOBID= node106-1305431610-4502
PBS_JOBID= 13324573
Free space on /tmp= 73464 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m42-q663-n40-p15-s72490337.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373000-1305432817/watcher-3373000-1305432817 -o /tmp/evaluation-result-3373000-1305432817/solver-3373000-1305432817 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373000-1305432817.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ab8e40d31c79e7a71114e3126a46874f
RANDOM SEED=1344062333

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23898936 kB
Buffers:        277636 kB
Cached:        5703384 kB
SwapCached:      27544 kB
Active:         849224 kB
Inactive:      7975120 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23898936 kB
SwapTotal:    67111528 kB
SwapFree:     56449224 kB
Dirty:            3916 kB
Writeback:           0 kB
AnonPages:     2824104 kB
Mapped:          10804 kB
Slab:           114036 kB
PageTables:      48060 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 75116304 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73456 MiB
End job on node106 at 2011-05-15 06:33:44