runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11660 MiB free)
  memory of node 1: 16384 MiB (15857 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4298154-1532743720/watcher-4298154-1532743720 -o /tmp/evaluation-result-4298154-1532743720/solver-4298154-1532743720 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1532741135-24676 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4298154-1532743720.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=25506, runsolver pid=25503
Current StackSize limit: 8192 KiB


[startup+0.100157 s]*
/proc/loadavg: 2.02 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28169276/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=35872 memory=12388 CPUtime=0.1 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 3271 0 0 0 10 0 0 0 20 0 1 0 91935205 36732928 3097 33554432000 4194304 6142532 140736680615504 140736680609992 4995536 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 8968 3097 839 476 0 2290 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 35872 KiB
Current children cumulated memory: 12388 KiB

[startup+0.209577 s]*
/proc/loadavg: 2.02 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28169276/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12388 CPUtime=0.21 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 3292 0 0 0 21 0 0 0 20 0 1 0 91935205 36868096 3097 33554432000 4194304 6142532 140736680615504 140736680609992 5215667 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3097 839 476 0 2323 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12388 KiB

[startup+0.309156 s]*
/proc/loadavg: 2.02 2.02 2.43 4/189 25507
/proc/meminfo: memFree=28169276/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12388 CPUtime=0.31 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 3294 0 0 0 31 0 0 0 20 0 1 0 91935205 36868096 3097 33554432000 4194304 6142532 140736680615504 140736680609992 4995483 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3097 839 476 0 2323 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12388 KiB

[startup+0.700272 s]
/proc/loadavg: 2.02 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28169276/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12388 CPUtime=0.69 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 3294 0 0 0 69 0 0 0 20 0 1 0 91935205 36868096 3097 33554432000 4194304 6142532 140736680615504 140736680613032 5175092 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3097 839 476 0 2323 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12388 KiB

[startup+1.50028 s]
/proc/loadavg: 2.02 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28168912/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12388 CPUtime=1.49 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 3297 0 0 0 149 0 0 0 20 0 1 0 91935205 36868096 3097 33554432000 4194304 6142532 140736680615504 140736680602776 5345690 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3097 839 476 0 2323 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12388 KiB

[startup+3.10903 s]
/proc/loadavg: 2.02 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28168464/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12552 CPUtime=3.09 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 3873 0 0 0 309 0 0 0 20 0 1 0 91935205 36868096 3138 33554432000 4194304 6142532 140736680615504 140736680602776 5347578 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3138 840 476 0 2323 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12552 KiB

[startup+6.30027 s]
/proc/loadavg: 2.02 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28168200/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12552 CPUtime=6.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 4572 0 0 0 629 0 0 0 20 0 1 0 91935205 36868096 3138 33554432000 4194304 6142532 140736680615504 140736680613032 4995681 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3138 840 476 0 2323 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12552 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.02 2.43 3/189 25507
/proc/meminfo: memFree=28168456/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12556 CPUtime=12.69 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 5219 0 0 0 1269 0 0 0 20 0 1 0 91935205 36868096 3139 33554432000 4194304 6142532 140736680615504 140736680613032 4995262 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3139 840 476 0 2323 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12556 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.02 2.42 3/189 25507
/proc/meminfo: memFree=28169048/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12556 CPUtime=25.49 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 6541 0 0 0 2549 0 0 0 20 0 1 0 91935205 36868096 3139 33554432000 4194304 6142532 140736680615504 140736680613032 5128840 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3139 840 476 0 2323 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12556 KiB

[startup+51.109 s]
/proc/loadavg: 2.01 2.02 2.41 3/189 25507
/proc/meminfo: memFree=28169048/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12564 CPUtime=51.1 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 7294 0 0 0 5110 0 0 0 20 0 1 0 91935205 36868096 3141 33554432000 4194304 6142532 140736680615504 140736680613032 4995362 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3141 840 476 0 2323 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12564 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.39 3/189 25515
/proc/meminfo: memFree=28167780/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12568 CPUtime=102.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 7988 0 0 0 10229 0 0 0 20 0 1 0 91935205 36868096 3142 33554432000 4194304 6142532 140736680615504 140736680613032 4995371 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3142 840 476 0 2323 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12568 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.36 3/189 25516
/proc/meminfo: memFree=28168532/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12568 CPUtime=162.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 8683 0 0 0 16229 0 0 0 20 0 1 0 91935205 36868096 3142 33554432000 4194304 6142532 140736680615504 140736680613032 4995356 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3142 840 476 0 2323 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12568 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.34 3/187 25517
/proc/meminfo: memFree=28168908/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12584 CPUtime=222.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 9382 0 0 0 22229 0 0 0 20 0 1 0 91935205 36868096 3146 33554432000 4194304 6142532 140736680615504 140736680613032 5175098 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3146 840 476 0 2323 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12584 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.32 3/187 25518
/proc/meminfo: memFree=28168756/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12584 CPUtime=282.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 10078 0 0 0 28229 0 0 0 20 0 1 0 91935205 36868096 3146 33554432000 4194304 6142532 140736680615504 140736680613032 5336815 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3146 840 476 0 2323 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12584 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.30 3/187 25519
/proc/meminfo: memFree=28168856/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12584 CPUtime=342.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 10777 0 0 0 34229 0 0 0 20 0 1 0 91935205 36868096 3146 33554432000 4194304 6142532 140736680615504 140736680613032 4995540 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3146 840 476 0 2323 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12584 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.28 3/187 25520
/proc/meminfo: memFree=28168556/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12584 CPUtime=402.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 11322 0 0 0 40229 0 0 0 20 0 1 0 91935205 36868096 3146 33554432000 4194304 6142532 140736680615504 140736680613032 4995590 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3146 840 476 0 2323 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12584 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.26 3/187 25521
/proc/meminfo: memFree=28168508/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12584 CPUtime=462.29 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 12018 0 0 0 46229 0 0 0 20 0 1 0 91935205 36868096 3146 33554432000 4194304 6142532 140736680615504 140736680613032 5327319 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3146 840 476 0 2323 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12584 KiB


################
# More data... #
################

/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 1722.33 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.09 3/187 25621
/proc/meminfo: memFree=28181424/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=1782.33 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 26262 0 0 0 178232 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995540 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 1782.33 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.08 3/187 25622
/proc/meminfo: memFree=28181756/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=1842.33 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 26960 0 0 0 184232 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 5175098 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.08 3/187 25630
/proc/meminfo: memFree=28181696/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=1902.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 27658 0 0 0 190233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995580 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 1902.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.07 3/187 25631
/proc/meminfo: memFree=28181528/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=1962.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 28189 0 0 0 196233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995506 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 1962.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.07 3/187 25632
/proc/meminfo: memFree=28181536/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2022.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 28741 0 0 0 202233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 5175098 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2022.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.06 3/187 25633
/proc/meminfo: memFree=28181616/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2082.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 29289 0 0 0 208233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995371 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2082.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25634
/proc/meminfo: memFree=28181672/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2142.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 29947 0 0 0 214233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 5326325 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2142.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2202.3 s]
/proc/loadavg: 2.34 2.09 2.07 3/187 25635
/proc/meminfo: memFree=28181628/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2202.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 30467 0 0 0 220233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995461 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2202.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2262.3 s]
/proc/loadavg: 2.27 2.13 2.09 3/187 25636
/proc/meminfo: memFree=28182032/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2262.34 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 31103 0 0 0 226233 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995536 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2262.34 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2322.3 s]
/proc/loadavg: 2.10 2.11 2.08 3/187 25637
/proc/meminfo: memFree=28181980/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2322.35 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 31800 0 0 0 232234 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995286 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2322.35 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2382.3 s]
/proc/loadavg: 2.04 2.09 2.08 3/187 25638
/proc/meminfo: memFree=28182292/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2382.35 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 32293 0 0 0 238234 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995681 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2382.35 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/187 25639
/proc/meminfo: memFree=28182000/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2442.35 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 32789 0 0 0 244234 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995432 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2442.35 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/188 25648
/proc/meminfo: memFree=28181504/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2502.35 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 33310 0 0 0 250234 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995558 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2502.35 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.06 2.06 3/188 25648
/proc/meminfo: memFree=28181504/32770624 swapFree=67108860/67108860
[pid=25506] ppid=25503 vsize=36004 memory=12588 CPUtime=2520.06 cores=1,3,5,7
/proc/25506/stat : 25506 (cosoco) R 25503 25506 24644 0 -1 4202496 33800 0 0 0 252005 1 0 0 20 0 1 0 91935205 36868096 3147 33554432000 4194304 6142532 140736680615504 140736680613032 4995353 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 19333120 140736680621190 140736680621320 140736680621320 140736680624078 0
/proc/25506/statm: 9001 3147 840 476 0 2323 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 36004 KiB
Current children cumulated memory: 12588 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 25506 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.05 s, system=0.014 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.07
CPU user time (s): 2520.05
CPU system time (s): 0.014
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 36004
Max. memory (cumulated for all children) (KiB): 12588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.05
system time used= 0.014
maximum resident set size= 12656
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33887
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18
involuntary context switches= 645


# summary of solver processes directly reported to runsolver:
#   pid: 25506
#   total CPU time (s): 2520.07
#   total CPU user time (s): 2520.05
#   total CPU system time (s): 0.014

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.96756 second user time and 16.4973 second system time

The end