runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15517 MiB free)
  memory of node 1: 16384 MiB (13316 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390195-1568349114/watcher-4390195-1568349114 -o /tmp/evaluation-result-4390195-1568349114/solver-4390195-1568349114 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node145-1568328837-13394 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390195-1568349114.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=16968, runsolver pid=16965
Current StackSize limit: 8192 KiB


[startup+0.100202 s]*
/proc/loadavg: 2.00 1.99 2.03 3/200 16969
/proc/meminfo: memFree=29519656/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=35448 memory=11832 CPUtime=0.1 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 3148 0 0 0 10 0 0 0 20 0 1 0 410847918 36298752 2958 33554432000 4194304 6210612 140729141815360 140729141811896 139755537857509 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 8862 2958 835 493 0 2167 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 35448 KiB
Current children cumulated memory: 11832 KiB

[startup+0.209729 s]*
/proc/loadavg: 2.00 1.99 2.03 3/200 16969
/proc/meminfo: memFree=29504404/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=50692 memory=27080 CPUtime=0.2 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 6944 0 0 0 20 0 0 0 20 0 1 0 410847918 51908608 6770 33554432000 4194304 6210612 140729141815360 140729141811896 139755537857509 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 12673 6770 835 493 0 5978 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 50692 KiB
Current children cumulated memory: 27080 KiB

[startup+0.309676 s]*
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29492500/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=62300 memory=38700 CPUtime=0.31 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 9854 0 0 0 30 1 0 0 20 0 1 0 410847918 63795200 9675 33554432000 4194304 6210612 140729141815360 140729141811896 139755537857509 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 15575 9675 835 493 0 8880 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 62300 KiB
Current children cumulated memory: 38700 KiB

[startup+0.700397 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29484788/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75272 memory=51892 CPUtime=0.69 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 13142 0 0 0 67 2 0 0 20 0 1 0 410847918 77078528 12973 33554432000 4194304 6210612 140729141815360 140729141812760 5155768 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18818 12973 873 493 0 12123 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 75272 KiB
Current children cumulated memory: 51892 KiB

[startup+1.50035 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29478388/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51892 CPUtime=1.49 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 13153 0 0 0 147 2 0 0 20 0 1 0 410847918 77213696 12973 33554432000 4194304 6210612 140729141815360 140729141812600 5249738 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12973 873 493 0 12156 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51892 KiB

[startup+3.10925 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29478156/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51964 CPUtime=3.1 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 17142 0 0 0 308 2 0 0 20 0 1 0 410847918 77213696 12991 33554432000 4194304 6210612 140729141815360 140729141812600 5249729 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12991 873 493 0 12156 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51964 KiB

[startup+6.30034 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29478188/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51964 CPUtime=6.29 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 21166 0 0 0 627 2 0 0 20 0 1 0 410847918 77213696 12991 33554432000 4194304 6210612 140729141815360 140729141812600 5185856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12991 873 493 0 12156 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51964 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29478188/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51964 CPUtime=12.69 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 25238 0 0 0 1267 2 0 0 20 0 1 0 410847918 77213696 12991 33554432000 4194304 6210612 140729141815360 140729141812600 5155432 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12991 873 493 0 12156 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51964 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16970
/proc/meminfo: memFree=29477920/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51964 CPUtime=25.48 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 30682 0 0 0 2546 2 0 0 20 0 1 0 410847918 77213696 12991 33554432000 4194304 6210612 140729141815360 140729141812600 5409305 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12991 873 493 0 12156 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51964 KiB

[startup+51.1093 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16972
/proc/meminfo: memFree=29477712/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51964 CPUtime=51.09 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 31896 0 0 0 5107 2 0 0 20 0 1 0 410847918 77213696 12991 33554432000 4194304 6210612 140729141815360 140729141812600 5154977 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12991 873 493 0 12156 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51964 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16976
/proc/meminfo: memFree=29477532/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=75404 memory=51964 CPUtime=102.28 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 32069 0 0 0 10226 2 0 0 20 0 1 0 410847918 77213696 12991 33554432000 4194304 6210612 140729141815360 140729141812600 5008472 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 18851 12991 873 493 0 12156 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 75404 KiB
Current children cumulated memory: 51964 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16980
/proc/meminfo: memFree=29473056/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56108 CPUtime=162.28 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 33373 0 0 0 16225 3 0 0 20 0 1 0 410847918 81436672 14027 33554432000 4194304 6210612 140729141815360 140729141803240 5249907 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14027 873 493 0 13187 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56108 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 16986
/proc/meminfo: memFree=29473036/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=222.28 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 33635 0 0 0 22225 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5155752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 16990
/proc/meminfo: memFree=29473236/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=282.28 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 33712 0 0 0 28225 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 16994
/proc/meminfo: memFree=29472792/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=342.28 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 33790 0 0 0 34225 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17064
/proc/meminfo: memFree=29475448/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=402.27 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 33870 0 0 0 40224 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249890 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17068
/proc/meminfo: memFree=29475228/32770624 swapFree=66957392/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=462.27 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 33949 0 0 0 46224 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249899 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB


################
# More data... #
################

/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 1662.24 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+1722.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/199 17245
/proc/meminfo: memFree=29475464/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=1722.24 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 35595 0 0 0 172221 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5155864 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 1722.24 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17257
/proc/meminfo: memFree=29474752/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=1782.24 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 35672 0 0 0 178221 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249664 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 17286
/proc/meminfo: memFree=29475016/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=1842.23 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 35752 0 0 0 184220 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5157194 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 1842.23 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 17290
/proc/meminfo: memFree=29475212/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=1902.23 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 35831 0 0 0 190220 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 1902.23 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 17294
/proc/meminfo: memFree=29475040/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=1962.23 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 35910 0 0 0 196220 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249664 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 1962.23 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 17300
/proc/meminfo: memFree=29474804/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2022.23 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 35988 0 0 0 202220 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249719 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2022.23 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17304
/proc/meminfo: memFree=29474612/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2082.23 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36068 0 0 0 208220 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5155752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2082.23 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17308
/proc/meminfo: memFree=29474304/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2142.23 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36145 0 0 0 214220 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5157176 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2142.23 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17314
/proc/meminfo: memFree=29474756/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2202.22 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36225 0 0 0 220219 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249664 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2202.22 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17318
/proc/meminfo: memFree=29474780/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2262.22 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36304 0 0 0 226219 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5155623 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17322
/proc/meminfo: memFree=29474476/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2322.22 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36382 0 0 0 232219 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5409293 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2322.22 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17336
/proc/meminfo: memFree=29474168/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2382.22 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36457 0 0 0 238219 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5249890 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2382.22 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17336
/proc/meminfo: memFree=29473792/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2400.03 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36529 0 0 0 240000 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5155864 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 16968 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400 s, system=0.041998 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17336
/proc/meminfo: memFree=29473792/32770624 swapFree=66957396/67108860
[pid=16968] ppid=16965 vsize=79528 memory=56212 CPUtime=2400.03 cores=0,2,4,6
/proc/16968/stat : 16968 (cosoco) R 16965 16968 13363 0 -1 4202496 36529 0 0 0 240000 3 0 0 20 0 1 0 410847918 81436672 14053 33554432000 4194304 6210612 140729141815360 140729141803240 5155864 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 33218560 140729141818379 140729141818481 140729141818481 140729141821390 0
/proc/16968/statm: 19882 14053 874 493 0 13187 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 56212 KiB

Child status: 1
Real time (s): 2400.11
CPU time (s): 2400.04
CPU user time (s): 2400
CPU system time (s): 0.041998
CPU usage (%): 99.9972
Max. virtual memory (cumulated for all children) (KiB): 79528
Max. memory (cumulated for all children) (KiB): 56212

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400
system time used= 0.041998
maximum resident set size= 56280
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36583
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27
involuntary context switches= 3001


# summary of solver processes directly reported to runsolver:
#   pid: 16968
#   total CPU time (s): 2400.04
#   total CPU user time (s): 2400
#   total CPU system time (s): 0.041998

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.03556 second user time and 15.3586 second system time

The end