runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14951 MiB free)
  memory of node 1: 16384 MiB (1649 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389921-1568316571/watcher-4389921-1568316571 -o /tmp/evaluation-result-4389921-1568316571/solver-4389921-1568316571 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568313599-15140 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389921-1568316571.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=15836, runsolver pid=15833

[startup+0.100115 s]*
/proc/loadavg: 2.00 2.01 1.96 3/200 15837
/proc/meminfo: memFree=16984844/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=37516 memory=13692 CPUtime=0.1 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 3613 0 0 0 10 0 0 0 20 0 1 0 407595051 38416384 3423 33554432000 4194304 6210612 140734802023920 140734802021192 140404420078377 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 9379 3423 807 493 0 2684 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 37516 KiB
Current children cumulated memory: 13692 KiB

[startup+0.209678 s]*
/proc/loadavg: 2.00 2.01 1.96 3/200 15837
/proc/meminfo: memFree=16977996/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=37972 memory=14108 CPUtime=0.2 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 3783 0 0 0 20 0 0 0 20 0 1 0 407595051 38883328 3527 33554432000 4194304 6210612 140734802023920 140734802021192 140404422907266 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 9493 3527 807 493 0 2798 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 37972 KiB
Current children cumulated memory: 14108 KiB

[startup+5.42852 s]*
/proc/loadavg: 2.40 2.10 1.99 3/201 15838
/proc/meminfo: memFree=16423656/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=317164 memory=292640 CPUtime=5.42 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 75752 0 0 0 514 28 0 0 20 0 1 0 407595051 324775936 73160 33554432000 4194304 6210612 140734802023920 140734802018360 5443679 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 79291 73160 821 493 0 72596 0
Current children cumulated CPU time: 5.42 s
Current children cumulated vsize: 317164 KiB
Current children cumulated memory: 292640 KiB

[startup+5.50965 s]*
/proc/loadavg: 2.40 2.10 1.99 3/201 15838
/proc/meminfo: memFree=16411508/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=321520 memory=297096 CPUtime=5.5 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 76865 0 0 0 521 29 0 0 20 0 1 0 407595051 329236480 74274 33554432000 4194304 6210612 140734802023920 140734802018360 140404410141669 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 80380 74274 821 493 0 73685 0
Current children cumulated CPU time: 5.5 s
Current children cumulated vsize: 321520 KiB
Current children cumulated memory: 297096 KiB

[startup+5.60967 s]*
/proc/loadavg: 2.40 2.10 1.99 3/201 15838
/proc/meminfo: memFree=16402988/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=326980 memory=303420 CPUtime=5.6 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 105403 0 0 0 529 31 0 0 20 0 1 0 407595051 334827520 75855 33554432000 4194304 6210612 140734802023920 140734802016920 5000435 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 81745 75855 828 493 0 75050 0
Current children cumulated CPU time: 5.6 s
Current children cumulated vsize: 326980 KiB
Current children cumulated memory: 303420 KiB

[startup+5.70967 s]
/proc/loadavg: 2.40 2.10 1.99 3/201 15838
/proc/meminfo: memFree=16402988/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=327652 memory=304136 CPUtime=5.69 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 114135 0 0 0 537 32 0 0 20 0 1 0 407595051 335515648 76034 33554432000 4194304 6210612 140734802023920 140734802021400 140404410141669 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 81913 76034 866 493 0 75218 0
Current children cumulated CPU time: 5.69 s
Current children cumulated vsize: 327652 KiB
Current children cumulated memory: 304136 KiB

[startup+6.30029 s]
/proc/loadavg: 2.40 2.10 1.99 3/201 15838
/proc/meminfo: memFree=16361340/32770624 swapFree=66916672/67108860
[pid=15836] ppid=15833 vsize=331236 memory=307656 CPUtime=6.28 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 115041 0 0 0 594 34 0 0 20 0 1 0 407595051 339185664 76914 33554432000 4194304 6210612 140734802023920 140734802021320 5380155 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 82809 76914 868 493 0 76114 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 331236 KiB
Current children cumulated memory: 307656 KiB

[startup+12.7004 s]
/proc/loadavg: 2.37 2.10 1.99 3/200 15841
/proc/meminfo: memFree=16955748/32770624 swapFree=66917152/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308676 CPUtime=12.66 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 149728 0 0 0 1222 44 0 0 20 0 1 0 407595051 339996672 77169 33554432000 4194304 6210612 140734802023920 140734802011800 5165314 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77169 868 493 0 76312 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308676 KiB

[startup+25.5004 s]
/proc/loadavg: 2.61 2.16 2.01 3/201 15903
/proc/meminfo: memFree=30103392/32770624 swapFree=66917156/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308676 CPUtime=25.47 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 182735 0 0 0 2501 46 0 0 20 0 1 0 407595051 339996672 77169 33554432000 4194304 6210612 140734802023920 140734802011800 5165357 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77169 868 493 0 76312 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308676 KiB

[startup+51.1004 s]
/proc/loadavg: 2.68 2.22 2.04 3/200 15970
/proc/meminfo: memFree=31301660/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308676 CPUtime=51.05 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 211748 0 0 0 5058 47 0 0 20 0 1 0 407595051 339996672 77169 33554432000 4194304 6210612 140734802023920 140734802011800 5390308 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77169 868 493 0 76312 0
Current children cumulated CPU time: 51.05 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308676 KiB

[startup+102.3 s]*
/proc/loadavg: 2.29 2.19 2.04 3/202 15983
/proc/meminfo: memFree=31301412/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308676 CPUtime=102.23 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 236718 0 0 0 10175 48 0 0 20 0 1 0 407595051 339996672 77169 33554432000 4194304 6210612 140734802023920 140734802011800 5008626 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77169 868 493 0 76312 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308676 KiB

[startup+162.3 s]*
/proc/loadavg: 2.18 2.17 2.04 3/202 15987
/proc/meminfo: memFree=31301624/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308680 CPUtime=162.2 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 254459 0 0 0 16171 49 0 0 20 0 1 0 407595051 339996672 77170 33554432000 4194304 6210612 140734802023920 140734802011800 5008626 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77170 868 493 0 76312 0
Current children cumulated CPU time: 162.2 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308680 KiB

[startup+222.3 s]*
/proc/loadavg: 2.07 2.14 2.04 3/202 15993
/proc/meminfo: memFree=31301772/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=222.17 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 260294 0 0 0 22168 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165256 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 222.17 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+282.3 s]*
/proc/loadavg: 2.02 2.11 2.04 3/202 15996
/proc/meminfo: memFree=31302244/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=282.18 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 260487 0 0 0 28169 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5390284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 282.18 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+342.3 s]*
/proc/loadavg: 2.01 2.09 2.04 3/201 16000
/proc/meminfo: memFree=31302424/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=342.18 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 260644 0 0 0 34169 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165357 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+402.3 s]*
/proc/loadavg: 2.00 2.08 2.04 3/200 16006
/proc/meminfo: memFree=31302236/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=402.19 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 260680 0 0 0 40170 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5409284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+462.3 s]*
/proc/loadavg: 2.00 2.06 2.04 3/199 16010
/proc/meminfo: memFree=31302356/32770624 swapFree=66917160/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=462.19 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 260837 0 0 0 46170 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5409279 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB


################
# More data... #
################

/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+1842.3 s]*
/proc/loadavg: 2.01 2.03 2.05 3/199 16136
/proc/meminfo: memFree=31302004/32770624 swapFree=66917184/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=1842.32 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263173 0 0 0 184183 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165357 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+1902.3 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 16148
/proc/meminfo: memFree=31302312/32770624 swapFree=66917188/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=1902.32 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263329 0 0 0 190183 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5409284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+1962.3 s]*
/proc/loadavg: 2.00 2.02 2.05 3/200 16174
/proc/meminfo: memFree=31301540/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=1962.33 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263365 0 0 0 196184 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165351 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 1962.33 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2022.3 s]*
/proc/loadavg: 2.00 2.02 2.05 3/200 16180
/proc/meminfo: memFree=31301172/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2022.33 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263521 0 0 0 202184 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5008472 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2022.33 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2082.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 16184
/proc/meminfo: memFree=31301264/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2082.34 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263552 0 0 0 208185 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165236 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2082.34 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2142.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 16188
/proc/meminfo: memFree=31301612/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2142.35 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263713 0 0 0 214186 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5409316 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2142.35 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2202.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 16194
/proc/meminfo: memFree=31301740/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2202.35 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263747 0 0 0 220186 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5008619 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2202.35 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2262.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 16198
/proc/meminfo: memFree=31301896/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2262.36 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 263936 0 0 0 226187 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165357 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2262.36 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2322.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 16202
/proc/meminfo: memFree=31302028/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2322.36 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 264095 0 0 0 232187 49 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5409284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2322.36 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2382.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 16208
/proc/meminfo: memFree=31301920/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2382.38 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 264129 0 0 0 238188 50 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5008463 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2382.38 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2442.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 16212
/proc/meminfo: memFree=31302300/32770624 swapFree=66917196/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2442.38 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 264285 0 0 0 244188 50 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165314 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2442.38 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

[startup+2502.3 s]*
/proc/loadavg: 2.00 2.01 2.05 3/202 16226
/proc/meminfo: memFree=31302212/32770624 swapFree=66917200/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2502.39 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 264319 0 0 0 250189 50 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165216 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2502.39 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/202 16229
/proc/meminfo: memFree=31301656/32770624 swapFree=66917200/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2520.08 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 264319 0 0 0 251958 50 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165357 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520 s]
# the end of solver process 15836 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.59 s, system=0.501038 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/202 16229
/proc/meminfo: memFree=31301656/32770624 swapFree=66917200/67108860
[pid=15836] ppid=15833 vsize=332028 memory=308684 CPUtime=2520.08 cores=0,2,4,6
/proc/15836/stat : 15836 (cosoco) R 15833 15836 15109 0 -1 4202496 264319 0 0 0 251958 50 0 0 20 0 1 0 407595051 339996672 77171 33554432000 4194304 6210612 140734802023920 140734802011800 5165357 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12177408 140734802027531 140734802027633 140734802027633 140734802030542 0
/proc/15836/statm: 83007 77171 868 493 0 76312 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 332028 KiB
Current children cumulated memory: 308684 KiB

Child status: 1
Real time (s): 2520
CPU time (s): 2520.09
CPU user time (s): 2519.59
CPU system time (s): 0.501038
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 332028
Max. memory (cumulated for all children) (KiB): 308684

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.59
system time used= 0.501038
maximum resident set size= 308756
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 264381
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 162
involuntary context switches= 3298


# summary of solver processes directly reported to runsolver:
#   pid: 15836
#   total CPU time (s): 2520.09
#   total CPU user time (s): 2519.59
#   total CPU system time (s): 0.501038

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.7414 second user time and 14.8559 second system time

The end