runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8460 MiB free)
  memory of node 1: 16384 MiB (15734 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4394768-1568346293/watcher-4394768-1568346293 -o /tmp/evaluation-result-4394768-1568346293/solver-4394768-1568346293 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568323911-7049 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4394768-1568346293.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=13105, runsolver pid=13102

[startup+0.100157 s]*
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24771624/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=31880 memory=8276 CPUtime=0.1 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 2235 0 0 0 10 0 0 0 20 0 1 0 410901958 32645120 2069 33554432000 4194304 6210612 140736707304432 140736707300968 140013689359333 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 7970 2069 835 493 0 1275 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31880 KiB
Current children cumulated memory: 8276 KiB

[startup+0.209603 s]*
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24767940/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=34924 memory=11452 CPUtime=0.2 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 3043 0 0 0 20 0 0 0 20 0 1 0 410901958 35762176 2863 33554432000 4194304 6210612 140736707304432 140736707298792 5155432 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8731 2863 873 493 0 2036 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 34924 KiB
Current children cumulated memory: 11452 KiB

[startup+0.309307 s]*
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24767940/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=34924 memory=11452 CPUtime=0.3 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 3043 0 0 0 30 0 0 0 20 0 1 0 410901958 35762176 2863 33554432000 4194304 6210612 140736707304432 140736707298792 5155303 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8731 2863 873 493 0 2036 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 34924 KiB
Current children cumulated memory: 11452 KiB

[startup+0.700273 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24767568/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35188 memory=11716 CPUtime=0.69 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 3104 0 0 0 69 0 0 0 20 0 1 0 410901958 36032512 2929 33554432000 4194304 6210612 140736707304432 140736707301672 5155776 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8797 2929 873 493 0 2102 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35188 KiB
Current children cumulated memory: 11716 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24767196/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35716 memory=12244 CPUtime=1.49 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 3229 0 0 0 149 0 0 0 20 0 1 0 410901958 36573184 3061 33554432000 4194304 6210612 140736707304432 140736707301672 5155466 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8929 3061 873 493 0 2234 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 35716 KiB
Current children cumulated memory: 12244 KiB

[startup+3.10944 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24766504/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35716 memory=12268 CPUtime=3.09 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 4499 0 0 0 309 0 0 0 20 0 1 0 410901958 36573184 3067 33554432000 4194304 6210612 140736707304432 140736707301672 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8929 3067 873 493 0 2234 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 35716 KiB
Current children cumulated memory: 12268 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13106
/proc/meminfo: memFree=24766380/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35716 memory=12268 CPUtime=6.28 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 4559 0 0 0 628 0 0 0 20 0 1 0 410901958 36573184 3067 33554432000 4194304 6210612 140736707304432 140736707301672 5409305 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8929 3067 873 493 0 2234 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 35716 KiB
Current children cumulated memory: 12268 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13107
/proc/meminfo: memFree=24766292/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35716 memory=12268 CPUtime=12.68 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 4639 0 0 0 1268 0 0 0 20 0 1 0 410901958 36573184 3067 33554432000 4194304 6210612 140736707304432 140736707301672 5249729 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8929 3067 873 493 0 2234 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 35716 KiB
Current children cumulated memory: 12268 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13107
/proc/meminfo: memFree=24766408/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12424 CPUtime=25.48 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 4854 0 0 0 2548 0 0 0 20 0 1 0 410901958 36708352 3106 33554432000 4194304 6210612 140736707304432 140736707301672 5155344 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3106 873 493 0 2267 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12424 KiB

[startup+51.109 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 13109
/proc/meminfo: memFree=24765324/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=51.09 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 4966 0 0 0 5109 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5249733 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 13114
/proc/meminfo: memFree=24765408/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=102.28 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5054 0 0 0 10228 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5249719 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 13118
/proc/meminfo: memFree=24765604/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=162.27 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5126 0 0 0 16227 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5155606 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 13124
/proc/meminfo: memFree=24764868/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=222.27 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5196 0 0 0 22227 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5249674 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 13128
/proc/meminfo: memFree=24765056/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=282.27 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5269 0 0 0 28227 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+342.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/200 13132
/proc/meminfo: memFree=24765232/32770624 swapFree=67018876/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=342.27 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5340 0 0 0 34227 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5249890 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+402.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/201 13146
/proc/meminfo: memFree=24764716/32770624 swapFree=67018896/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=402.26 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5412 0 0 0 40226 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5249738 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/200 13150
/proc/meminfo: memFree=24765020/32770624 swapFree=67018896/67108860
[pid=13105] ppid=13102 vsize=35848 memory=12440 CPUtime=462.26 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 5484 0 0 0 46226 0 0 0 20 0 1 0 410901958 36708352 3110 33554432000 4194304 6210612 140736707304432 140736707301672 5155444 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8962 3110 873 493 0 2267 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 35848 KiB
Current children cumulated memory: 12440 KiB


################
# More data... #
################

/proc/13105/statm: 8995 3157 874 493 0 2300 0
Current children cumulated CPU time: 1602.21 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12628 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/202 13469
/proc/meminfo: memFree=24745536/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12628 CPUtime=1662.21 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 7600 0 0 0 166220 1 0 0 20 0 1 0 410901958 36843520 3157 33554432000 4194304 6210612 140736707304432 140736707292312 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3157 874 493 0 2300 0
Current children cumulated CPU time: 1662.21 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12628 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 13473
/proc/meminfo: memFree=24746068/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=1722.21 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 7674 0 0 0 172220 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5155439 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 13477
/proc/meminfo: memFree=24746304/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=1782.21 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 7751 0 0 0 178220 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157194 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 13483
/proc/meminfo: memFree=24746784/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=1842.2 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 7830 0 0 0 184219 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157826 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 13487
/proc/meminfo: memFree=24747208/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=1902.2 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 7906 0 0 0 190219 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157194 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 1902.2 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 13491
/proc/meminfo: memFree=24746364/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=1962.2 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 7983 0 0 0 196219 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5249890 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 1962.2 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 13497
/proc/meminfo: memFree=24745968/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2022.2 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8058 0 0 0 202219 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2022.2 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 13501
/proc/meminfo: memFree=24746460/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2082.19 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8135 0 0 0 208218 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157172 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2082.19 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 13505
/proc/meminfo: memFree=24746624/32770624 swapFree=67018948/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2142.19 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8211 0 0 0 214218 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5008603 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2142.19 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 13519
/proc/meminfo: memFree=24745964/32770624 swapFree=67018964/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2202.19 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8287 0 0 0 220218 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5155768 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2202.19 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 13523
/proc/meminfo: memFree=24745652/32770624 swapFree=67018964/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2262.18 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8364 0 0 0 226217 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157635 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2262.18 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2322.3 s]
/proc/loadavg: 2.07 2.00 2.04 3/200 13527
/proc/meminfo: memFree=24746132/32770624 swapFree=67018964/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2322.18 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8440 0 0 0 232217 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2322.18 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

[startup+2382.3 s]
/proc/loadavg: 2.03 2.00 2.04 3/201 13533
/proc/meminfo: memFree=24745356/32770624 swapFree=67018964/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2382.18 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8516 0 0 0 238217 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157152 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2382.18 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.02 2.00 2.04 3/200 13533
/proc/meminfo: memFree=24745464/32770624 swapFree=67018964/67108860
[pid=13105] ppid=13102 vsize=35980 memory=12640 CPUtime=2400.08 cores=1,3,5,7
/proc/13105/stat : 13105 (cosoco) R 13102 13105 7017 0 -1 4202496 8590 0 0 0 240007 1 0 0 20 0 1 0 410901958 36843520 3160 33554432000 4194304 6210612 140736707304432 140736707292312 5157152 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 14376960 140736707306507 140736707306609 140736707306609 140736707309518 0
/proc/13105/statm: 8995 3160 874 493 0 2300 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 35980 KiB
Current children cumulated memory: 12640 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.2 s]
# the end of solver process 13105 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.07 s, system=0.010999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.2
CPU time (s): 2400.08
CPU user time (s): 2400.07
CPU system time (s): 0.010999
CPU usage (%): 99.9951
Max. virtual memory (cumulated for all children) (KiB): 35980
Max. memory (cumulated for all children) (KiB): 12640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.07
system time used= 0.010999
maximum resident set size= 12708
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8646
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18
involuntary context switches= 623


# summary of solver processes directly reported to runsolver:
#   pid: 13105
#   total CPU time (s): 2400.08
#   total CPU user time (s): 2400.07
#   total CPU system time (s): 0.010999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.13189 second user time and 14.583 second system time

The end