runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63708 MiB (46189 MiB free)
  memory of node 1: 64465 MiB (47913 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4526345-1751630044/watcher-4526345-1751630044 -o /tmp/evaluation-result-4526345-1751630044/solver-4526345-1751630044 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC035-1751623294-89824 --watchdog 3760 toulbar2.sh toulbar2 HOME/instance-4526345-1751630044.wbo -timer=3600 -hve=512 -f=3 -n: -precision=0 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 5.14.0-503.14.1.el9_5.x86_64
Starting watchdog thread
solver pid=90893, runsolver pid=90890
Current StackSize limit: 8192 KiB


[startup+0.100064 s]*
/proc/loadavg: 4.35 4.26 4.15 5/267 90895
/proc/meminfo: memFree=96305060/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=68464 memory=58496 CPUtime=0.08 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 13863 0 0 0 7 1 0 0 20 0 1 0 78678940 70107136 14624 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 7 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 17116 14624 928 1162 0 15725 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 72656 KiB
Current children cumulated memory: 61568 KiB

[startup+0.205836 s]*
/proc/loadavg: 4.35 4.26 4.15 5/267 90895
/proc/meminfo: memFree=96296996/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=76644 memory=66600 CPUtime=0.19 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 15971 0 0 0 17 2 0 0 20 0 1 0 78678940 78483456 16650 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 7 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 19161 16650 1024 1162 0 17770 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 80836 KiB
Current children cumulated memory: 69672 KiB

[startup+0.305714 s]*
/proc/loadavg: 4.35 4.26 4.15 5/267 90895
/proc/meminfo: memFree=96289184/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=88696 memory=78504 CPUtime=0.28 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 18951 0 0 0 26 2 0 0 20 0 1 0 78678940 90824704 19626 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 22174 19626 1024 1162 0 20783 0
Current children cumulated CPU time: 0.28 s
Current children cumulated vsize: 92888 KiB
Current children cumulated memory: 81576 KiB

[startup+0.700201 s]
/proc/loadavg: 4.35 4.26 4.15 5/267 90895
/proc/meminfo: memFree=96289236/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=89308 memory=80040 CPUtime=0.67 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 19228 0 0 0 65 2 0 0 20 0 1 0 78678940 91451392 20010 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 22327 20010 1152 1162 0 20936 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 93500 KiB
Current children cumulated memory: 83112 KiB

[startup+1.5002 s]
/proc/loadavg: 4.35 4.26 4.15 5/267 90895
/proc/meminfo: memFree=96289236/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=91148 memory=81448 CPUtime=1.46 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 19577 0 0 0 144 2 0 0 20 0 1 0 78678940 93335552 20362 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 22787 20362 1152 1162 0 21396 0
Current children cumulated CPU time: 1.46 s
Current children cumulated vsize: 95340 KiB
Current children cumulated memory: 84520 KiB

[startup+3.10562 s]
/proc/loadavg: 4.35 4.26 4.15 5/267 90895
/proc/meminfo: memFree=96273104/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=92688 memory=82740 CPUtime=3.06 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 20080 0 0 0 304 2 0 0 20 0 1 0 78678940 94912512 20685 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 23172 20685 1152 1162 0 21781 0
Current children cumulated CPU time: 3.06 s
Current children cumulated vsize: 96880 KiB
Current children cumulated memory: 85812 KiB

[startup+6.30019 s]
/proc/loadavg: 4.32 4.25 4.15 5/267 90895
/proc/meminfo: memFree=96273608/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=94992 memory=84472 CPUtime=6.25 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 21085 0 0 0 622 3 0 0 20 0 1 0 78678940 97271808 21118 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 23748 21118 1152 1162 0 22357 0
Current children cumulated CPU time: 6.25 s
Current children cumulated vsize: 99184 KiB
Current children cumulated memory: 87544 KiB

[startup+12.7002 s]
/proc/loadavg: 4.29 4.25 4.15 5/267 90895
/proc/meminfo: memFree=96274416/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=99748 memory=89604 CPUtime=12.63 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 22511 0 0 0 1260 3 0 0 20 0 1 0 78678940 102141952 22401 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 24937 22401 1152 1162 0 23546 0
Current children cumulated CPU time: 12.63 s
Current children cumulated vsize: 103940 KiB
Current children cumulated memory: 92676 KiB

[startup+25.5002 s]
/proc/loadavg: 4.45 4.29 4.16 5/268 90896
/proc/meminfo: memFree=96254768/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=102964 memory=91248 CPUtime=25.38 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 23168 0 0 0 2535 3 0 0 20 0 1 0 78678940 105435136 22812 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 25741 22812 1152 1162 0 24350 0
Current children cumulated CPU time: 25.38 s
Current children cumulated vsize: 107156 KiB
Current children cumulated memory: 94320 KiB

[startup+51.1056 s]
/proc/loadavg: 4.54 4.33 4.18 5/267 90897
/proc/meminfo: memFree=96241756/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=115392 memory=102096 CPUtime=50.91 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 23846 0 0 0 5087 4 0 0 20 0 1 0 78678940 118161408 25524 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 28848 25524 1152 1162 0 27457 0
Current children cumulated CPU time: 50.91 s
Current children cumulated vsize: 119584 KiB
Current children cumulated memory: 105168 KiB

[startup+102.3 s]
/proc/loadavg: 4.23 4.27 4.17 5/267 90899
/proc/meminfo: memFree=96216568/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=139968 memory=122176 CPUtime=101.93 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 25324 0 0 0 10188 5 0 0 20 0 1 0 78678940 143327232 30544 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 34992 30544 1152 1162 0 33601 0
Current children cumulated CPU time: 101.93 s
Current children cumulated vsize: 144160 KiB
Current children cumulated memory: 125248 KiB

[startup+162.3 s]
/proc/loadavg: 4.19 4.25 4.17 5/267 90901
/proc/meminfo: memFree=96213992/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=164544 memory=136576 CPUtime=161.74 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 25890 0 0 0 16168 6 0 0 20 0 1 0 78678940 168493056 34144 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 41136 34144 1152 1162 0 39745 0
Current children cumulated CPU time: 161.74 s
Current children cumulated vsize: 168736 KiB
Current children cumulated memory: 139648 KiB

[startup+222.3 s]
/proc/loadavg: 4.13 4.22 4.16 5/268 90906
/proc/meminfo: memFree=96194336/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=189120 memory=151464 CPUtime=221.55 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 26089 0 0 0 22148 7 0 0 20 0 1 0 78678940 193658880 37866 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 47280 37866 1152 1162 0 45889 0
Current children cumulated CPU time: 221.55 s
Current children cumulated vsize: 193312 KiB

################
# More data... #
################

/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 34993 0 0 0 339266 48 0 0 20 0 1 0 78678940 1306300416 238337 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 238337 1152 1162 0 317530 0
Current children cumulated CPU time: 3393.14 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 956420 KiB

[startup+3462.3 s]
/proc/loadavg: 4.10 4.14 4.10 5/266 92079
/proc/meminfo: memFree=125217472/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=965660 CPUtime=3452.99 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35267 0 0 0 345251 48 0 0 20 0 1 0 78678940 1306300416 241415 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 241415 1152 1162 0 317530 0
Current children cumulated CPU time: 3452.99 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 968732 KiB

[startup+3522.3 s]
/proc/loadavg: 4.14 4.15 4.10 5/267 92086
/proc/meminfo: memFree=125196888/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=982076 CPUtime=3512.84 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35409 0 0 0 351236 48 0 0 20 0 1 0 78678940 1306300416 245519 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 245519 1152 1162 0 317530 0
Current children cumulated CPU time: 3512.84 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 985148 KiB

[startup+3582.3 s]
/proc/loadavg: 4.05 4.12 4.09 5/267 92088
/proc/meminfo: memFree=125176528/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=994392 CPUtime=3572.69 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35675 0 0 0 357221 48 0 0 20 0 1 0 78678940 1306300416 248598 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 248598 1152 1162 0 317530 0
Current children cumulated CPU time: 3572.69 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 997464 KiB

[startup+3609.68 s]
# the end of solver process 90893 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3599.52 s, system=0.495989 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.05 4.12 4.09 5/267 92088
/proc/meminfo: memFree=125176528/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=994392 CPUtime=3574.39 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35683 0 0 0 357391 48 0 0 20 0 1 0 78678940 1306300416 248598 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 248598 1152 1162 0 317530 0
Current children cumulated CPU time: 3574.39 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 997464 KiB

[startup+3596.8 s]
/proc/loadavg: 4.12 4.13 4.10 5/267 92088
/proc/meminfo: memFree=125172432/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=998496 CPUtime=3587.16 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35739 0 0 0 358667 49 0 0 20 0 1 0 78678940 1306300416 249624 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 249624 1152 1162 0 317530 0
Current children cumulated CPU time: 3587.16 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1001568 KiB

[startup+3603.2 s]
/proc/loadavg: 4.11 4.13 4.09 5/267 92090
/proc/meminfo: memFree=125172288/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=998496 CPUtime=3593.54 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35743 0 0 0 359305 49 0 0 20 0 1 0 78678940 1306300416 249624 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 249624 1152 1162 0 317530 0
Current children cumulated CPU time: 3593.54 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1001568 KiB

[startup+3606.4 s]
/proc/loadavg: 4.10 4.12 4.09 5/267 92090
/proc/meminfo: memFree=125172288/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=1000548 CPUtime=3596.74 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35746 0 0 0 359625 49 0 0 20 0 1 0 78678940 1306300416 250137 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 250137 1152 1162 0 317530 0
Current children cumulated CPU time: 3596.74 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1003620 KiB

[startup+3608 s]*
/proc/loadavg: 4.10 4.12 4.09 5/267 92090
/proc/meminfo: memFree=125172288/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=1000548 CPUtime=3598.34 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35749 0 0 0 359785 49 0 0 20 0 1 0 78678940 1306300416 250137 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 250137 1152 1162 0 317530 0
Current children cumulated CPU time: 3598.34 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1003620 KiB

[startup+3608.8 s]
/proc/loadavg: 4.10 4.12 4.09 5/267 92090
/proc/meminfo: memFree=125172288/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=1000548 CPUtime=3599.13 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35750 0 0 0 359864 49 0 0 20 0 1 0 78678940 1306300416 250137 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 250137 1152 1162 0 317530 0
Current children cumulated CPU time: 3599.13 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1003620 KiB

[startup+3609.2 s]
/proc/loadavg: 4.09 4.12 4.09 5/267 92090
/proc/meminfo: memFree=125172288/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=1000548 CPUtime=3599.53 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35750 0 0 0 359904 49 0 0 20 0 1 0 78678940 1306300416 250137 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 250137 1152 1162 0 317530 0
Current children cumulated CPU time: 3599.53 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1003620 KiB

[startup+3609.6 s]
/proc/loadavg: 4.09 4.12 4.09 5/267 92090
/proc/meminfo: memFree=125172288/131249992 swapFree=33009392/33010684
[pid=90893] ppid=90890 vsize=4192 memory=3072 CPUtime=0 cores=5,7
/proc/90893/stat : 90893 (toulbar2.sh) S 90890 90893 89811 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 78678940 4292608 768 18446744073709551615 94317499244544 94317500139077 140730683669360 0 0 0 65536 4 65538 1 0 0 17 5 0 0 0 0 0 94317500378128 94317500425872 94317500813312 140730683676981 140730683677157 140730683677157 140730683682761 0
/proc/90893/statm: 1048 768 704 219 0 110 0
[pid=90895] ppid=90893 vsize=1275684 memory=1000548 CPUtime=3599.93 cores=5,7
/proc/90895/stat : 90895 (toulbar2) R 90893 90893 89811 0 -1 4194304 35751 0 0 0 359944 49 0 0 20 0 1 0 78678940 1306300416 250137 18446744073709551615 4198400 8956741 140722471367088 0 0 0 0 0 33570818 0 0 0 17 5 0 0 0 0 0 9785056 9890480 35885056 140722471373171 140722471373290 140722471373290 140722471378892 0
/proc/90895/statm: 318921 250137 1152 1162 0 317530 0
Current children cumulated CPU time: 3599.93 s
Current children cumulated vsize: 1279876 KiB
Current children cumulated memory: 1003620 KiB

Child status: 0

Real time (s): 3609.68
CPU time (s): 3600.01
CPU user time (s): 3599.52
CPU system time (s): 0.495989
CPU usage (%): 99.7323
Max. virtual memory (cumulated for all children) (KiB): 1673096
Max. memory (cumulated for all children) (KiB): 1003620

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3599.52
system time used= 0.495989
maximum resident set size= 1177412
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35967
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87
involuntary context switches= 20461


# summary of solver processes directly reported to runsolver:
#   pid: 90893
#   total CPU time (s): 3600.01
#   total CPU user time (s): 3599.52
#   total CPU system time (s): 0.495989

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.52027 second user time and 13.2204 second system time

The end