runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63708 MiB (62940 MiB free)
  memory of node 1: 64465 MiB (61187 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4525175-1751623294/watcher-4525175-1751623294 -o /tmp/evaluation-result-4525175-1751623294/solver-4525175-1751623294 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC035-1751623294-89821 --watchdog 3760 toulbar2.sh toulbar2 HOME/instance-4525175-1751623294.wbo -timer=3600 -hve=512 -f=3 -n: -precision=0 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 5.14.0-503.14.1.el9_5.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=89872, runsolver pid=89863

[startup+0.100065 s]*
/proc/loadavg: 0.95 1.17 1.94 6/268 89885
/proc/meminfo: memFree=127034828/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=28504 memory=19328 CPUtime=0.08 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 3917 0 0 0 8 0 0 0 20 0 1 0 78003963 29188096 4832 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7126 4832 1024 1162 0 5735 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 32696 KiB
Current children cumulated memory: 22400 KiB

[startup+0.20467 s]*
/proc/loadavg: 0.95 1.17 1.94 6/268 89885
/proc/meminfo: memFree=127003660/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=28764 memory=20096 CPUtime=0.19 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4124 0 0 0 19 0 0 0 20 0 1 0 78003963 29454336 5024 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7191 5024 1024 1162 0 5800 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 23168 KiB

[startup+0.305722 s]*
/proc/loadavg: 0.95 1.17 1.94 6/268 89885
/proc/meminfo: memFree=127003660/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=29256 memory=21632 CPUtime=0.29 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4351 0 0 0 29 0 0 0 20 0 1 0 78003963 29958144 5408 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7314 5408 1184 1162 0 5923 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 33448 KiB
Current children cumulated memory: 24704 KiB

[startup+0.700152 s]
/proc/loadavg: 0.95 1.17 1.94 6/268 89885
/proc/meminfo: memFree=127003660/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=29256 memory=21632 CPUtime=0.68 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4353 0 0 0 68 0 0 0 20 0 1 0 78003963 29958144 5408 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7314 5408 1184 1162 0 5923 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 33448 KiB
Current children cumulated memory: 24704 KiB

[startup+1.50015 s]
/proc/loadavg: 0.95 1.17 1.94 6/268 89885
/proc/meminfo: memFree=127003412/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=30136 memory=22528 CPUtime=1.47 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4566 0 0 0 147 0 0 0 20 0 1 0 78003963 30859264 5632 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7534 5632 1184 1162 0 6143 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 34328 KiB
Current children cumulated memory: 25600 KiB

[startup+3.10448 s]
/proc/loadavg: 1.19 1.22 1.95 6/268 89885
/proc/meminfo: memFree=127004244/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=30268 memory=22656 CPUtime=3.07 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4590 0 0 0 307 0 0 0 20 0 1 0 78003963 30994432 5664 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7567 5664 1184 1162 0 6176 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 34460 KiB
Current children cumulated memory: 25728 KiB

[startup+6.30014 s]
/proc/loadavg: 1.19 1.22 1.95 6/268 89885
/proc/meminfo: memFree=127004556/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=30268 memory=22656 CPUtime=6.26 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4604 0 0 0 626 0 0 0 20 0 1 0 78003963 30994432 5664 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7567 5664 1184 1162 0 6176 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 34460 KiB
Current children cumulated memory: 25728 KiB

[startup+12.7001 s]
/proc/loadavg: 1.62 1.31 1.97 6/268 89885
/proc/meminfo: memFree=127004332/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=30604 memory=22784 CPUtime=12.64 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4653 0 0 0 1264 0 0 0 20 0 1 0 78003963 31338496 5696 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7651 5696 1184 1162 0 6260 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 34796 KiB
Current children cumulated memory: 25856 KiB

[startup+25.5002 s]
/proc/loadavg: 2.07 1.42 2.00 6/268 89885
/proc/meminfo: memFree=127004436/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=30796 memory=23004 CPUtime=25.41 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4729 0 0 0 2541 0 0 0 20 0 1 0 78003963 31535104 5751 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7699 5751 1184 1162 0 6308 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 34988 KiB
Current children cumulated memory: 26076 KiB

[startup+51.1045 s]
/proc/loadavg: 2.73 1.62 2.06 6/269 89887
/proc/meminfo: memFree=127004284/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=31180 memory=23236 CPUtime=50.95 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 4882 0 0 0 5095 0 0 0 20 0 1 0 78003963 31928320 5809 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 7795 5809 1184 1162 0 6404 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 35372 KiB
Current children cumulated memory: 26308 KiB

[startup+102.3 s]
/proc/loadavg: 3.61 2.06 2.18 6/271 89892
/proc/meminfo: memFree=126981948/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=32100 memory=23732 CPUtime=102.01 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 5199 0 0 0 10201 0 0 0 20 0 1 0 78003963 32870400 5933 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 8025 5933 1184 1162 0 6634 0
Current children cumulated CPU time: 102.01 s
Current children cumulated vsize: 36292 KiB
Current children cumulated memory: 26804 KiB

[startup+162.3 s]
/proc/loadavg: 3.92 2.43 2.30 6/271 89897
/proc/meminfo: memFree=126955524/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=32100 memory=24116 CPUtime=161.86 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 5311 0 0 0 16186 0 0 0 20 0 1 0 78003963 32870400 6029 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 8025 6029 1184 1162 0 6634 0
Current children cumulated CPU time: 161.86 s
Current children cumulated vsize: 36292 KiB
Current children cumulated memory: 27188 KiB

[startup+222.3 s]
/proc/loadavg: 4.02 2.73 2.42 6/271 89899
/proc/meminfo: memFree=126929332/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=33636 memory=30772 CPUtime=221.69 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 5842 0 0 0 22169 0 0 0 20 0 1 0 78003963 34443264 7693 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 8409 7693 1184 1162 0 7018 0
Current children cumulated CPU time: 221.69 s
Current children cumulated vsize: 37828 KiB

################
# More data... #
################

/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7962 0 0 0 339281 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3392.83 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3462.3 s]
/proc/loadavg: 4.09 4.14 4.09 6/267 90092
/proc/meminfo: memFree=126866732/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3452.66 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 345264 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3452.66 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3522.3 s]
/proc/loadavg: 4.13 4.14 4.09 6/266 90098
/proc/meminfo: memFree=126868016/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3512.5 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 351248 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3512.5 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3582.3 s]
/proc/loadavg: 4.05 4.11 4.09 6/266 90111
/proc/meminfo: memFree=126867108/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3572.33 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 357231 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3572.33 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3610.07 s]
# the end of solver process 89872 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3600.02 s, system=0.022898 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.04 4.11 4.08 6/266 90111
/proc/meminfo: memFree=126867156/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3574.03 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 357401 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3574.03 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3596.8 s]
/proc/loadavg: 4.11 4.12 4.09 6/266 90113
/proc/meminfo: memFree=126867356/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3586.79 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 358677 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3586.79 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3603.2 s]
/proc/loadavg: 4.09 4.12 4.09 6/266 90113
/proc/meminfo: memFree=126867396/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3593.18 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 359316 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3593.18 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3606.4 s]
/proc/loadavg: 4.09 4.12 4.09 6/266 90113
/proc/meminfo: memFree=126867436/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3596.37 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 359635 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3596.37 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3608 s]*
/proc/loadavg: 4.08 4.12 4.09 6/266 90113
/proc/meminfo: memFree=126867476/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3597.97 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 359795 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3597.97 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3608.8 s]
/proc/loadavg: 4.08 4.12 4.09 6/266 90113
/proc/meminfo: memFree=126867476/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3598.76 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 359874 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3598.76 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3609.6 s]
/proc/loadavg: 4.08 4.12 4.09 3/256 90129
/proc/meminfo: memFree=126990780/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3599.56 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 359954 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3599.56 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

[startup+3610 s]*
/proc/loadavg: 4.08 4.12 4.09 4/258 90193
/proc/meminfo: memFree=127001860/131249992 swapFree=33009392/33010684
[pid=89872] ppid=89863 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/89872/stat : 89872 (toulbar2.sh) S 89863 89872 89811 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 78003962 4292608 768 18446744073709551615 94565762064384 94565762958917 140730342726928 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94565763197968 94565763245712 94565767487488 140730342734133 140730342734309 140730342734309 140730342739913 0
/proc/89872/statm: 1048 768 704 219 0 110 0
[pid=89883] ppid=89872 vsize=55140 memory=53868 CPUtime=3599.96 cores=0,2
/proc/89883/stat : 89883 (toulbar2) R 89872 89872 89811 0 -1 4194304 7966 0 0 0 359994 2 0 0 20 0 1 0 78003963 56463360 13467 18446744073709551615 4198400 8956741 140734141072624 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 23056384 140734141077875 140734141077994 140734141077994 140734141083596 0
/proc/89883/statm: 13785 13467 1184 1162 0 12394 0
Current children cumulated CPU time: 3599.96 s
Current children cumulated vsize: 59332 KiB
Current children cumulated memory: 56940 KiB

Child status: 0

Real time (s): 3610.07
CPU time (s): 3600.04
CPU user time (s): 3600.02
CPU system time (s): 0.022898
CPU usage (%): 99.722
Max. virtual memory (cumulated for all children) (KiB): 59332
Max. memory (cumulated for all children) (KiB): 56940

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3600.02
system time used= 0.022898
maximum resident set size= 55920
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8182
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 113
involuntary context switches= 8513


# summary of solver processes directly reported to runsolver:
#   pid: 89872
#   total CPU time (s): 3600.04
#   total CPU user time (s): 3600.02
#   total CPU system time (s): 0.022898

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.17584 second user time and 11.4179 second system time

The end