runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63708 MiB (61870 MiB free)
  memory of node 1: 64465 MiB (62735 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4525652-1751626683/watcher-4525652-1751626683 -o /tmp/evaluation-result-4525652-1751626683/solver-4525652-1751626683 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC028-1751617353-88057 --watchdog 3760 toulbar2.sh toulbar2 HOME/instance-4525652-1751626683.wbo -timer=3600 -hve=512 -f=3 -n: -precision=0 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 5.14.0-503.14.1.el9_5.x86_64
Linux 5.14.0-503.14.1.el9_5.x86_64
Starting watchdog thread
solver pid=89859, runsolver pid=89856
Current StackSize limit: 8192 KiB


[startup+0.100063 s]*
/proc/loadavg: 4.20 4.14 4.10 5/268 89861
/proc/meminfo: memFree=127508904/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=98520 memory=85476 CPUtime=0.08 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 21171 0 0 0 5 3 0 0 20 0 1 0 78290833 100884480 21369 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 6 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 24630 21369 864 1162 0 23239 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 102712 KiB
Current children cumulated memory: 88420 KiB

[startup+0.205605 s]*
/proc/loadavg: 4.20 4.14 4.10 5/268 89861
/proc/meminfo: memFree=127434060/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=185616 memory=170876 CPUtime=0.19 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 43445 0 0 0 12 7 0 0 20 0 1 0 78290833 190070784 42719 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 46404 42719 864 1162 0 45013 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 189808 KiB
Current children cumulated memory: 173820 KiB

[startup+0.305551 s]*
/proc/loadavg: 4.20 4.14 4.10 5/268 89861
/proc/meminfo: memFree=127369800/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=267588 memory=255988 CPUtime=0.28 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 64203 0 0 0 18 10 0 0 20 0 1 0 78290833 274010112 63997 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 66897 63997 864 1162 0 65506 0
Current children cumulated CPU time: 0.28 s
Current children cumulated vsize: 271780 KiB
Current children cumulated memory: 258932 KiB

[startup+0.700211 s]
/proc/loadavg: 4.20 4.14 4.10 5/268 89861
/proc/meminfo: memFree=127199572/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=592964 memory=581440 CPUtime=0.67 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 144554 0 0 0 46 21 0 0 20 0 1 0 78290833 607195136 145360 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 148241 145360 864 1162 0 146850 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 597156 KiB
Current children cumulated memory: 584384 KiB

[startup+1.5002 s]
/proc/loadavg: 4.20 4.14 4.10 5/268 89861
/proc/meminfo: memFree=126786540/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=1132216 memory=1114656 CPUtime=1.47 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 274769 0 0 0 106 41 0 0 20 0 1 0 78290833 1159389184 278664 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 283054 278664 896 1162 0 281663 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 1136408 KiB
Current children cumulated memory: 1117600 KiB

[startup+3.1054 s]
/proc/loadavg: 4.20 4.14 4.10 5/268 89861
/proc/meminfo: memFree=125939692/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=1733392 memory=1713192 CPUtime=3.08 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 422380 0 0 0 246 62 0 0 20 0 1 0 78290833 1774993408 428298 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 433348 428298 896 1162 0 431957 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 1737584 KiB
Current children cumulated memory: 1716136 KiB

[startup+6.30019 s]
/proc/loadavg: 4.18 4.13 4.10 5/268 89861
/proc/meminfo: memFree=124806572/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=2936884 memory=2916196 CPUtime=6.26 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 719556 0 0 0 517 109 0 0 20 0 1 0 78290833 3007369216 729049 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 734221 729049 896 1162 0 732830 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 2941076 KiB
Current children cumulated memory: 2919140 KiB

[startup+12.7002 s]
/proc/loadavg: 4.17 4.13 4.10 5/268 89862
/proc/meminfo: memFree=121536040/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=6482004 memory=6443376 CPUtime=12.64 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1583972 0 0 0 1020 244 0 0 20 0 1 0 78290833 6637572096 1610844 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1620501 1610844 928 1162 0 1619110 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 6486196 KiB
Current children cumulated memory: 6446320 KiB

[startup+25.5002 s]
/proc/loadavg: 4.13 4.12 4.10 5/266 89862
/proc/meminfo: memFree=120503360/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7108980 memory=7075340 CPUtime=25.42 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1745806 0 0 0 2264 278 0 0 20 0 1 0 78290833 7279595520 1768835 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1777245 1768835 1024 1162 0 1775854 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 7113172 KiB
Current children cumulated memory: 7078284 KiB

[startup+51.1055 s]
/proc/loadavg: 4.08 4.11 4.09 5/266 89862
/proc/meminfo: memFree=120148044/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7488676 memory=7452624 CPUtime=50.95 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1823332 0 0 0 4803 292 0 0 20 0 1 0 78290833 7668404224 1863156 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1872169 1863156 1024 1162 0 1870778 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 7492868 KiB
Current children cumulated memory: 7455568 KiB

[startup+102.3 s]
/proc/loadavg: 4.09 4.11 4.09 5/266 89864
/proc/meminfo: memFree=119882808/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7732580 memory=7693816 CPUtime=102.01 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1863448 0 0 0 9898 303 0 0 20 0 1 0 78290833 7918161920 1923454 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1933145 1923454 1152 1162 0 1931754 0
Current children cumulated CPU time: 102.01 s
Current children cumulated vsize: 7736772 KiB
Current children cumulated memory: 7696760 KiB

[startup+162.3 s]
/proc/loadavg: 4.08 4.10 4.09 5/267 89867
/proc/meminfo: memFree=119872540/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7739080 memory=7700352 CPUtime=161.85 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1864145 0 0 0 15877 308 0 0 20 0 1 0 78290833 7924817920 1925088 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1934770 1925088 1152 1162 0 1933379 0
Current children cumulated CPU time: 161.85 s
Current children cumulated vsize: 7743272 KiB
Current children cumulated memory: 7703296 KiB

[startup+222.3 s]
/proc/loadavg: 4.14 4.11 4.09 5/267 89880
/proc/meminfo: memFree=119867352/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7740616 memory=7701248 CPUtime=221.7 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1864384 0 0 0 21859 311 0 0 20 0 1 0 78290833 7926390784 1925312 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1935154 1925312 1152 1162 0 1933763 0
Current children cumulated CPU time: 221.7 s

################
# More data... #
################

/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749832 memory=7710720 CPUtime=1059.56 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865728 0 0 0 105615 341 0 0 20 0 1 0 78290833 7935827968 1927680 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937458 1927680 1152 1162 0 1936067 0
Current children cumulated CPU time: 1059.56 s
Current children cumulated vsize: 7754024 KiB
Current children cumulated memory: 7713664 KiB

[startup+1122.3 s]
/proc/loadavg: 4.07 4.08 4.09 5/269 89927
/proc/meminfo: memFree=119814508/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749832 memory=7710720 CPUtime=1119.4 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865757 0 0 0 111597 343 0 0 20 0 1 0 78290833 7935827968 1927680 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937458 1927680 1152 1162 0 1936067 0
Current children cumulated CPU time: 1119.4 s
Current children cumulated vsize: 7754024 KiB
Current children cumulated memory: 7713664 KiB

[startup+1182.3 s]
/proc/loadavg: 4.08 4.08 4.09 5/268 89929
/proc/meminfo: memFree=119814904/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749832 memory=7710720 CPUtime=1179.26 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865793 0 0 0 117580 346 0 0 20 0 1 0 78290833 7935827968 1927680 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937458 1927680 1152 1162 0 1936067 0
Current children cumulated CPU time: 1179.26 s
Current children cumulated vsize: 7754024 KiB
Current children cumulated memory: 7713664 KiB

[startup+1242.3 s]
/proc/loadavg: 4.07 4.08 4.09 5/266 89931
/proc/meminfo: memFree=119818568/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749832 memory=7710720 CPUtime=1239.1 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865822 0 0 0 123562 348 0 0 20 0 1 0 78290833 7935827968 1927680 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937458 1927680 1152 1162 0 1936067 0
Current children cumulated CPU time: 1239.1 s
Current children cumulated vsize: 7754024 KiB
Current children cumulated memory: 7713664 KiB

[startup+1302.3 s]
/proc/loadavg: 4.12 4.09 4.09 5/266 89933
/proc/meminfo: memFree=119819388/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749832 memory=7710720 CPUtime=1298.96 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865858 0 0 0 129545 351 0 0 20 0 1 0 78290833 7935827968 1927680 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937458 1927680 1152 1162 0 1936067 0
Current children cumulated CPU time: 1298.96 s
Current children cumulated vsize: 7754024 KiB
Current children cumulated memory: 7713664 KiB

[startup+1362.3 s]
/proc/loadavg: 4.04 4.07 4.08 5/266 89934
/proc/meminfo: memFree=119821060/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749832 memory=7710720 CPUtime=1358.8 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865895 0 0 0 135527 353 0 0 20 0 1 0 78290833 7935827968 1927680 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937458 1927680 1152 1162 0 1936067 0
Current children cumulated CPU time: 1358.8 s
Current children cumulated vsize: 7754024 KiB
Current children cumulated memory: 7713664 KiB

[startup+1422.3 s]
/proc/loadavg: 4.12 4.09 4.09 5/266 89936
/proc/meminfo: memFree=119824320/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7749988 memory=7710848 CPUtime=1418.65 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1865974 0 0 0 141509 356 0 0 20 0 1 0 78290833 7935987712 1927712 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937497 1927712 1152 1162 0 1936106 0
Current children cumulated CPU time: 1418.65 s
Current children cumulated vsize: 7754180 KiB
Current children cumulated memory: 7713792 KiB

[startup+1482.3 s]
/proc/loadavg: 4.10 4.09 4.09 5/267 89941
/proc/meminfo: memFree=119843224/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7751036 memory=7711872 CPUtime=1478.5 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1866265 0 0 0 147491 359 0 0 20 0 1 0 78290833 7937060864 1927968 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937759 1927968 1152 1162 0 1936368 0
Current children cumulated CPU time: 1478.5 s
Current children cumulated vsize: 7755228 KiB
Current children cumulated memory: 7714816 KiB

[startup+1484.4 s]
# the end of solver process 89859 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=1476.84 s, system=3.76663 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1483.2 s]
/proc/loadavg: 4.10 4.09 4.09 5/267 89941
/proc/meminfo: memFree=119843224/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7751092 memory=7712000 CPUtime=1479.4 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1866279 0 0 0 147581 359 0 0 20 0 1 0 78290833 7937118208 1928000 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937773 1928000 1152 1162 0 1936382 0
Current children cumulated CPU time: 1479.4 s
Current children cumulated vsize: 7755284 KiB
Current children cumulated memory: 7714944 KiB

[startup+1484 s]*
/proc/loadavg: 4.09 4.09 4.09 5/267 89941
/proc/meminfo: memFree=119843224/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7751128 memory=7712000 CPUtime=1480.2 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1866288 0 0 0 147661 359 0 0 20 0 1 0 78290833 7937155072 1928000 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937782 1928000 1152 1162 0 1936391 0
Current children cumulated CPU time: 1480.2 s
Current children cumulated vsize: 7755320 KiB
Current children cumulated memory: 7714944 KiB

[startup+1484.2 s]
/proc/loadavg: 4.09 4.09 4.09 5/267 89941
/proc/meminfo: memFree=119843224/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
[pid=89861] ppid=89859 vsize=7751156 memory=7712000 CPUtime=1480.4 cores=4,6
/proc/89861/stat : 89861 (toulbar2) R 89859 89859 88046 0 -1 4194304 1866358 0 0 0 147681 359 0 0 20 0 1 0 78290833 7937183744 1928000 18446744073709551615 4198400 8956741 140720546626656 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 23564288 140720546634099 140720546634218 140720546634218 140720546639820 0
/proc/89861/statm: 1937789 1928000 1152 1162 0 1936398 0
Current children cumulated CPU time: 1480.4 s
Current children cumulated vsize: 7755348 KiB
Current children cumulated memory: 7714944 KiB

[startup+1484.3 s]
/proc/loadavg: 4.09 4.09 4.09 5/267 89941
/proc/meminfo: memFree=119843224/131250000 swapFree=33010684/33010684
[pid=89859] ppid=89856 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/89859/stat : 89859 (toulbar2.sh) S 89856 89859 88046 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78290832 4292608 736 18446744073709551615 94795645906944 94795646801477 140723516599552 0 0 0 65536 4 65538 1 0 0 17 4 0 0 0 0 0 94795647040528 94795647088272 94795649978368 140723516602677 140723516602853 140723516602853 140723516608457 0
/proc/89859/statm: 1048 736 672 219 0 110 0
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 4192 KiB
Current children cumulated memory: 2944 KiB

Child status: 0

Real time (s): 1484.4
CPU time (s): 1480.6
CPU user time (s): 1476.84
CPU system time (s): 3.76663
CPU usage (%): 99.7443
Max. virtual memory (cumulated for all children) (KiB): 7755348
Max. memory (cumulated for all children) (KiB): 7714944

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1476.84
system time used= 3.76663
maximum resident set size= 7712128
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1866987
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 86
involuntary context switches= 1732


# summary of solver processes directly reported to runsolver:
#   pid: 89859
#   total CPU time (s): 1480.6
#   total CPU user time (s): 1476.84
#   total CPU system time (s): 3.76663

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 2.63339 second user time and 6.15385 second system time

The end