runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63665 MiB (62934 MiB free)
  memory of node 1: 64507 MiB (64008 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4488784-1751348337/watcher-4488784-1751348337 -o /tmp/evaluation-result-4488784-1751348337/solver-4488784-1751348337 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC022-1751348337-50532 --watchdog 3760 toulbar2.sh toulbar2 HOME/instance-4488784-1751348337.opb -timer=3600 -hve=512 -f=3 -n: -precision=0 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 5.14.0-503.14.1.el9_5.x86_64
Linux 5.14.0-503.14.1.el9_5.x86_64
Starting watchdog thread
solver pid=50582, runsolver pid=50573
Current StackSize limit: 8192 KiB


[startup+0.100064 s]*
/proc/loadavg: 1.67 3.39 3.84 6/270 50595
/proc/meminfo: memFree=129872416/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=41008 memory=31872 CPUtime=0.08 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7052 0 0 0 7 1 0 0 20 0 1 0 50511468 41992192 7968 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10252 7968 1024 1162 0 8861 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 45200 KiB
Current children cumulated memory: 34944 KiB

[startup+0.205921 s]*
/proc/loadavg: 1.67 3.39 3.84 6/270 50595
/proc/meminfo: memFree=129872556/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=41452 memory=33152 CPUtime=0.19 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7277 0 0 0 18 1 0 0 20 0 1 0 50511468 42446848 8288 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10363 8288 1152 1162 0 8972 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 45644 KiB
Current children cumulated memory: 36224 KiB

[startup+0.305209 s]*
/proc/loadavg: 1.67 3.39 3.84 6/270 50595
/proc/meminfo: memFree=129872556/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=41608 memory=33280 CPUtime=0.28 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7293 0 0 0 27 1 0 0 20 0 1 0 50511468 42606592 8320 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10402 8320 1152 1162 0 9011 0
Current children cumulated CPU time: 0.28 s
Current children cumulated vsize: 45800 KiB
Current children cumulated memory: 36352 KiB

[startup+0.700142 s]
/proc/loadavg: 1.67 3.39 3.84 6/270 50595
/proc/meminfo: memFree=129872556/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=41804 memory=33536 CPUtime=0.67 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7359 0 0 0 66 1 0 0 20 0 1 0 50511468 42807296 8384 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10451 8384 1152 1162 0 9060 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 45996 KiB
Current children cumulated memory: 36608 KiB

[startup+1.50014 s]
/proc/loadavg: 1.67 3.39 3.84 6/270 50595
/proc/meminfo: memFree=129872812/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=42192 memory=33780 CPUtime=1.47 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7473 0 0 0 146 1 0 0 20 0 1 0 50511468 43204608 8445 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10548 8445 1152 1162 0 9157 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 46384 KiB
Current children cumulated memory: 36852 KiB

[startup+3.10486 s]
/proc/loadavg: 1.85 3.40 3.84 6/270 50595
/proc/meminfo: memFree=129872984/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=42768 memory=34116 CPUtime=3.07 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7698 0 0 0 306 1 0 0 20 0 1 0 50511468 43794432 8529 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10692 8529 1152 1162 0 9301 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 46960 KiB
Current children cumulated memory: 37188 KiB

[startup+6.30013 s]
/proc/loadavg: 1.85 3.40 3.84 6/271 50597
/proc/meminfo: memFree=129872568/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=43152 memory=34704 CPUtime=6.25 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 7951 0 0 0 624 1 0 0 20 0 1 0 50511468 44187648 8676 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 10788 8676 1152 1162 0 9397 0
Current children cumulated CPU time: 6.25 s
Current children cumulated vsize: 47344 KiB
Current children cumulated memory: 37776 KiB

[startup+12.7001 s]
/proc/loadavg: 2.26 3.44 3.85 6/271 50597
/proc/meminfo: memFree=129871852/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=44688 memory=35572 CPUtime=12.65 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 8570 0 0 0 1263 2 0 0 20 0 1 0 50511468 45760512 8893 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 11172 8893 1152 1162 0 9781 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 48880 KiB
Current children cumulated memory: 38644 KiB

[startup+25.5002 s]
/proc/loadavg: 2.53 3.45 3.85 6/271 50597
/proc/meminfo: memFree=129867096/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=47760 memory=37996 CPUtime=25.4 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 9415 0 0 0 2538 2 0 0 20 0 1 0 50511468 48906240 9499 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 11940 9499 1152 1162 0 10549 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 51952 KiB
Current children cumulated memory: 41068 KiB

[startup+51.1049 s]
/proc/loadavg: 3.03 3.50 3.86 6/270 50597
/proc/meminfo: memFree=129863676/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=53904 memory=41964 CPUtime=50.94 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 10407 0 0 0 5092 2 0 0 20 0 1 0 50511468 55197696 10491 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 13476 10491 1152 1162 0 12085 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 58096 KiB
Current children cumulated memory: 45036 KiB

[startup+102.3 s]
/proc/loadavg: 3.73 3.62 3.88 6/270 50599
/proc/meminfo: memFree=129808908/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=66192 memory=51088 CPUtime=102 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 11503 0 0 0 10197 3 0 0 20 0 1 0 50511468 67780608 12772 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 16548 12772 1152 1162 0 15157 0
Current children cumulated CPU time: 102 s
Current children cumulated vsize: 70384 KiB
Current children cumulated memory: 54160 KiB

[startup+162.3 s]
/proc/loadavg: 3.97 3.71 3.89 6/270 50601
/proc/meminfo: memFree=129760736/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=78480 memory=65084 CPUtime=161.84 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 11847 0 0 0 16181 3 0 0 20 0 1 0 50511468 80363520 16271 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 19620 16271 1152 1162 0 18229 0
Current children cumulated CPU time: 161.84 s
Current children cumulated vsize: 82672 KiB
Current children cumulated memory: 68156 KiB

[startup+222.3 s]
/proc/loadavg: 4.03 3.78 3.91 6/269 50603
/proc/meminfo: memFree=129710220/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=90768 memory=72424 CPUtime=221.7 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 12168 0 0 0 22166 4 0 0 20 0 1 0 50511468 92946432 18106 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 22692 18106 1152 1162 0 21301 0
Current children cumulated CPU time: 221.7 s

################
# More data... #
################

/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16222 0 0 0 333361 15 0 0 20 0 1 0 50511468 446312448 70011 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 70011 1152 1162 0 107572 0
Current children cumulated CPU time: 3333.76 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 283116 KiB

[startup+3402.3 s]
/proc/loadavg: 4.13 4.25 4.14 6/268 50769
/proc/meminfo: memFree=128880084/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=282096 CPUtime=3393.6 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16290 0 0 0 339345 15 0 0 20 0 1 0 50511468 446312448 70524 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 70524 1152 1162 0 107572 0
Current children cumulated CPU time: 3393.6 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 285168 KiB

[startup+3462.3 s]
/proc/loadavg: 4.16 4.23 4.14 6/268 50771
/proc/meminfo: memFree=128864640/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=286208 CPUtime=3453.45 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16317 0 0 0 345330 15 0 0 20 0 1 0 50511468 446312448 71552 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 71552 1152 1162 0 107572 0
Current children cumulated CPU time: 3453.45 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 289280 KiB

[startup+3522.3 s]
/proc/loadavg: 4.12 4.20 4.14 6/267 50773
/proc/meminfo: memFree=128819944/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=290320 CPUtime=3513.3 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16384 0 0 0 351315 15 0 0 20 0 1 0 50511468 446312448 72580 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 72580 1152 1162 0 107572 0
Current children cumulated CPU time: 3513.3 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 293392 KiB

[startup+3582.3 s]
/proc/loadavg: 4.09 4.18 4.13 6/268 50776
/proc/meminfo: memFree=128811464/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=290320 CPUtime=3573.14 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16432 0 0 0 357299 15 0 0 20 0 1 0 50511468 446312448 72580 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 72580 1152 1162 0 107572 0
Current children cumulated CPU time: 3573.14 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 293392 KiB

[startup+3608.9 s]
# the end of solver process 50582 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3599.53 s, system=0.157866 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.08 4.17 4.13 6/268 50776
/proc/meminfo: memFree=128811488/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=290320 CPUtime=3574.84 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16434 0 0 0 357469 15 0 0 20 0 1 0 50511468 446312448 72580 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 72580 1152 1162 0 107572 0
Current children cumulated CPU time: 3574.84 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 293392 KiB

[startup+3596.8 s]
/proc/loadavg: 4.14 4.18 4.14 6/268 50776
/proc/meminfo: memFree=128807432/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=294428 CPUtime=3587.61 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16460 0 0 0 358746 15 0 0 20 0 1 0 50511468 446312448 73607 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 73607 1152 1162 0 107572 0
Current children cumulated CPU time: 3587.61 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 297500 KiB

[startup+3603.2 s]
/proc/loadavg: 4.12 4.18 4.13 6/268 50776
/proc/meminfo: memFree=128803368/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=294428 CPUtime=3593.99 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16461 0 0 0 359384 15 0 0 20 0 1 0 50511468 446312448 73607 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 73607 1152 1162 0 107572 0
Current children cumulated CPU time: 3593.99 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 297500 KiB

[startup+3606.4 s]
/proc/loadavg: 4.12 4.18 4.13 6/268 50777
/proc/meminfo: memFree=128803880/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=294428 CPUtime=3597.18 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16461 0 0 0 359703 15 0 0 20 0 1 0 50511468 446312448 73607 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 73607 1152 1162 0 107572 0
Current children cumulated CPU time: 3597.18 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 297500 KiB

[startup+3608 s]*
/proc/loadavg: 4.11 4.17 4.13 6/268 50777
/proc/meminfo: memFree=128803880/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=294428 CPUtime=3598.78 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16461 0 0 0 359863 15 0 0 20 0 1 0 50511468 446312448 73607 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 73607 1152 1162 0 107572 0
Current children cumulated CPU time: 3598.78 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 297500 KiB

[startup+3608.4 s]
/proc/loadavg: 4.11 4.17 4.13 6/268 50777
/proc/meminfo: memFree=128803880/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=294428 CPUtime=3599.18 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16461 0 0 0 359903 15 0 0 20 0 1 0 50511468 446312448 73607 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 73607 1152 1162 0 107572 0
Current children cumulated CPU time: 3599.18 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 297500 KiB

[startup+3608.8 s]
/proc/loadavg: 4.11 4.17 4.13 6/268 50777
/proc/meminfo: memFree=128803880/131249996 swapFree=33010416/33010684
[pid=50582] ppid=50573 vsize=4192 memory=3072 CPUtime=0 cores=0,2
/proc/50582/stat : 50582 (toulbar2.sh) S 50573 50582 50522 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 50511467 4292608 768 18446744073709551615 94172119252992 94172120147525 140730428193568 0 0 0 65536 4 65538 1 0 0 17 0 0 0 0 0 0 94172120386576 94172120434320 94172144889856 140730428197175 140730428197351 140730428197351 140730428202953 0
/proc/50582/statm: 1048 768 704 219 0 110 0
[pid=50585] ppid=50582 vsize=435852 memory=294428 CPUtime=3599.58 cores=0,2
/proc/50585/stat : 50585 (toulbar2) R 50582 50582 50522 0 -1 4194304 16461 0 0 0 359943 15 0 0 20 0 1 0 50511468 446312448 73607 18446744073709551615 4198400 8956741 140731723302960 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 31342592 140731723311477 140731723311596 140731723311596 140731723317196 0
/proc/50585/statm: 108963 73607 1152 1162 0 107572 0
Current children cumulated CPU time: 3599.58 s
Current children cumulated vsize: 440044 KiB
Current children cumulated memory: 297500 KiB

Child status: 0

Real time (s): 3608.9
CPU time (s): 3599.69
CPU user time (s): 3599.53
CPU system time (s): 0.157866
CPU usage (%): 99.7448
Max. virtual memory (cumulated for all children) (KiB): 440044
Max. memory (cumulated for all children) (KiB): 297500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3599.53
system time used= 0.157866
maximum resident set size= 357028
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16676
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 109
involuntary context switches= 7960


# summary of solver processes directly reported to runsolver:
#   pid: 50582
#   total CPU time (s): 3599.69
#   total CPU user time (s): 3599.53
#   total CPU system time (s): 0.157866

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.68218 second user time and 12.4439 second system time

The end