runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13393 MiB free)
  memory of node 1: 16384 MiB (14316 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4301539-1532883022/watcher-4301539-1532883022 -o /tmp/evaluation-result-4301539-1532883022/solver-4301539-1532883022 -C 252 -W 252 -M 15500 --bin-var /tmp/runsolver-exch-node134-1532878455-19305 --watchdog 312 HOME/cosoco -lc -model -restarts HOME/instance-4301539-1532883022.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 282 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22027, runsolver pid=22024

[startup+0.10011 s]*
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28368572/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=34124 memory=10460 CPUtime=0.1 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 2777 0 0 0 10 0 0 0 20 0 1 0 105865448 34942976 2615 33554432000 4194304 6142532 140732703375792 140732703372424 139779030567936 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 8531 2615 802 476 0 1853 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 34124 KiB
Current children cumulated memory: 10460 KiB

[startup+0.209821 s]*
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28365224/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=37408 memory=13716 CPUtime=0.21 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 3594 0 0 0 21 0 0 0 20 0 1 0 105865448 38305792 3429 33554432000 4194304 6142532 140732703375792 140732703370264 139779030129637 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 9352 3429 802 476 0 2674 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 37408 KiB
Current children cumulated memory: 13716 KiB

[startup+0.309461 s]*
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28361132/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=41564 memory=17872 CPUtime=0.31 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 4634 0 0 0 31 0 0 0 20 0 1 0 105865448 42561536 4468 33554432000 4194304 6142532 140732703375792 140732703365144 139779030129637 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 10391 4468 802 476 0 3713 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41564 KiB
Current children cumulated memory: 17872 KiB

[startup+0.70024 s]
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28352576/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=57620 memory=33788 CPUtime=0.68 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 8657 0 0 0 68 0 0 0 20 0 1 0 105865448 59002880 8447 33554432000 4194304 6142532 140732703375792 140732703365144 139779030129637 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 14405 8447 802 476 0 7727 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 57620 KiB
Current children cumulated memory: 33788 KiB

[startup+1.50027 s]
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28332116/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=91248 memory=67556 CPUtime=1.49 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 17069 0 0 0 147 2 0 0 20 0 1 0 105865448 93437952 16889 33554432000 4194304 6142532 140732703375792 140732703366392 139779030129637 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 22812 16889 802 476 0 16134 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 91248 KiB
Current children cumulated memory: 67556 KiB

[startup+3.10982 s]
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28285664/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116544 memory=92964 CPUtime=3.09 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 44915 0 0 0 305 4 0 0 20 0 1 0 105865448 119341056 23241 33554432000 4194304 6142532 140732703375792 140732703370264 5375774 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29136 23241 845 476 0 22458 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 116544 KiB
Current children cumulated memory: 92964 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28285004/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116808 memory=93364 CPUtime=6.29 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 67356 0 0 0 624 5 0 0 20 0 1 0 105865448 119611392 23341 33554432000 4194304 6142532 140732703375792 140732703372504 5361201 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29202 23341 846 476 0 22524 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 116808 KiB
Current children cumulated memory: 93364 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.99 2.03 3/192 22028
/proc/meminfo: memFree=28285004/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93420 CPUtime=12.69 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 89812 0 0 0 1263 6 0 0 20 0 1 0 105865448 119746560 23355 33554432000 4194304 6142532 140732703375792 140732703363064 5361236 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23355 846 476 0 22557 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93420 KiB

[startup+25.5002 s]
/proc/loadavg: 2.08 2.00 2.04 3/192 22089
/proc/meminfo: memFree=28211924/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93532 CPUtime=25.48 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 129761 0 0 0 2541 7 0 0 20 0 1 0 105865448 119746560 23383 33554432000 4194304 6142532 140732703375792 140732703373320 5363546 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23383 846 476 0 22557 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93532 KiB

[startup+51.1098 s]
/proc/loadavg: 2.05 2.00 2.04 3/192 22089
/proc/meminfo: memFree=28211564/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93572 CPUtime=51.09 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 144961 0 0 0 5101 8 0 0 20 0 1 0 105865448 119746560 23393 33554432000 4194304 6142532 140732703375792 140732703363064 5047904 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23393 846 476 0 22557 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93572 KiB

[startup+102.3 s]
/proc/loadavg: 2.11 2.03 2.05 3/191 22090
/proc/meminfo: memFree=28210792/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93580 CPUtime=102.27 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 146989 0 0 0 10219 8 0 0 20 0 1 0 105865448 119746560 23395 33554432000 4194304 6142532 140732703375792 140732703363064 5361433 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23395 846 476 0 22557 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93580 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/191 22091
/proc/meminfo: memFree=28209320/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93580 CPUtime=162.27 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 147478 0 0 0 16219 8 0 0 20 0 1 0 105865448 119746560 23395 33554432000 4194304 6142532 140732703375792 140732703363064 5396698 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23395 846 476 0 22557 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93580 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/192 22093
/proc/meminfo: memFree=28209392/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93580 CPUtime=222.27 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 147965 0 0 0 22219 8 0 0 20 0 1 0 105865448 119746560 23395 33554432000 4194304 6142532 140732703375792 140732703363064 5051889 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23395 846 476 0 22557 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93580 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252 s]*
/proc/loadavg: 2.35 2.10 2.07 3/192 22093
/proc/meminfo: memFree=28209392/32770624 swapFree=67108744/67108860
[pid=22027] ppid=22024 vsize=116940 memory=93580 CPUtime=251.98 cores=1,3,5,7
/proc/22027/stat : 22027 (cosoco) R 22024 22027 19273 0 -1 4202496 148451 0 0 0 25190 8 0 0 20 0 1 0 105865448 119746560 23395 33554432000 4194304 6142532 140732703375792 140732703363064 5367159 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 18608128 140732703384715 140732703384845 140732703384845 140732703387598 0
/proc/22027/statm: 29235 23395 846 476 0 22557 0
Current children cumulated CPU time: 251.98 s
Current children cumulated vsize: 116940 KiB
Current children cumulated memory: 93580 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.01 s]
# the end of solver process 22027 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=251.905 s, system=0.088999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.01
CPU time (s): 251.994
CPU user time (s): 251.905
CPU system time (s): 0.088999
CPU usage (%): 99.9933
Max. virtual memory (cumulated for all children) (KiB): 116940
Max. memory (cumulated for all children) (KiB): 93580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 251.905
system time used= 0.088999
maximum resident set size= 93648
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 148495
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31
involuntary context switches= 77


# summary of solver processes directly reported to runsolver:
#   pid: 22027
#   total CPU time (s): 251.994
#   total CPU user time (s): 251.905
#   total CPU system time (s): 0.088999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.933091 second user time and 1.78526 second system time

The end