Trace number 4397204

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1128.67 1130.62

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-19-020-009.xml
MD5SUM62ee24bcba75d1d33fbbd4bb45a854a0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4
Best CPU time to get the best result obtained on this benchmark1412.74
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints191
Number of domains2
Minimum domain size2
Maximum domain size17
Distribution of domain sizes[{"size":2,"count":380},{"size":17,"count":1}]
Minimum variable degree20
Maximum variable degree172
Distribution of variable degrees[{"degree":20,"count":380},{"degree":172,"count":1}]
Minimum constraint arity20
Maximum constraint arity380
Distribution of constraint arities[{"arity":20,"count":19},{"arity":41,"count":171},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":190}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14361 MiB free)
  memory of node 1: 16384 MiB (7138 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397204-1568576798/watcher-4397204-1568576798 -o /tmp/evaluation-result-4397204-1568576798/solver-4397204-1568576798 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1568572743-13957 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4397204-1568576798.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=14963, runsolver pid=14960

[startup+0.100089 s]*
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=22014136/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=28988 memory=5272 CPUtime=0.1 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 1518 0 0 0 10 0 0 0 20 0 1 0 433930262 29683712 1318 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 7247 1318 846 493 0 552 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28988 KiB
Current children cumulated memory: 5272 KiB

[startup+0.20983 s]*
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=22011532/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=30432 memory=6856 CPUtime=0.21 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 1894 0 0 0 21 0 0 0 20 0 1 0 433930262 31162368 1714 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 7608 1714 846 493 0 913 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30432 KiB
Current children cumulated memory: 6856 KiB

[startup+0.309176 s]*
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=22008556/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=31876 memory=8176 CPUtime=0.31 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 2238 0 0 0 31 0 0 0 20 0 1 0 433930262 32641024 2044 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 7969 2044 846 493 0 1274 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31876 KiB
Current children cumulated memory: 8176 KiB

[startup+0.700229 s]
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=22003968/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=37368 memory=13448 CPUtime=0.69 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 3562 0 0 0 69 0 0 0 20 0 1 0 433930262 38264832 3362 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 9342 3362 846 493 0 2647 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 37368 KiB
Current children cumulated memory: 13448 KiB

[startup+1.50023 s]
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=21989684/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=48732 memory=24592 CPUtime=1.49 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 6333 0 0 0 149 0 0 0 20 0 1 0 433930262 49901568 6148 33554432000 4194304 6211092 140735824287488 140735824273496 5013258 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 12183 6148 846 493 0 5488 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 48732 KiB
Current children cumulated memory: 24592 KiB

[startup+3.10967 s]
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=21936056/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=70548 memory=46892 CPUtime=3.1 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 11944 0 0 0 309 1 0 0 20 0 1 0 433930262 72241152 11723 33554432000 4194304 6211092 140735824287488 140735824273496 5476816 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 17637 11723 846 493 0 10942 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70548 KiB
Current children cumulated memory: 46892 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.02 1.98 3/204 14964
/proc/meminfo: memFree=21854956/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=115332 memory=90956 CPUtime=6.28 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 23033 0 0 0 626 2 0 0 20 0 1 0 433930262 118099968 22739 33554432000 4194304 6211092 140735824287488 140735824273496 5456298 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 28833 22739 846 493 0 22138 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 115332 KiB
Current children cumulated memory: 90956 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.02 1.98 3/204 14965
/proc/meminfo: memFree=21691652/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=206328 memory=181040 CPUtime=12.68 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 44550 0 0 0 1262 6 0 0 20 0 1 0 433930262 211279872 45260 33554432000 4194304 6211092 140735824287488 140735824273496 5451572 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 51582 45260 846 493 0 44887 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 206328 KiB
Current children cumulated memory: 181040 KiB

[startup+25.5002 s]
/proc/loadavg: 2.00 2.02 1.98 3/204 14965
/proc/meminfo: memFree=21341748/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=390256 memory=358396 CPUtime=25.48 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 87414 0 0 0 2537 11 0 0 20 0 1 0 433930262 399622144 89599 33554432000 4194304 6211092 140735824287488 140735824273496 140267845731916 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 97564 89599 846 493 0 90869 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 390256 KiB
Current children cumulated memory: 358396 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.01 1.98 3/204 14967
/proc/meminfo: memFree=20641696/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=737748 memory=712072 CPUtime=51.09 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 170757 0 0 0 5087 22 0 0 20 0 1 0 433930262 755453952 178018 33554432000 4194304 6211092 140735824287488 140735824273496 5454180 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 184437 178018 846 493 0 177742 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 737748 KiB
Current children cumulated memory: 712072 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 1.98 3/204 14972
/proc/meminfo: memFree=19269144/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=1461364 memory=1421196 CPUtime=102.27 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 336838 0 0 0 10184 43 0 0 20 0 1 0 433930262 1496436736 355299 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 365341 355299 846 493 0 358646 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1461364 KiB
Current children cumulated memory: 1421196 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.03 1.99 3/204 14976
/proc/meminfo: memFree=17654340/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=2292420 memory=2252192 CPUtime=162.26 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 531299 0 0 0 16160 66 0 0 20 0 1 0 433930262 2347438080 563048 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 573105 563048 846 493 0 566410 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 2292420 KiB
Current children cumulated memory: 2252192 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 1.99 3/204 14982
/proc/meminfo: memFree=16035636/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=3151380 memory=3084788 CPUtime=222.25 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 725622 0 0 0 22134 91 0 0 20 0 1 0 433930262 3227013120 771197 33554432000 4194304 6211092 140735824287488 140735824273496 5451484 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 787845 771197 846 493 0 781150 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 3151380 KiB
Current children cumulated memory: 3084788 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 2.03 1.99 3/205 14995
/proc/meminfo: memFree=14423584/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=4051744 memory=3913840 CPUtime=282.24 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 920162 0 0 0 28110 114 0 0 20 0 1 0 433930262 4148985856 978460 33554432000 4194304 6211092 140735824287488 140735824273496 5012912 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 1012936 978460 846 493 0 1006241 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 4051744 KiB
Current children cumulated memory: 3913840 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.03 1.99 3/205 14999
/proc/meminfo: memFree=12808656/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=4827752 memory=4745064 CPUtime=342.23 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 1114295 0 0 0 34081 142 0 0 20 0 1 0 433930262 4943618048 1186266 33554432000 4194304 6211092 140735824287488 140735824273496 5451532 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 1206938 1186266 846 493 0 1200243 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 4827752 KiB
Current children cumulated memory: 4745064 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.02 1.99 3/205 15005
/proc/meminfo: memFree=11192884/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=5604080 memory=5576100 CPUtime=402.22 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 1308297 0 0 0 40049 173 0 0 20 0 1 0 433930262 5738577920 1394025 33554432000 4194304 6211092 140735824287488 140735824273496 5013073 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 1401020 1394025 846 493 0 1394325 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 5604080 KiB
Current children cumulated memory: 5576100 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/205 15009
/proc/meminfo: memFree=9577788/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=6566172 memory=6406116 CPUtime=462.21 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 1503137 0 0 0 46020 201 0 0 20 0 1 0 433930262 6723760128 1601529 33554432000 4194304 6211092 140735824287488 140735824273496 5443042 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 1641543 1601529 846 493 0 1634848 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 6566172 KiB
Current children cumulated memory: 6406116 KiB


################
# More data... #
################

Current children cumulated vsize: 9174128 KiB
Current children cumulated memory: 8899392 KiB

[startup+702.3 s]
/proc/loadavg: 2.04 2.07 2.02 3/203 15094
/proc/meminfo: memFree=20377936/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=9951608 memory=9732532 CPUtime=702.11 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 2280525 0 0 0 69884 327 0 0 20 0 1 0 433930262 10190446592 2433133 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 2487902 2433133 846 493 0 2481207 0
Current children cumulated CPU time: 702.11 s
Current children cumulated vsize: 9951608 KiB
Current children cumulated memory: 9732532 KiB

[startup+762.3 s]
/proc/loadavg: 2.02 2.06 2.02 3/204 15102
/proc/meminfo: memFree=19543716/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=10729088 memory=10565532 CPUtime=762.08 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 2475083 0 0 0 75849 359 0 0 20 0 1 0 433930262 10986586112 2641383 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 2682272 2641383 846 493 0 2675577 0
Current children cumulated CPU time: 762.08 s
Current children cumulated vsize: 10729088 KiB
Current children cumulated memory: 10565532 KiB

[startup+822.3 s]
/proc/loadavg: 1.94 2.03 2.02 3/204 15106
/proc/meminfo: memFree=18708124/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=11506568 memory=11398356 CPUtime=822.05 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 2669701 0 0 0 81810 395 0 0 20 0 1 0 433930262 11782725632 2849589 33554432000 4194304 6211092 140735824287488 140735824273496 140267844807653 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 2876642 2849589 846 493 0 2869947 0
Current children cumulated CPU time: 822.05 s
Current children cumulated vsize: 11506568 KiB
Current children cumulated memory: 11398356 KiB

[startup+882.3 s]
/proc/loadavg: 1.95 2.01 2.01 3/205 15119
/proc/meminfo: memFree=17873712/32770624 swapFree=66916988/67108860
[pid=14963] ppid=14960 vsize=12285812 memory=12231120 CPUtime=882.02 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 2864274 0 0 0 87775 427 0 0 20 0 1 0 433930262 12580671488 3057780 33554432000 4194304 6211092 140735824287488 140735824273496 140267845733837 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3071453 3057780 846 493 0 3064758 0
Current children cumulated CPU time: 882.02 s
Current children cumulated vsize: 12285812 KiB
Current children cumulated memory: 12231120 KiB

[startup+942.3 s]
/proc/loadavg: 1.98 2.01 2.01 3/205 15147
/proc/meminfo: memFree=17043940/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=13480284 memory=13061224 CPUtime=941.99 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 3058608 0 0 0 93739 460 0 0 20 0 1 0 433930262 13803810816 3265306 33554432000 4194304 6211092 140735824287488 140735824273496 5451554 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3370071 3265306 846 493 0 3363376 0
Current children cumulated CPU time: 941.99 s
Current children cumulated vsize: 13480284 KiB
Current children cumulated memory: 13061224 KiB

[startup+1002.3 s]
/proc/loadavg: 1.99 2.01 2.01 3/206 15152
/proc/meminfo: memFree=16212556/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=14254200 memory=13889128 CPUtime=1001.96 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 3252482 0 0 0 99701 495 0 0 20 0 1 0 433930262 14596300800 3472282 33554432000 4194304 6211092 140735824287488 140735824273496 140267845728163 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3563550 3472282 846 493 0 3556855 0
Current children cumulated CPU time: 1001.96 s
Current children cumulated vsize: 14254200 KiB
Current children cumulated memory: 13889128 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/206 15157
/proc/meminfo: memFree=15379512/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15031092 memory=14720780 CPUtime=1061.93 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 3446220 0 0 0 105659 534 0 0 20 0 1 0 433930262 15391838208 3680195 33554432000 4194304 6211092 140735824287488 140735824273496 5454168 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3757773 3680195 846 493 0 3751078 0
Current children cumulated CPU time: 1061.93 s
Current children cumulated vsize: 15031092 KiB
Current children cumulated memory: 14720780 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/206 15163
/proc/meminfo: memFree=14552884/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15803424 memory=15546320 CPUtime=1121.91 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 3639489 0 0 0 111617 574 0 0 20 0 1 0 433930262 16182706176 3886580 33554432000 4194304 6211092 140735824287488 140735824273496 5013126 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3950856 3886580 846 493 0 3944161 0
Current children cumulated CPU time: 1121.91 s
Current children cumulated vsize: 15803424 KiB
Current children cumulated memory: 15546320 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1127.7 s]
/proc/loadavg: 2.00 2.01 2.01 3/206 15163
/proc/meminfo: memFree=14481764/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15872988 memory=15622100 CPUtime=1127.3 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 4202496 3656908 0 0 0 112153 577 0 0 20 0 1 0 433930262 16253939712 3905525 33554432000 4194304 6211092 140735824287488 140735824273496 5451469 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3968247 3905525 846 493 0 3961552 0
Current children cumulated CPU time: 1127.3 s
Current children cumulated vsize: 15872988 KiB
Current children cumulated memory: 15622100 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1130.62 s]
# the end of solver process 14963 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1121.89 s, system=6.77387 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1128 s]*
/proc/loadavg: 2.00 2.01 2.01 3/207 15164
/proc/meminfo: memFree=14310272/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15872988 memory=15622100 CPUtime=1127.39 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) S 14960 14963 13926 0 -1 512 3656914 0 0 0 112161 578 0 0 20 0 1 0 433930262 16253939712 3905525 33554432000 4194304 6211092 140735824287488 140735824273496 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3968247 3905525 846 493 0 3961552 0
Current children cumulated CPU time: 1127.39 s
Current children cumulated vsize: 15872988 KiB
Current children cumulated memory: 15622100 KiB

[startup+1128.8 s]
/proc/loadavg: 2.00 2.01 2.01 3/207 15164
/proc/meminfo: memFree=14310272/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15872988 memory=15622100 CPUtime=1127.56 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) S 14960 14963 13926 0 -1 512 3656914 0 0 0 112174 582 0 0 20 0 1 0 433930262 16253939712 3905525 33554432000 4194304 6211092 140735824287488 140735824273496 5189768 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3968247 3905525 846 493 0 3961552 0
Current children cumulated CPU time: 1127.56 s
Current children cumulated vsize: 15872988 KiB
Current children cumulated memory: 15622100 KiB

[startup+1129.2 s]
/proc/loadavg: 2.00 2.01 2.01 3/207 15164
/proc/meminfo: memFree=13733624/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15872988 memory=15622100 CPUtime=1127.62 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) R 14960 14963 13926 0 -1 512 3656914 0 0 0 112179 583 0 0 20 0 1 0 433930262 16253939712 3905525 33554432000 4194304 6211092 140735824287488 140735824273496 5189768 0 16384 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3968247 3905525 846 493 0 3961552 0
Current children cumulated CPU time: 1127.62 s
Current children cumulated vsize: 15872988 KiB
Current children cumulated memory: 15622100 KiB

[startup+1129.6 s]
/proc/loadavg: 2.00 2.01 2.01 3/207 15164
/proc/meminfo: memFree=13733624/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15872988 memory=15622100 CPUtime=1127.7 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) S 14960 14963 13926 0 -1 512 3656914 0 0 0 112186 584 0 0 20 0 1 0 433930262 16253939712 3905525 33554432000 4194304 6211092 140735824287488 140735824273496 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3968247 3905525 846 493 0 3961552 0
Current children cumulated CPU time: 1127.7 s
Current children cumulated vsize: 15872988 KiB
Current children cumulated memory: 15622100 KiB

[startup+1129.7 s]
/proc/loadavg: 2.00 2.01 2.01 3/207 15164
/proc/meminfo: memFree=13733624/32770624 swapFree=66916992/67108860
[pid=14963] ppid=14960 vsize=15872988 memory=15622100 CPUtime=1127.74 cores=0,2,4,6
/proc/14963/stat : 14963 (cosoco) S 14960 14963 13926 0 -1 512 3656914 0 0 0 112189 585 0 0 20 0 1 0 433930262 16253939712 3905525 33554432000 4194304 6211092 140735824287488 140735824273496 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 0 0 0 0 0 0 8312316 8317760 19927040 140735824294923 140735824295025 140735824295025 140735824297934 0
/proc/14963/statm: 3968247 3905525 846 493 0 3961552 0
Current children cumulated CPU time: 1127.74 s
Current children cumulated vsize: 15872988 KiB
Current children cumulated memory: 15622100 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1130.62
CPU time (s): 1128.67
CPU user time (s): 1121.89
CPU system time (s): 6.77387
CPU usage (%): 99.8267
Max. virtual memory (cumulated for all children) (KiB): 15872988
Max. memory (cumulated for all children) (KiB): 15622100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1121.89
system time used= 6.77387
maximum resident set size= 15622252
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3656914
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 133252
involuntary context switches= 1599


# summary of solver processes directly reported to runsolver:
#   pid: 14963
#   total CPU time (s): 1128.67
#   total CPU user time (s): 1121.89
#   total CPU system time (s): 6.77387

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.07154 second user time and 8.00497 second system time

The end

Launcher Data 

Begin job on node134 at 2019-09-15 21:45:56
IDJOB=4397204
IDBENCH=122984
IDSOLVER=2848
FILE ID=node134/4397204-1568576798
RUNJOBID= node134-1568572743-13957
PBS_JOBID= 21703320
Free space on /tmp= 59600 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-19-020-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397204-1568576798/watcher-4397204-1568576798 -o /tmp/evaluation-result-4397204-1568576798/solver-4397204-1568576798 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1568572743-13957 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4397204-1568576798.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 62ee24bcba75d1d33fbbd4bb45a854a0
RANDOM SEED=1142553565

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22017080 kB
MemAvailable:   23679516 kB
Buffers:          196860 kB
Cached:          1740548 kB
SwapCached:        90436 kB
Active:          8682452 kB
Inactive:        1442056 kB
Active(anon):    8094128 kB
Inactive(anon):   140864 kB
Active(file):     588324 kB
Inactive(file):  1301192 kB
Unevictable:      108388 kB
Mlocked:          108388 kB
SwapTotal:      67108860 kB
SwapFree:       66916988 kB
Dirty:              2796 kB
Writeback:             0 kB
AnonPages:       8152080 kB
Mapped:            48520 kB
Shmem:             39596 kB
Slab:             207632 kB
SReclaimable:     177512 kB
SUnreclaim:        30120 kB
KernelStack:        3840 kB
PageTables:        21452 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    8768608 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1050624 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 59060 MiB
End job on node134 at 2019-09-15 22:04:47