Trace number 4409033

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1452.32 1454.21

General information on the benchmark

NameTemplateDesign/
TemplateDesign-m2-herbs_c18.xml
MD5SUM01ee442f0f2e93e01b5a5546098ec59b
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark15.8703
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of constraints121
Number of domains3
Minimum domain size2
Maximum domain size281
Distribution of domain sizes[{"size":2,"count":30},{"size":43,"count":900},{"size":281,"count":30}]
Minimum variable degree2
Maximum variable degree32
Distribution of variable degrees[{"degree":2,"count":870},{"degree":3,"count":60},{"degree":32,"count":30}]
Minimum constraint arity2
Maximum constraint arity60
Distribution of constraint arities[{"arity":2,"count":60},{"arity":30,"count":31},{"arity":60,"count":30}]
Number of extensional constraints0
Number of intensional constraints60
Distribution of constraint types[{"type":"intension","count":60},{"type":"ordered","count":1},{"type":"sum","count":60}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -lc -model -restarts -stick HOME/instance-4409033-1569814833.xml 
0.00/0.01	c intension  iff(le(1,npt[0]),eq(u[0],1)) -> extension (support ? 1) - 281tuples

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13287 MiB free)
  memory of node 1: 16384 MiB (15494 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409033-1569814833/watcher-4409033-1569814833 -o /tmp/evaluation-result-4409033-1569814833/solver-4409033-1569814833 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node120-1325301813-18515 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409033-1569814833.xml 

running on 4 cores: 4-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=23379, runsolver pid=23376

[startup+0.100116 s]*
/proc/loadavg: 2.03 2.03 2.05 3/201 23380
/proc/meminfo: memFree=29471292/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=29604 memory=5928 CPUtime=0.1 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 1703 0 0 0 10 0 0 0 20 0 1 0 557489328 30314496 1482 33554432000 4194304 6211132 140720712197168 140720712193704 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 7401 1482 851 493 0 706 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29604 KiB
Current children cumulated memory: 5928 KiB

[startup+0.211112 s]*
/proc/loadavg: 2.03 2.03 2.05 3/201 23380
/proc/meminfo: memFree=29470176/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=30948 memory=7248 CPUtime=0.21 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 2010 0 0 0 21 0 0 0 20 0 1 0 557489328 31690752 1812 33554432000 4194304 6211132 140720712197168 140720712193704 5455666 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 7737 1812 851 493 0 1042 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30948 KiB
Current children cumulated memory: 7248 KiB

[startup+0.311004 s]*
/proc/loadavg: 2.03 2.03 2.05 3/201 23380
/proc/meminfo: memFree=29469060/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=31912 memory=8304 CPUtime=0.31 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 2274 0 0 0 31 0 0 0 20 0 1 0 557489328 32677888 2076 33554432000 4194304 6211132 140720712197168 140720712193704 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 7978 2076 851 493 0 1283 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31912 KiB
Current children cumulated memory: 8304 KiB

[startup+0.700323 s]
/proc/loadavg: 2.03 2.03 2.05 3/201 23380
/proc/meminfo: memFree=29466912/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=36084 memory=12556 CPUtime=0.69 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3305 0 0 0 69 0 0 0 20 0 1 0 557489328 36950016 3139 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 9021 3139 851 493 0 2326 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36084 KiB
Current children cumulated memory: 12556 KiB

[startup+1.50032 s]
/proc/loadavg: 2.03 2.03 2.05 5/202 23382
/proc/meminfo: memFree=29459200/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=44916 memory=21028 CPUtime=1.49 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 5475 0 0 0 149 0 0 0 20 0 1 0 557489328 45993984 5257 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 11229 5257 851 493 0 4534 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 44916 KiB
Current children cumulated memory: 21028 KiB

[startup+3.11114 s]
/proc/loadavg: 2.10 2.05 2.05 3/202 23382
/proc/meminfo: memFree=29435120/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=62740 memory=38416 CPUtime=3.1 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 9957 0 0 0 309 1 0 0 20 0 1 0 557489328 64245760 9604 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 15685 9604 851 493 0 8990 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 62740 KiB
Current children cumulated memory: 38416 KiB

[startup+7.43617 s]
/proc/loadavg: 2.10 2.05 2.05 3/202 23382
/proc/meminfo: memFree=29435120/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=110072 memory=85280 CPUtime=7.42 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 21847 0 0 0 740 2 0 0 20 0 1 0 557489328 112713728 21320 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 27518 21320 851 493 0 20823 0
Current children cumulated CPU time: 7.42 s
Current children cumulated vsize: 110072 KiB
Current children cumulated memory: 85280 KiB

[startup+12.7002 s]
/proc/loadavg: 2.54 2.15 2.08 3/202 23405
/proc/meminfo: memFree=29821372/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=166900 memory=142180 CPUtime=12.69 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 36106 0 0 0 1265 4 0 0 20 0 1 0 557489328 170905600 35545 33554432000 4194304 6211132 140720712197168 140720712179528 139988548254526 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 41725 35545 851 493 0 35030 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 166900 KiB
Current children cumulated memory: 142180 KiB

[startup+25.5002 s]
/proc/loadavg: 2.46 2.14 2.08 3/201 23408
/proc/meminfo: memFree=30182228/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=308596 memory=282300 CPUtime=25.49 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 70897 0 0 0 2541 8 0 0 20 0 1 0 557489328 316002304 70575 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 77149 70575 851 493 0 70454 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 308596 KiB
Current children cumulated memory: 282300 KiB

[startup+51.1002 s]
/proc/loadavg: 2.30 2.13 2.08 3/201 23410
/proc/meminfo: memFree=29904692/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=592048 memory=557952 CPUtime=51.09 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 138380 0 0 0 5090 19 0 0 20 0 1 0 557489328 606257152 139488 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 148012 139488 851 493 0 141317 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 592048 KiB
Current children cumulated memory: 557952 KiB

[startup+102.311 s]
/proc/loadavg: 2.12 2.11 2.07 3/201 23414
/proc/meminfo: memFree=29274860/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=1142032 memory=1116496 CPUtime=102.3 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 271879 0 0 0 10193 37 0 0 20 0 1 0 557489328 1169440768 279124 33554432000 4194304 6211132 140720712197168 140720712179528 5443128 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 285508 279124 851 493 0 278813 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 1142032 KiB
Current children cumulated memory: 1116496 KiB

[startup+162.311 s]
/proc/loadavg: 2.04 2.09 2.07 3/201 23418
/proc/meminfo: memFree=28615924/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=1789880 memory=1762512 CPUtime=162.3 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 427922 0 0 0 16174 56 0 0 20 0 1 0 557489328 1832837120 440628 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 447470 440628 851 493 0 440775 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 1789880 KiB
Current children cumulated memory: 1762512 KiB

[startup+222.311 s]
/proc/loadavg: 2.02 2.07 2.06 3/201 23422
/proc/meminfo: memFree=27952324/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=2448116 memory=2414960 CPUtime=222.3 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 583859 0 0 0 22151 79 0 0 20 0 1 0 557489328 2506870784 603740 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 612029 603740 851 493 0 605334 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 2448116 KiB
Current children cumulated memory: 2414960 KiB

[startup+282.311 s]
/proc/loadavg: 2.01 2.06 2.06 3/200 23428
/proc/meminfo: memFree=27297872/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=3123748 memory=3064848 CPUtime=282.3 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 739817 0 0 0 28128 102 0 0 20 0 1 0 557489328 3198717952 766212 33554432000 4194304 6211132 140720712197168 140720712179528 139988548254526 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 780937 766212 851 493 0 774242 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 3123748 KiB
Current children cumulated memory: 3064848 KiB

[startup+342.311 s]
/proc/loadavg: 1.96 2.04 2.05 3/199 23432
/proc/meminfo: memFree=26622416/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=3748216 memory=3713880 CPUtime=342.3 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 895181 0 0 0 34105 125 0 0 20 0 1 0 557489328 3838173184 928470 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 937054 928470 851 493 0 930359 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 3748216 KiB
Current children cumulated memory: 3713880 KiB

[startup+402.311 s]
/proc/loadavg: 1.99 2.03 2.05 3/199 23436
/proc/meminfo: memFree=25933832/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=4450208 memory=4363816 CPUtime=402.31 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 1050850 0 0 0 40083 148 0 0 20 0 1 0 557489328 4557012992 1090954 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 1112552 1090954 851 493 0 1105857 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 4450208 KiB
Current children cumulated memory: 4363816 KiB

[startup+462.311 s]
/proc/loadavg: 1.99 2.02 2.05 3/199 23442
/proc/meminfo: memFree=25275160/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=5070080 memory=5012356 CPUtime=462.3 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 1206208 0 0 0 46057 173 0 0 20 0 1 0 557489328 5191761920 1253089 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 1267520 1253089 851 493 0 1260825 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 5070080 KiB
Current children cumulated memory: 5012356 KiB


################
# More data... #
################

Current children cumulated vsize: 9713480 KiB
Current children cumulated memory: 9550196 KiB

[startup+942.311 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23485
/proc/meminfo: memFree=20046444/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=10333616 memory=10198828 CPUtime=942.23 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 2448357 0 0 0 93824 399 0 0 20 0 1 0 557489328 10581622784 2549707 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 2583404 2549707 851 493 0 2576709 0
Current children cumulated CPU time: 942.23 s
Current children cumulated vsize: 10333616 KiB
Current children cumulated memory: 10198828 KiB

[startup+1002.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23491
/proc/meminfo: memFree=19396824/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=10952960 memory=10847140 CPUtime=1002.21 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 2603557 0 0 0 99792 429 0 0 20 0 1 0 557489328 11215831040 2711785 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 2738240 2711785 851 493 0 2731545 0
Current children cumulated CPU time: 1002.21 s
Current children cumulated vsize: 10952960 KiB
Current children cumulated memory: 10847140 KiB

[startup+1062.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23495
/proc/meminfo: memFree=18744560/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=11572172 memory=11497296 CPUtime=1062.2 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 2758806 0 0 0 105758 462 0 0 20 0 1 0 557489328 11849904128 2874324 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 2893076 2874324 851 493 0 2886381 0
Current children cumulated CPU time: 1062.2 s
Current children cumulated vsize: 11572172 KiB
Current children cumulated memory: 11497296 KiB

[startup+1122.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23499
/proc/meminfo: memFree=18096724/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=12198016 memory=12144656 CPUtime=1122.19 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 2913874 0 0 0 111727 492 0 0 20 0 1 0 557489328 12490768384 3036164 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3049504 3036164 851 493 0 3042809 0
Current children cumulated CPU time: 1122.19 s
Current children cumulated vsize: 12198016 KiB
Current children cumulated memory: 12144656 KiB

[startup+1182.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23513
/proc/meminfo: memFree=17443744/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=13098828 memory=12795340 CPUtime=1182.17 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3069659 0 0 0 117691 526 0 0 20 0 1 0 557489328 13413199872 3198835 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3274707 3198835 851 493 0 3268012 0
Current children cumulated CPU time: 1182.17 s
Current children cumulated vsize: 13098828 KiB
Current children cumulated memory: 12795340 KiB

[startup+1242.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23517
/proc/meminfo: memFree=16795436/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=13717248 memory=13442620 CPUtime=1242.15 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3224704 0 0 0 123659 556 0 0 20 0 1 0 557489328 14046461952 3360655 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3429312 3360655 851 493 0 3422617 0
Current children cumulated CPU time: 1242.15 s
Current children cumulated vsize: 13717248 KiB
Current children cumulated memory: 13442620 KiB

[startup+1302.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23521
/proc/meminfo: memFree=16146500/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=14336064 memory=14090164 CPUtime=1302.13 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3379825 0 0 0 129619 594 0 0 20 0 1 0 557489328 14680129536 3522541 33554432000 4194304 6211132 140720712197168 140720712179528 5453929 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3584016 3522541 851 493 0 3577321 0
Current children cumulated CPU time: 1302.13 s
Current children cumulated vsize: 14336064 KiB
Current children cumulated memory: 14090164 KiB

[startup+1362.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23527
/proc/meminfo: memFree=15494440/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=14953824 memory=14741020 CPUtime=1362.12 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3534634 0 0 0 135581 631 0 0 20 0 1 0 557489328 15312715776 3685255 33554432000 4194304 6211132 140720712197168 140720712179528 139988549184927 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3738456 3685255 851 493 0 3731761 0
Current children cumulated CPU time: 1362.12 s
Current children cumulated vsize: 14953824 KiB
Current children cumulated memory: 14741020 KiB

[startup+1422.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23531
/proc/meminfo: memFree=14845244/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=15573168 memory=15388828 CPUtime=1422.1 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3689832 0 0 0 141545 665 0 0 20 0 1 0 557489328 15946924032 3847207 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3893292 3847207 851 493 0 3886597 0
Current children cumulated CPU time: 1422.1 s
Current children cumulated vsize: 15573168 KiB
Current children cumulated memory: 15388828 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1451.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23536
/proc/meminfo: memFree=14531124/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=15872676 memory=15702952 CPUtime=1451.1 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 4202496 3764952 0 0 0 144428 682 0 0 20 0 1 0 557489328 16253620224 3925738 33554432000 4194304 6211132 140720712197168 140720712179528 139988548258789 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3968169 3925738 851 493 0 3961474 0
Current children cumulated CPU time: 1451.1 s
Current children cumulated vsize: 15872676 KiB
Current children cumulated memory: 15702952 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1454.21 s]
# the end of solver process 23379 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1444.49 s, system=7.82997 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1452.2 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 23537
/proc/meminfo: memFree=14095628/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=15872676 memory=15702952 CPUtime=1451.24 cores=4-7
/proc/23379/stat : 23379 (cosoco) S 23376 23379 18483 0 -1 512 3764955 0 0 0 144437 687 0 0 20 0 1 0 557489328 16253620224 3925738 33554432000 4194304 6211132 140720712197168 140720712179528 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3968169 3925738 851 493 0 3961474 0
Current children cumulated CPU time: 1451.24 s
Current children cumulated vsize: 15872676 KiB
Current children cumulated memory: 15702952 KiB

[startup+1453 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23537
/proc/meminfo: memFree=14095628/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=15872676 memory=15702952 CPUtime=1451.37 cores=4-7
/proc/23379/stat : 23379 (cosoco) S 23376 23379 18483 0 -1 512 3764955 0 0 0 144445 692 0 0 20 0 1 0 557489328 16253620224 3925738 33554432000 4194304 6211132 140720712197168 140720712179528 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3968169 3925738 851 493 0 3961474 0
Current children cumulated CPU time: 1451.37 s
Current children cumulated vsize: 15872676 KiB
Current children cumulated memory: 15702952 KiB

[startup+1453.2 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 23537
/proc/meminfo: memFree=13586108/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=15872676 memory=15702952 CPUtime=1451.4 cores=4-7
/proc/23379/stat : 23379 (cosoco) S 23376 23379 18483 0 -1 512 3764955 0 0 0 144447 693 0 0 20 0 1 0 557489328 16253620224 3925738 33554432000 4194304 6211132 140720712197168 140720712179528 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3968169 3925738 851 493 0 3961474 0
Current children cumulated CPU time: 1451.4 s
Current children cumulated vsize: 15872676 KiB
Current children cumulated memory: 15702952 KiB

[startup+1453.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23537
/proc/meminfo: memFree=13586108/32770688 swapFree=66927776/67108860
[pid=23379] ppid=23376 vsize=15872676 memory=15702952 CPUtime=1451.42 cores=4-7
/proc/23379/stat : 23379 (cosoco) R 23376 23379 18483 0 -1 512 3764955 0 0 0 144449 693 0 0 20 0 1 0 557489328 16253620224 3925738 33554432000 4194304 6211132 140720712197168 140720712179528 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 17821696 140720712201227 140720712201329 140720712201329 140720712204238 0
/proc/23379/statm: 3968169 3925738 851 493 0 3961474 0
Current children cumulated CPU time: 1451.42 s
Current children cumulated vsize: 15872676 KiB
Current children cumulated memory: 15702952 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1454.21
CPU time (s): 1452.32
CPU user time (s): 1444.49
CPU system time (s): 7.82997
CPU usage (%): 99.8705
Max. virtual memory (cumulated for all children) (KiB): 15872676
Max. memory (cumulated for all children) (KiB): 15702952

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1444.49
system time used= 7.82997
maximum resident set size= 15702972
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3764955
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 122753
involuntary context switches= 783


# summary of solver processes directly reported to runsolver:
#   pid: 23379
#   total CPU time (s): 1452.32
#   total CPU user time (s): 1444.49
#   total CPU system time (s): 7.82997

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.92845 second user time and 11.1957 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-31 12:00:53
IDJOB=4409033
IDBENCH=141359
IDSOLVER=2876
FILE ID=node120/4409033-1569814833
RUNJOBID= node120-1325301813-18515
PBS_JOBID= 21705832
Free space on /tmp= 61240 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP18/TemplateDesign/TemplateDesign-m2-herbs_c18.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409033-1569814833/watcher-4409033-1569814833 -o /tmp/evaluation-result-4409033-1569814833/solver-4409033-1569814833 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node120-1325301813-18515 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409033-1569814833.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 01ee442f0f2e93e01b5a5546098ec59b
RANDOM SEED=1186475149

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        29473896 kB
MemAvailable:   30857644 kB
Buffers:          208624 kB
Cached:          1494508 kB
SwapCached:        68828 kB
Active:          1376196 kB
Inactive:        1328008 kB
Active(anon):     951996 kB
Inactive(anon):   130284 kB
Active(file):     424200 kB
Inactive(file):  1197724 kB
Unevictable:      107072 kB
Mlocked:          107072 kB
SwapTotal:      67108860 kB
SwapFree:       66927776 kB
Dirty:            883040 kB
Writeback:         69472 kB
AnonPages:       1045696 kB
Mapped:            30536 kB
Shmem:             72460 kB
Slab:             185160 kB
SReclaimable:     155320 kB
SUnreclaim:        29840 kB
KernelStack:        3664 kB
PageTables:         7600 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:    1522316 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     75776 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61240 MiB
End job on node120 at 2011-12-31 12:25:07