Trace number 4408474

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1514.7 1517.27

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_13_19.xml
MD5SUM517edee816e601fa237873c001bf01e9
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark260
Best CPU time to get the best result obtained on this benchmark19244.5
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":12,"count":111},{"size":48,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13530 MiB free)
  memory of node 1: 16384 MiB (14704 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408474-1569811623/watcher-4408474-1569811623 -o /tmp/evaluation-result-4408474-1569811623/solver-4408474-1569811623 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node140-1569787351-2497 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408474-1569811623.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=8315, runsolver pid=8312

[startup+0.100115 s]*
/proc/loadavg: 2.11 2.26 2.18 3/200 8316
/proc/meminfo: memFree=28901520/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=39152 memory=15356 CPUtime=0.1 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 4007 0 0 0 10 0 0 0 20 0 1 0 557100544 40091648 3839 33554432000 4194304 6211132 140726328145392 140726328141928 5525144 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 9788 3839 809 493 0 3093 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15356 KiB

[startup+0.209569 s]*
/proc/loadavg: 2.11 2.26 2.18 3/200 8316
/proc/meminfo: memFree=28898544/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=40728 memory=16868 CPUtime=0.2 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 4434 0 0 0 20 0 0 0 20 0 1 0 557100544 41705472 4217 33554432000 4194304 6211132 140726328145392 140726328141928 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 10182 4217 819 493 0 3487 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16868 KiB

[startup+0.309105 s]*
/proc/loadavg: 2.11 2.26 2.18 3/200 8316
/proc/meminfo: memFree=28894264/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=41712 memory=17924 CPUtime=0.3 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 4692 0 0 0 30 0 0 0 20 0 1 0 557100544 42713088 4481 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 10428 4481 819 493 0 3733 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17924 KiB

[startup+0.700235 s]
/proc/loadavg: 2.11 2.26 2.18 3/200 8316
/proc/meminfo: memFree=28890172/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=45840 memory=21992 CPUtime=0.69 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 5692 0 0 0 69 0 0 0 20 0 1 0 557100544 46940160 5498 33554432000 4194304 6211132 140726328145392 140726328118952 5451560 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 11460 5498 819 493 0 4765 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45840 KiB
Current children cumulated memory: 21992 KiB

[startup+1.50023 s]
/proc/loadavg: 2.11 2.26 2.18 3/200 8316
/proc/meminfo: memFree=28880128/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=54208 memory=30316 CPUtime=1.49 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 7779 0 0 0 148 1 0 0 20 0 1 0 557100544 55508992 7579 33554432000 4194304 6211132 140726328145392 140726328118952 5452258 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 13552 7579 819 493 0 6857 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54208 KiB
Current children cumulated memory: 30316 KiB

[startup+3.10936 s]
/proc/loadavg: 2.11 2.26 2.18 3/201 8318
/proc/meminfo: memFree=28837872/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=71156 memory=47068 CPUtime=3.1 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 12147 0 0 0 308 2 0 0 20 0 1 0 557100544 72863744 11767 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 17789 11767 819 493 0 11094 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 71156 KiB
Current children cumulated memory: 47068 KiB

[startup+6.30022 s]
/proc/loadavg: 2.10 2.25 2.18 3/201 8318
/proc/meminfo: memFree=28776016/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=105096 memory=80520 CPUtime=6.29 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 20641 0 0 0 626 3 0 0 20 0 1 0 557100544 107618304 20130 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 26274 20130 819 493 0 19579 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 105096 KiB
Current children cumulated memory: 80520 KiB

[startup+12.7002 s]
/proc/loadavg: 2.09 2.25 2.18 3/200 8318
/proc/meminfo: memFree=28651260/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=171216 memory=147048 CPUtime=12.69 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 37503 0 0 0 1263 6 0 0 20 0 1 0 557100544 175325184 36762 33554432000 4194304 6211132 140726328145392 140726328118952 5451604 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 42804 36762 819 493 0 36109 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 171216 KiB
Current children cumulated memory: 147048 KiB

[startup+25.5002 s]
/proc/loadavg: 2.07 2.24 2.18 3/200 8319
/proc/meminfo: memFree=28380272/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=305844 memory=281308 CPUtime=25.49 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 70870 0 0 0 2538 11 0 0 20 0 1 0 557100544 313184256 70327 33554432000 4194304 6211132 140726328145392 140726328118952 5451553 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 76461 70327 819 493 0 69766 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 305844 KiB
Current children cumulated memory: 281308 KiB

[startup+51.1095 s]
/proc/loadavg: 2.05 2.22 2.17 3/200 8321
/proc/meminfo: memFree=27833724/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=576584 memory=549664 CPUtime=51.09 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 137067 0 0 0 5089 20 0 0 20 0 1 0 557100544 590422016 137416 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 144146 137416 819 493 0 137451 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 576584 KiB
Current children cumulated memory: 549664 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.18 2.16 3/200 8325
/proc/meminfo: memFree=26772332/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=1121100 memory=1083032 CPUtime=102.28 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 267552 0 0 0 10193 35 0 0 20 0 1 0 557100544 1148006400 270758 33554432000 4194304 6211132 140726328145392 140726328118952 140057435301312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 280275 270758 819 493 0 273580 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1121100 KiB
Current children cumulated memory: 1083032 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.15 2.15 3/199 8329
/proc/meminfo: memFree=25525120/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=1751716 memory=1707640 CPUtime=162.27 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 419591 0 0 0 16170 57 0 0 20 0 1 0 557100544 1793757184 426910 33554432000 4194304 6211132 140726328145392 140726328118952 140057436211107 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 437929 426910 819 493 0 431234 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 1751716 KiB
Current children cumulated memory: 1707640 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.12 2.14 3/200 8341
/proc/meminfo: memFree=24278260/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=2357860 memory=2332708 CPUtime=222.26 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 571276 0 0 0 22150 76 0 0 20 0 1 0 557100544 2414448640 583177 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 589465 583177 819 493 0 582770 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 2357860 KiB
Current children cumulated memory: 2332708 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.10 2.13 3/200 8347
/proc/meminfo: memFree=23024476/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=3001048 memory=2958940 CPUtime=282.26 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 723264 0 0 0 28130 96 0 0 20 0 1 0 557100544 3073073152 739735 33554432000 4194304 6211132 140726328145392 140726328118952 140057445235530 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 750262 739735 819 493 0 743567 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 3001048 KiB
Current children cumulated memory: 2958940 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.08 2.13 3/200 8351
/proc/meminfo: memFree=21769640/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=3662292 memory=3585324 CPUtime=342.25 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 875608 0 0 0 34106 119 0 0 20 0 1 0 557100544 3750187008 896331 33554432000 4194304 6211132 140726328145392 140726328118952 140057436214486 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 915573 896331 819 493 0 908878 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 3662292 KiB
Current children cumulated memory: 3585324 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.07 2.12 3/200 8355
/proc/meminfo: memFree=20520916/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=4268172 memory=4209660 CPUtime=402.24 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 1027582 0 0 0 40085 139 0 0 20 0 1 0 557100544 4370608128 1052415 33554432000 4194304 6211132 140726328145392 140726328118952 140057445235544 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 1067043 1052415 819 493 0 1060348 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 4268172 KiB
Current children cumulated memory: 4209660 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.06 2.11 3/200 8361
/proc/meminfo: memFree=19267748/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=4873788 memory=4835728 CPUtime=462.23 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 1179510 0 0 0 46060 163 0 0 20 0 1 0 557100544 4990758912 1208932 33554432000 4194304 6211132 140726328145392 140726328118952 5451532 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 1218447 1208932 819 493 0 1211752 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 4873788 KiB
Current children cumulated memory: 4835728 KiB


################
# More data... #
################

Current children cumulated vsize: 9318468 KiB
Current children cumulated memory: 9209260 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.02 2.08 3/201 8430
/proc/meminfo: memFree=9264840/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=9923292 memory=9832540 CPUtime=942.17 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 2397060 0 0 0 93838 379 0 0 20 0 1 0 557100544 10161451008 2458135 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 2480823 2458135 819 493 0 2474128 0
Current children cumulated CPU time: 942.17 s
Current children cumulated vsize: 9923292 KiB
Current children cumulated memory: 9832540 KiB

[startup+1002.3 s]
/proc/loadavg: 2.05 2.03 2.08 3/201 8436
/proc/meminfo: memFree=8014320/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=10528248 memory=10458080 CPUtime=1002.16 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 2549150 0 0 0 99806 410 0 0 20 0 1 0 557100544 10780925952 2614520 33554432000 4194304 6211132 140726328145392 140726328118952 140057436214499 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 2632062 2614520 819 493 0 2625367 0
Current children cumulated CPU time: 1002.16 s
Current children cumulated vsize: 10528248 KiB
Current children cumulated memory: 10458080 KiB

[startup+1062.3 s]
/proc/loadavg: 2.02 2.03 2.07 3/201 8440
/proc/meminfo: memFree=6765624/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=11133072 memory=11083356 CPUtime=1062.16 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 2701227 0 0 0 105775 441 0 0 20 0 1 0 557100544 11400265728 2770839 33554432000 4194304 6211132 140726328145392 140726328118952 5443143 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 2783268 2770839 819 493 0 2776573 0
Current children cumulated CPU time: 1062.16 s
Current children cumulated vsize: 11133072 KiB
Current children cumulated memory: 11083356 KiB

[startup+1122.3 s]
/proc/loadavg: 2.01 2.02 2.07 3/200 8444
/proc/meminfo: memFree=5514096/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=11737764 memory=11706588 CPUtime=1122.15 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 2853278 0 0 0 111742 473 0 0 20 0 1 0 557100544 12019470336 2926647 33554432000 4194304 6211132 140726328145392 140726328118952 5454208 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 2934441 2926647 819 493 0 2927746 0
Current children cumulated CPU time: 1122.15 s
Current children cumulated vsize: 11737764 KiB
Current children cumulated memory: 11706588 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.06 3/199 8450
/proc/meminfo: memFree=4264872/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=12529312 memory=12331052 CPUtime=1182.15 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3005688 0 0 0 117710 505 0 0 20 0 1 0 557100544 12830015488 3082763 33554432000 4194304 6211132 140726328145392 140726328118952 140057436214515 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3132328 3082763 819 493 0 3125633 0
Current children cumulated CPU time: 1182.15 s
Current children cumulated vsize: 12529312 KiB
Current children cumulated memory: 12331052 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8454
/proc/meminfo: memFree=3015792/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=13133872 memory=12954116 CPUtime=1242.13 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3157530 0 0 0 123674 539 0 0 20 0 1 0 557100544 13449084928 3238529 33554432000 4194304 6211132 140726328145392 140726328118952 5446210 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3283468 3238529 819 493 0 3276773 0
Current children cumulated CPU time: 1242.13 s
Current children cumulated vsize: 13133872 KiB
Current children cumulated memory: 12954116 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8458
/proc/meminfo: memFree=1766356/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=13738432 memory=13579128 CPUtime=1302.13 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3309522 0 0 0 129639 574 0 0 20 0 1 0 557100544 14068154368 3394782 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3434608 3394782 819 493 0 3427913 0
Current children cumulated CPU time: 1302.13 s
Current children cumulated vsize: 13738432 KiB
Current children cumulated memory: 13579128 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8464
/proc/meminfo: memFree=517920/32770624 swapFree=66997328/67108860
[pid=8315] ppid=8312 vsize=14342728 memory=14201832 CPUtime=1362.13 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3461472 0 0 0 135605 608 0 0 20 0 1 0 557100544 14686953472 3550458 33554432000 4194304 6211132 140726328145392 140726328118952 140057436211124 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3585682 3550458 819 493 0 3578987 0
Current children cumulated CPU time: 1362.13 s
Current children cumulated vsize: 14342728 KiB
Current children cumulated memory: 14201832 KiB

[startup+1422.3 s]
/proc/loadavg: 2.13 2.06 2.06 3/202 8543
/proc/meminfo: memFree=15706072/32770624 swapFree=66997268/67108860
[pid=8315] ppid=8312 vsize=14941480 memory=14821064 CPUtime=1421.42 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3612220 0 0 0 141498 644 0 0 20 0 1 0 557100544 15300075520 3705266 33554432000 4194304 6211132 140726328145392 140726328118952 140057436214482 0 0 4096 8405026 0 0 0 17 1 0 0 69 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3735370 3705266 819 493 0 3728675 0
Current children cumulated CPU time: 1421.42 s
Current children cumulated vsize: 14941480 KiB
Current children cumulated memory: 14821064 KiB

[startup+1482.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/201 8547
/proc/meminfo: memFree=15075904/32770624 swapFree=66997268/67108860
[pid=8315] ppid=8312 vsize=15548284 memory=15446148 CPUtime=1481.38 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3764168 0 0 0 147457 681 0 0 20 0 1 0 557100544 15921442816 3861537 33554432000 4194304 6211132 140726328145392 140726328118952 5454212 0 0 4096 8405026 0 0 0 17 1 0 0 69 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3887071 3861537 819 493 0 3880376 0
Current children cumulated CPU time: 1481.38 s
Current children cumulated vsize: 15548284 KiB
Current children cumulated memory: 15446148 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1514.4 s]
/proc/loadavg: 2.03 2.04 2.05 3/202 8551
/proc/meminfo: memFree=14717316/32770624 swapFree=66997268/67108860
[pid=8315] ppid=8312 vsize=15872476 memory=15782772 CPUtime=1513.48 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) R 8312 8315 2465 0 -1 4202496 3845389 0 0 0 150644 704 0 0 20 0 1 0 557100544 16253415424 3945693 33554432000 4194304 6211132 140726328145392 140726328118952 140057435290597 0 0 4096 8405026 0 0 0 17 1 0 0 69 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3968119 3945693 819 493 0 3961424 0
Current children cumulated CPU time: 1513.48 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15782772 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1517.27 s]
# the end of solver process 8315 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1506.72 s, system=7.97551 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1515.8 s]
/proc/loadavg: 2.03 2.04 2.05 3/203 8552
/proc/meminfo: memFree=14033764/32770624 swapFree=66997268/67108860
[pid=8315] ppid=8312 vsize=15872476 memory=15782772 CPUtime=1513.72 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) S 8312 8315 2465 0 -1 512 3845393 0 0 0 150662 710 0 0 20 0 1 0 557100544 16253415424 3945693 33554432000 4194304 6211132 140726328145392 140726328118952 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 69 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3968119 3945693 819 493 0 3961424 0
Current children cumulated CPU time: 1513.72 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15782772 KiB

[startup+1516.2 s]
/proc/loadavg: 2.03 2.04 2.05 3/203 8552
/proc/meminfo: memFree=14033764/32770624 swapFree=66997268/67108860
[pid=8315] ppid=8312 vsize=15872476 memory=15782772 CPUtime=1513.79 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) S 8312 8315 2465 0 -1 512 3845393 0 0 0 150669 710 0 0 20 0 1 0 557100544 16253415424 3945693 33554432000 4194304 6211132 140726328145392 140726328118952 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 69 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3968119 3945693 819 493 0 3961424 0
Current children cumulated CPU time: 1513.79 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15782772 KiB

[startup+1516.4 s]
/proc/loadavg: 2.03 2.04 2.05 3/203 8552
/proc/meminfo: memFree=14033764/32770624 swapFree=66997268/67108860
[pid=8315] ppid=8312 vsize=15872476 memory=15782772 CPUtime=1513.82 cores=1,3,5,7
/proc/8315/stat : 8315 (cosoco) S 8312 8315 2465 0 -1 512 3845393 0 0 0 150672 710 0 0 20 0 1 0 557100544 16253415424 3945693 33554432000 4194304 6211132 140726328145392 140726328118952 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 69 0 0 8312316 8317760 13586432 140726328149003 140726328149105 140726328149105 140726328152014 0
/proc/8315/statm: 3968119 3945693 819 493 0 3961424 0
Current children cumulated CPU time: 1513.82 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15782772 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1517.27
CPU time (s): 1514.7
CPU user time (s): 1506.72
CPU system time (s): 7.97551
CPU usage (%): 99.8305
Max. virtual memory (cumulated for all children) (KiB): 15872476
Max. memory (cumulated for all children) (KiB): 15782772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1506.72
system time used= 7.97551
maximum resident set size= 15782924
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3845393
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 140461
involuntary context switches= 1840


# summary of solver processes directly reported to runsolver:
#   pid: 8315
#   total CPU time (s): 1514.7
#   total CPU user time (s): 1506.72
#   total CPU system time (s): 7.97551

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.29772 second user time and 10.5227 second system time

The end

Launcher Data 

Begin job on node140 at 2019-09-30 04:46:21
IDJOB=4408474
IDBENCH=139525
IDSOLVER=2874
FILE ID=node140/4408474-1569811623
RUNJOBID= node140-1569787351-2497
PBS_JOBID= 21705822
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_13_19.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408474-1569811623/watcher-4408474-1569811623 -o /tmp/evaluation-result-4408474-1569811623/solver-4408474-1569811623 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node140-1569787351-2497 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408474-1569811623.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 517edee816e601fa237873c001bf01e9
RANDOM SEED=718104457

node140.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28914008 kB
MemAvailable:   30357920 kB
Buffers:          224420 kB
Cached:          1555696 kB
SwapCached:         3052 kB
Active:          2911112 kB
Inactive:         392844 kB
Active(anon):    1531168 kB
Inactive(anon):    72368 kB
Active(file):    1379944 kB
Inactive(file):   320476 kB
Unevictable:      107036 kB
Mlocked:          107036 kB
SwapTotal:      67108860 kB
SwapFree:       66997328 kB
Dirty:              2720 kB
Writeback:             0 kB
AnonPages:       1640180 kB
Mapped:            28360 kB
Shmem:             71208 kB
Slab:             147608 kB
SReclaimable:     118652 kB
SUnreclaim:        28956 kB
KernelStack:        3568 kB
PageTables:         8616 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2085792 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    206848 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 61476 MiB
End job on node140 at 2019-09-30 05:11:38