Trace number 4397200

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1576.77 1578.33

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_3_12.xml
MD5SUM75a96ae289dcd0162feddbff51d0d425
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark1336
Best CPU time to get the best result obtained on this benchmark2520.4
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":28,"count":111},{"size":38,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10744 MiB free)
  memory of node 1: 16384 MiB (15912 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397200-1568594146/watcher-4397200-1568594146 -o /tmp/evaluation-result-4397200-1568594146/solver-4397200-1568594146 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568594102-5381 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4397200-1568594146.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=5411, runsolver pid=5408

[startup+0.100119 s]*
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27274420/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=39156 memory=15364 CPUtime=0.1 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 4008 0 0 0 10 0 0 0 20 0 1 0 435663249 40095744 3841 33554432000 4194304 6211092 140726642912352 140726642908888 140382982883715 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 9789 3841 809 493 0 3094 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39156 KiB
Current children cumulated memory: 15364 KiB

[startup+0.20934 s]*
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27270960/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=40596 memory=17004 CPUtime=0.21 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 4414 0 0 0 21 0 0 0 20 0 1 0 435663249 41570304 4251 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 10149 4251 819 493 0 3454 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40596 KiB
Current children cumulated memory: 17004 KiB

[startup+0.309059 s]*
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27268948/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=41716 memory=17796 CPUtime=0.3 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 4662 0 0 0 30 0 0 0 20 0 1 0 435663249 42717184 4449 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 10429 4449 819 493 0 3734 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41716 KiB
Current children cumulated memory: 17796 KiB

[startup+0.700228 s]
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27265228/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=45580 memory=21736 CPUtime=0.69 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 5615 0 0 0 69 0 0 0 20 0 1 0 435663249 46673920 5434 33554432000 4194304 6211092 140726642912352 140726642885912 5479673 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 11395 5434 819 493 0 4700 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45580 KiB
Current children cumulated memory: 21736 KiB

[startup+1.50023 s]
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27255432/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=53552 memory=29792 CPUtime=1.49 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 7611 0 0 0 148 1 0 0 20 0 1 0 435663249 54837248 7448 33554432000 4194304 6211092 140726642912352 140726642885912 5442964 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 13388 7448 819 493 0 6693 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 53552 KiB
Current children cumulated memory: 29792 KiB

[startup+3.10032 s]*
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27213236/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=69840 memory=45760 CPUtime=3.1 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 11795 0 0 0 308 2 0 0 20 0 1 0 435663249 71516160 11440 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 17460 11440 819 493 0 10765 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 69840 KiB
Current children cumulated memory: 45760 KiB

[startup+6.30031 s]
/proc/loadavg: 0.85 1.21 1.65 3/199 5412
/proc/meminfo: memFree=27152560/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=102460 memory=77624 CPUtime=6.29 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 19967 0 0 0 626 3 0 0 20 0 1 0 435663249 104919040 19406 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 25615 19406 819 493 0 18920 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 102460 KiB
Current children cumulated memory: 77624 KiB

[startup+12.7003 s]
/proc/loadavg: 0.94 1.22 1.65 3/199 5413
/proc/meminfo: memFree=27031040/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=166072 memory=141772 CPUtime=12.7 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 36173 0 0 0 1264 6 0 0 20 0 1 0 435663249 170057728 35443 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 41518 35443 819 493 0 34823 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 166072 KiB
Current children cumulated memory: 141772 KiB

[startup+25.5003 s]
/proc/loadavg: 1.18 1.26 1.66 3/199 5413
/proc/meminfo: memFree=26765028/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=295684 memory=271548 CPUtime=25.49 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 68439 0 0 0 2538 11 0 0 20 0 1 0 435663249 302780416 67887 33554432000 4194304 6211092 140726642912352 140726642885912 5441131 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 73921 67887 819 493 0 67226 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 295684 KiB
Current children cumulated memory: 271548 KiB

[startup+51.1003 s]*
/proc/loadavg: 1.46 1.32 1.67 3/199 5415
/proc/meminfo: memFree=26240216/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=556524 memory=527756 CPUtime=51.11 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 131632 0 0 0 5092 19 0 0 20 0 1 0 435663249 569880576 131939 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 139131 131939 819 493 0 132436 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 556524 KiB
Current children cumulated memory: 527756 KiB

[startup+102.3 s]
/proc/loadavg: 1.84 1.44 1.69 3/199 5419
/proc/meminfo: memFree=25206192/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=1064836 memory=1040152 CPUtime=102.3 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 256822 0 0 0 10195 35 0 0 20 0 1 0 435663249 1090392064 260038 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 266209 260038 819 493 0 259514 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 1064836 KiB
Current children cumulated memory: 1040152 KiB

[startup+162.3 s]
/proc/loadavg: 1.94 1.54 1.71 3/199 5423
/proc/meminfo: memFree=23987452/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=1688756 memory=1643032 CPUtime=162.31 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 403452 0 0 0 16175 56 0 0 20 0 1 0 435663249 1729286144 410758 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 422189 410758 819 493 0 415494 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 1688756 KiB
Current children cumulated memory: 1643032 KiB

[startup+222.3 s]
/proc/loadavg: 1.98 1.62 1.72 3/199 5427
/proc/meminfo: memFree=22773220/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=2271668 memory=2244336 CPUtime=222.31 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 549174 0 0 0 22154 77 0 0 20 0 1 0 435663249 2326188032 561084 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 567917 561084 819 493 0 561222 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 2271668 KiB
Current children cumulated memory: 2244336 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.69 1.74 3/199 5433
/proc/meminfo: memFree=21557452/32770624 swapFree=67001936/67108860
[pid=5411] ppid=5408 vsize=2891492 memory=2845768 CPUtime=282.32 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 695625 0 0 0 28135 97 0 0 20 0 1 0 435663249 2960887808 711442 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 722873 711442 819 493 0 716178 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 2891492 KiB
Current children cumulated memory: 2845768 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.75 1.76 3/200 5445
/proc/meminfo: memFree=20342204/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=3474272 memory=3447044 CPUtime=342.32 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 841655 0 0 0 34113 119 0 0 20 0 1 0 435663249 3557654528 861761 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 868568 861761 819 493 0 861873 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 3474272 KiB
Current children cumulated memory: 3447044 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.79 1.78 3/200 5449
/proc/meminfo: memFree=19123960/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=4112152 memory=4050012 CPUtime=402.33 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 988343 0 0 0 40091 142 0 0 20 0 1 0 435663249 4210843648 1012503 33554432000 4194304 6211092 140726642912352 140726642885912 5446248 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 1028038 1012503 819 493 0 1021343 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 4112152 KiB
Current children cumulated memory: 4050012 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.83 1.79 3/200 5455
/proc/meminfo: memFree=17909724/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=4694668 memory=4650876 CPUtime=462.34 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 1134464 0 0 0 46068 166 0 0 20 0 1 0 435663249 4807340032 1162719 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 1173667 1162719 819 493 0 1166972 0
Current children cumulated CPU time: 462.34 s
Current children cumulated vsize: 4694668 KiB
Current children cumulated memory: 4650876 KiB


################
# More data... #
################

Current children cumulated vsize: 10142548 KiB
Current children cumulated memory: 10060496 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/200 5509
/proc/meminfo: memFree=5758828/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=10724668 memory=10661064 CPUtime=1062.4 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 2598775 0 0 0 105817 423 0 0 20 0 1 0 435663249 10982060032 2665266 33554432000 4194304 6211092 140726642912352 140726642885912 5452161 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 2681167 2665266 819 493 0 2674472 0
Current children cumulated CPU time: 1062.4 s
Current children cumulated vsize: 10724668 KiB
Current children cumulated memory: 10661064 KiB

[startup+1122.3 s]
/proc/loadavg: 2.05 2.00 1.90 3/200 5513
/proc/meminfo: memFree=4547008/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=11305864 memory=11260840 CPUtime=1122.4 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 2744945 0 0 0 111781 459 0 0 20 0 1 0 435663249 11577204736 2815210 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 2826466 2815210 819 493 0 2819771 0
Current children cumulated CPU time: 1122.4 s
Current children cumulated vsize: 11305864 KiB
Current children cumulated memory: 11260840 KiB

[startup+1182.3 s]
/proc/loadavg: 2.02 2.00 1.91 3/200 5519
/proc/meminfo: memFree=3334672/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=11886136 memory=11859528 CPUtime=1182.41 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 2891201 0 0 0 117738 503 0 0 20 0 1 0 435663249 12171403264 2964882 33554432000 4194304 6211092 140726642912352 140726642885912 140382982948771 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 2971534 2964882 819 493 0 2964839 0
Current children cumulated CPU time: 1182.41 s
Current children cumulated vsize: 11886136 KiB
Current children cumulated memory: 11859528 KiB

[startup+1242.3 s]
/proc/loadavg: 2.01 2.00 1.91 3/199 5524
/proc/meminfo: memFree=2122940/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=12651548 memory=12457764 CPUtime=1242.41 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3038089 0 0 0 123684 557 0 0 20 0 1 0 435663249 12955185152 3114441 33554432000 4194304 6211092 140726642912352 140726642885912 5452157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3162887 3114441 819 493 0 3156192 0
Current children cumulated CPU time: 1242.41 s
Current children cumulated vsize: 12651548 KiB
Current children cumulated memory: 12457764 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/199 5528
/proc/meminfo: memFree=915388/32770624 swapFree=67001940/67108860
[pid=5411] ppid=5408 vsize=13228652 memory=13053312 CPUtime=1302.42 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3185064 0 0 0 129614 628 0 0 20 0 1 0 435663249 13546139648 3263328 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3307163 3263328 819 493 0 3300468 0
Current children cumulated CPU time: 1302.42 s
Current children cumulated vsize: 13228652 KiB
Current children cumulated memory: 13053312 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/199 5534
/proc/meminfo: memFree=182684/32770624 swapFree=66766968/67108860
[pid=5411] ppid=5408 vsize=13804964 memory=13648116 CPUtime=1362.42 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3332344 0 0 0 135540 702 0 0 20 0 1 0 435663249 14136283136 3412029 33554432000 4194304 6211092 140726642912352 140726642885912 5446166 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3451241 3412029 819 493 0 3444546 0
Current children cumulated CPU time: 1362.42 s
Current children cumulated vsize: 13804964 KiB
Current children cumulated memory: 13648116 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.93 4/199 5539
/proc/meminfo: memFree=3392824/32770624 swapFree=66156664/67108860
[pid=5411] ppid=5408 vsize=14385368 memory=14245768 CPUtime=1422.43 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3479177 0 0 0 141504 739 0 0 20 0 1 0 435663249 14730616832 3561442 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3596342 3561442 819 493 0 3589647 0
Current children cumulated CPU time: 1422.43 s
Current children cumulated vsize: 14385368 KiB
Current children cumulated memory: 14245768 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/199 5543
/proc/meminfo: memFree=2193396/32770624 swapFree=66156728/67108860
[pid=5411] ppid=5408 vsize=14966300 memory=14845504 CPUtime=1482.44 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3627755 0 0 0 147469 775 0 0 20 0 1 0 435663249 15325491200 3711376 33554432000 4194304 6211092 140726642912352 140726642885912 140382991973213 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3741575 3711376 819 493 0 3734880 0
Current children cumulated CPU time: 1482.44 s
Current children cumulated vsize: 14966300 KiB
Current children cumulated memory: 14845504 KiB

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/200 5556
/proc/meminfo: memFree=995616/32770624 swapFree=66157352/67108860
[pid=5411] ppid=5408 vsize=15547496 memory=15445184 CPUtime=1542.45 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3774653 0 0 0 153436 809 0 0 20 0 1 0 435663249 15920635904 3861296 33554432000 4194304 6211092 140726642912352 140726642885912 140382982028261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3886874 3861296 819 493 0 3880179 0
Current children cumulated CPU time: 1542.45 s
Current children cumulated vsize: 15547496 KiB
Current children cumulated memory: 15445184 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1575.4 s]
/proc/loadavg: 2.41 2.11 1.98 3/202 5645
/proc/meminfo: memFree=15583976/32770624 swapFree=67000364/67108860
[pid=5411] ppid=5408 vsize=15872876 memory=15781700 CPUtime=1575.55 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) R 5408 5411 5350 0 -1 4202496 3856438 0 0 0 156721 834 0 0 20 0 1 0 435663249 16253825024 3945425 33554432000 4194304 6211092 140726642912352 140726642885912 140382982948788 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3968219 3945425 819 493 0 3961524 0
Current children cumulated CPU time: 1575.55 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781700 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1578.33 s]
# the end of solver process 5411 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1567.46 s, system=9.3074 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1576.1 s]*
/proc/loadavg: 2.41 2.11 1.98 3/203 5646
/proc/meminfo: memFree=15221880/32770624 swapFree=67000364/67108860
[pid=5411] ppid=5408 vsize=15872876 memory=15781700 CPUtime=1575.65 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) S 5408 5411 5350 0 -1 512 3856443 0 0 0 156730 835 0 0 20 0 1 0 435663249 16253825024 3945425 33554432000 4194304 6211092 140726642912352 140726642885912 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3968219 3945425 819 493 0 3961524 0
Current children cumulated CPU time: 1575.65 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781700 KiB

[startup+1576.9 s]
/proc/loadavg: 2.41 2.11 1.98 3/203 5646
/proc/meminfo: memFree=15221880/32770624 swapFree=67000364/67108860
[pid=5411] ppid=5408 vsize=15872876 memory=15781700 CPUtime=1575.76 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) S 5408 5411 5350 0 -1 512 3856443 0 0 0 156740 836 0 0 20 0 1 0 435663249 16253825024 3945425 33554432000 4194304 6211092 140726642912352 140726642885912 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3968219 3945425 819 493 0 3961524 0
Current children cumulated CPU time: 1575.76 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781700 KiB

[startup+1577.3 s]
/proc/loadavg: 2.41 2.11 1.98 3/203 5646
/proc/meminfo: memFree=14724268/32770624 swapFree=67000364/67108860
[pid=5411] ppid=5408 vsize=15872876 memory=15781700 CPUtime=1575.82 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) S 5408 5411 5350 0 -1 512 3856443 0 0 0 156745 837 0 0 20 0 1 0 435663249 16253825024 3945425 33554432000 4194304 6211092 140726642912352 140726642885912 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3968219 3945425 819 493 0 3961524 0
Current children cumulated CPU time: 1575.82 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781700 KiB

[startup+1577.4 s]
/proc/loadavg: 2.41 2.11 1.98 3/203 5646
/proc/meminfo: memFree=14724268/32770624 swapFree=67000364/67108860
[pid=5411] ppid=5408 vsize=15872876 memory=15781700 CPUtime=1575.84 cores=0,2,4,6
/proc/5411/stat : 5411 (cosoco) S 5408 5411 5350 0 -1 512 3856443 0 0 0 156746 838 0 0 20 0 1 0 435663249 16253825024 3945425 33554432000 4194304 6211092 140726642912352 140726642885912 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 39034880 140726642918411 140726642918513 140726642918513 140726642921422 0
/proc/5411/statm: 3968219 3945425 819 493 0 3961524 0
Current children cumulated CPU time: 1575.84 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781700 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1578.33
CPU time (s): 1576.77
CPU user time (s): 1567.46
CPU system time (s): 9.3074
CPU usage (%): 99.9014
Max. virtual memory (cumulated for all children) (KiB): 15872876
Max. memory (cumulated for all children) (KiB): 15781700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1567.46
system time used= 9.3074
maximum resident set size= 15781748
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3856443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 124381
involuntary context switches= 425


# summary of solver processes directly reported to runsolver:
#   pid: 5411
#   total CPU time (s): 1576.77
#   total CPU user time (s): 1567.46
#   total CPU system time (s): 9.3074

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.83772 second user time and 10.5578 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-16 02:35:02
IDJOB=4397200
IDBENCH=139399
IDSOLVER=2848
FILE ID=node136/4397200-1568594146
RUNJOBID= node136-1568594102-5381
PBS_JOBID= 21703347
Free space on /tmp= 61168 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_3_12.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397200-1568594146/watcher-4397200-1568594146 -o /tmp/evaluation-result-4397200-1568594146/solver-4397200-1568594146 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568594102-5381 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4397200-1568594146.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75a96ae289dcd0162feddbff51d0d425
RANDOM SEED=166266287

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27297812 kB
MemAvailable:   31886128 kB
Buffers:           60148 kB
Cached:          4815308 kB
SwapCached:         3600 kB
Active:          1863484 kB
Inactive:        3016764 kB
Active(anon):       5244 kB
Inactive(anon):    48948 kB
Active(file):    1858240 kB
Inactive(file):  2967816 kB
Unevictable:      110020 kB
Mlocked:          110020 kB
SwapTotal:      67108860 kB
SwapFree:       67001936 kB
Dirty:              5156 kB
Writeback:             0 kB
AnonPages:        112452 kB
Mapped:            45844 kB
Shmem:             40216 kB
Slab:             185356 kB
SReclaimable:     156188 kB
SUnreclaim:        29168 kB
KernelStack:        3296 kB
PageTables:         6072 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     536640 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 60680 MiB
End job on node136 at 2019-09-16 03:01:21