Trace number 4409125

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1517.02 1519.16

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_15_2.xml
MD5SUM5f96bf565600cbf50f8c2cf3fe757a5f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark105
Best CPU time to get the best result obtained on this benchmark2400.86
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":11,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15271 MiB free)
  memory of node 1: 16384 MiB (15522 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409125-1569812647/watcher-4409125-1569812647 -o /tmp/evaluation-result-4409125-1569812647/solver-4409125-1569812647 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node141-1569812557-30012 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409125-1569812647.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=30131, runsolver pid=30128
Current StackSize limit: 8192 KiB


[startup+0.100679 s]*
/proc/loadavg: 1.79 1.87 1.98 3/200 30132
/proc/meminfo: memFree=31522392/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=39024 memory=15228 CPUtime=0.09 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3985 0 0 0 9 0 0 0 20 0 1 0 557202460 39960576 3807 33554432000 4194304 6211132 140728165963760 140728165958920 140264588483390 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 9756 3807 809 493 0 3061 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 39024 KiB
Current children cumulated memory: 15228 KiB

[startup+0.209711 s]*
/proc/loadavg: 1.79 1.87 1.98 3/200 30132
/proc/meminfo: memFree=31520884/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=40600 memory=17004 CPUtime=0.2 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 4417 0 0 0 20 0 0 0 20 0 1 0 557202460 41574400 4251 33554432000 4194304 6211132 140728165963760 140728165961032 140264588487653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 10150 4251 819 493 0 3455 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40600 KiB
Current children cumulated memory: 17004 KiB

[startup+0.308915 s]*
/proc/loadavg: 1.79 1.87 1.98 3/200 30132
/proc/meminfo: memFree=31519768/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=41716 memory=17796 CPUtime=0.3 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 4673 0 0 0 30 0 0 0 20 0 1 0 557202460 42717184 4449 33554432000 4194304 6211132 140728165963760 140728165961032 140264588487653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 10429 4449 819 493 0 3734 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41716 KiB
Current children cumulated memory: 17796 KiB

[startup+0.700228 s]
/proc/loadavg: 1.79 1.87 1.98 3/200 30132
/proc/meminfo: memFree=31517908/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=45712 memory=21732 CPUtime=0.68 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 5658 0 0 0 68 0 0 0 20 0 1 0 557202460 46809088 5433 33554432000 4194304 6211132 140728165963760 140728165961032 140264589408177 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 11428 5433 819 493 0 4733 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 45712 KiB
Current children cumulated memory: 21732 KiB

[startup+1.50022 s]
/proc/loadavg: 1.79 1.87 1.98 3/200 30148
/proc/meminfo: memFree=31514392/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=53948 memory=30052 CPUtime=1.48 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 7695 0 0 0 148 0 0 0 20 0 1 0 557202460 55242752 7513 33554432000 4194304 6211132 140728165963760 140728165937320 5451514 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 13487 7513 819 493 0 6792 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 53948 KiB
Current children cumulated memory: 30052 KiB

[startup+3.10923 s]
/proc/loadavg: 1.79 1.87 1.98 3/200 30196
/proc/meminfo: memFree=31469420/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=70632 memory=46544 CPUtime=3.1 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 11983 0 0 0 309 1 0 0 20 0 1 0 557202460 72327168 11636 33554432000 4194304 6211132 140728165963760 140728165937320 5013005 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 17658 11636 819 493 0 10963 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70632 KiB
Current children cumulated memory: 46544 KiB

[startup+6.30022 s]
/proc/loadavg: 1.81 1.87 1.98 3/200 30196
/proc/meminfo: memFree=31407596/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=104044 memory=79204 CPUtime=6.28 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 20356 0 0 0 626 2 0 0 20 0 1 0 557202460 106541056 19801 33554432000 4194304 6211132 140728165963760 140728165937320 5443128 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 26011 19801 819 493 0 19316 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 104044 KiB
Current children cumulated memory: 79204 KiB

[startup+12.7002 s]
/proc/loadavg: 1.83 1.87 1.98 3/201 30198
/proc/meminfo: memFree=31284560/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=169372 memory=145200 CPUtime=12.68 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 37024 0 0 0 1263 5 0 0 20 0 1 0 557202460 173436928 36300 33554432000 4194304 6211132 140728165963760 140728165937320 5451653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 42343 36300 819 493 0 35648 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 169372 KiB
Current children cumulated memory: 145200 KiB

[startup+25.5002 s]
/proc/loadavg: 1.86 1.88 1.98 3/200 30198
/proc/meminfo: memFree=31018580/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=302680 memory=277428 CPUtime=25.48 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 70373 0 0 0 2539 9 0 0 20 0 1 0 557202460 309944320 69357 33554432000 4194304 6211132 140728165963760 140728165937320 5451650 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 75670 69357 819 493 0 68975 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 302680 KiB
Current children cumulated memory: 277428 KiB

[startup+51.1094 s]
/proc/loadavg: 1.91 1.89 1.98 3/200 30199
/proc/meminfo: memFree=30480896/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=571308 memory=543616 CPUtime=51.08 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 135439 0 0 0 5090 18 0 0 20 0 1 0 557202460 585019392 135904 33554432000 4194304 6211132 140728165963760 140728165937320 140264589411565 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 142827 135904 819 493 0 136132 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 571308 KiB
Current children cumulated memory: 543616 KiB

[startup+102.3 s]
/proc/loadavg: 1.96 1.90 1.98 3/201 30205
/proc/meminfo: memFree=29437100/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=1112656 memory=1072828 CPUtime=102.26 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 264719 0 0 0 10191 35 0 0 20 0 1 0 557202460 1139359744 268207 33554432000 4194304 6211132 140728165963760 140728165937320 5453944 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 278164 268207 819 493 0 271469 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1112656 KiB
Current children cumulated memory: 1072828 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.92 1.98 3/199 30209
/proc/meminfo: memFree=28201728/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=1739708 memory=1694796 CPUtime=162.23 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 416168 0 0 0 16167 56 0 0 20 0 1 0 557202460 1781460992 423699 33554432000 4194304 6211132 140728165963760 140728165937320 5443143 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 434927 423699 819 493 0 428232 0
Current children cumulated CPU time: 162.23 s
Current children cumulated vsize: 1739708 KiB
Current children cumulated memory: 1694796 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.93 1.98 3/199 30213
/proc/meminfo: memFree=26967932/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=2345060 memory=2320588 CPUtime=222.21 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 567505 0 0 0 22144 77 0 0 20 0 1 0 557202460 2401341440 580147 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 586265 580147 819 493 0 579570 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 2345060 KiB
Current children cumulated memory: 2320588 KiB

[startup+282.3 s]
/proc/loadavg: 2.34 2.03 2.01 3/200 30219
/proc/meminfo: memFree=25733848/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=2987324 memory=2944620 CPUtime=282.2 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 719452 0 0 0 28123 97 0 0 20 0 1 0 557202460 3059019776 736155 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 746831 736155 819 493 0 740136 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 2987324 KiB
Current children cumulated memory: 2944620 KiB

[startup+342.3 s]
/proc/loadavg: 2.31 2.09 2.03 3/199 30223
/proc/meminfo: memFree=24499724/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=3647908 memory=3569168 CPUtime=342.18 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 871033 0 0 0 34100 118 0 0 20 0 1 0 557202460 3735457792 892292 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 911977 892292 819 493 0 905282 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 3647908 KiB
Current children cumulated memory: 3569168 KiB

[startup+402.3 s]
/proc/loadavg: 2.11 2.08 2.03 3/199 30234
/proc/meminfo: memFree=23262800/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=4253128 memory=4193872 CPUtime=402.17 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 1022746 0 0 0 40077 140 0 0 20 0 1 0 557202460 4355203072 1048468 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 1063282 1048468 819 493 0 1056587 0
Current children cumulated CPU time: 402.17 s
Current children cumulated vsize: 4253128 KiB
Current children cumulated memory: 4193872 KiB

[startup+462.3 s]
/proc/loadavg: 2.04 2.06 2.03 3/200 30240
/proc/meminfo: memFree=22028384/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=4858348 memory=4819844 CPUtime=462.15 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 1174224 0 0 0 46053 162 0 0 20 0 1 0 557202460 4974948352 1204961 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 1214587 1204961 819 493 0 1207892 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 4858348 KiB
Current children cumulated memory: 4819844 KiB

################
# More data... #
################

Current children cumulated vsize: 9904816 KiB
Current children cumulated memory: 9815516 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/202 30292
/proc/meminfo: memFree=10918288/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=10509244 memory=10438288 CPUtime=1002.09 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 2537712 0 0 0 99817 392 0 0 20 0 1 0 557202460 10761465856 2609572 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 2627311 2609572 819 493 0 2620616 0
Current children cumulated CPU time: 1002.09 s
Current children cumulated vsize: 10509244 KiB
Current children cumulated memory: 10438288 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 30296
/proc/meminfo: memFree=9684088/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=11113672 memory=11063320 CPUtime=1062.07 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 2689084 0 0 0 105786 421 0 0 20 0 1 0 557202460 11380400128 2765830 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 2778418 2765830 819 493 0 2771723 0
Current children cumulated CPU time: 1062.07 s
Current children cumulated vsize: 11113672 KiB
Current children cumulated memory: 11063320 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 30300
/proc/meminfo: memFree=8451896/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=11718100 memory=11686048 CPUtime=1122.07 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 2840453 0 0 0 111755 452 0 0 20 0 1 0 557202460 11999334400 2921512 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 2929525 2921512 819 493 0 2922830 0
Current children cumulated CPU time: 1122.07 s
Current children cumulated vsize: 11718100 KiB
Current children cumulated memory: 11686048 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/201 30306
/proc/meminfo: memFree=7218028/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=12509252 memory=12310336 CPUtime=1182.06 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 2992109 0 0 0 117724 482 0 0 20 0 1 0 557202460 12809474048 3077584 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3127313 3077584 819 493 0 3120618 0
Current children cumulated CPU time: 1182.06 s
Current children cumulated vsize: 12509252 KiB
Current children cumulated memory: 12310336 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 30310
/proc/meminfo: memFree=5985644/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=13113416 memory=12933060 CPUtime=1242.05 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3143416 0 0 0 123693 512 0 0 20 0 1 0 557202460 13428137984 3233265 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3278354 3233265 819 493 0 3271659 0
Current children cumulated CPU time: 1242.05 s
Current children cumulated vsize: 13113416 KiB
Current children cumulated memory: 12933060 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 30315
/proc/meminfo: memFree=4752284/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=13717712 memory=13557572 CPUtime=1302.04 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3294732 0 0 0 129663 541 0 0 20 0 1 0 557202460 14046937088 3389393 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3429428 3389393 819 493 0 3422733 0
Current children cumulated CPU time: 1302.04 s
Current children cumulated vsize: 13717712 KiB
Current children cumulated memory: 13557572 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 30321
/proc/meminfo: memFree=3519148/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=14321744 memory=14180300 CPUtime=1362.03 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3446023 0 0 0 135631 572 0 0 20 0 1 0 557202460 14665465856 3545075 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3580436 3545075 819 493 0 3573741 0
Current children cumulated CPU time: 1362.03 s
Current children cumulated vsize: 14321744 KiB
Current children cumulated memory: 14180300 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 30325
/proc/meminfo: memFree=2286232/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=14925908 memory=14804764 CPUtime=1422.02 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3597327 0 0 0 141597 605 0 0 20 0 1 0 557202460 15284129792 3701191 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3731477 3701191 819 493 0 3724782 0
Current children cumulated CPU time: 1422.02 s
Current children cumulated vsize: 14925908 KiB
Current children cumulated memory: 14804764 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 30330
/proc/meminfo: memFree=1054972/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=15529808 memory=15427068 CPUtime=1482.02 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3748624 0 0 0 147563 639 0 0 20 0 1 0 557202460 15902523392 3856767 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3882452 3856767 819 493 0 3875757 0
Current children cumulated CPU time: 1482.02 s
Current children cumulated vsize: 15529808 KiB
Current children cumulated memory: 15427068 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1516.4 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 30333
/proc/meminfo: memFree=355788/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=15872612 memory=15782184 CPUtime=1516.11 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) R 30128 30131 29981 0 -1 4202496 3834482 0 0 0 150950 661 0 0 20 0 1 0 557202460 16253554688 3945546 33554432000 4194304 6211132 140728165963760 140728165937320 140264588487653 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3968153 3945546 819 493 0 3961458 0
Current children cumulated CPU time: 1516.11 s
Current children cumulated vsize: 15872612 KiB
Current children cumulated memory: 15782184 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1519.16 s]
# the end of solver process 30131 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1509.62 s, system=7.39375 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1516.8 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 30333
/proc/meminfo: memFree=355788/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=15872612 memory=15782184 CPUtime=1516.11 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) S 30128 30131 29981 0 -1 512 3834487 0 0 0 150950 661 0 0 20 0 1 0 557202460 16253554688 3945546 33554432000 4194304 6211132 140728165963760 140728165937320 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3968153 3945546 819 493 0 3961458 0
Current children cumulated CPU time: 1516.11 s
Current children cumulated vsize: 15872612 KiB
Current children cumulated memory: 15782184 KiB

[startup+1517.6 s]
/proc/loadavg: 2.00 2.01 2.03 4/200 30334
/proc/meminfo: memFree=329560/32770624 swapFree=66937824/67108860
[pid=30131] ppid=30128 vsize=15872612 memory=15782184 CPUtime=1516.19 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) S 30128 30131 29981 0 -1 512 3834487 0 0 0 150958 661 0 0 20 0 1 0 557202460 16253554688 3945546 33554432000 4194304 6211132 140728165963760 140728165937320 5189800 0 16384 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3968153 3945546 819 493 0 3961458 0
Current children cumulated CPU time: 1516.19 s
Current children cumulated vsize: 15872612 KiB
Current children cumulated memory: 15782184 KiB

[startup+1518 s]*
/proc/loadavg: 2.00 2.01 2.03 3/200 30334
/proc/meminfo: memFree=211164/32770624 swapFree=66937820/67108860
[pid=30131] ppid=30128 vsize=15872612 memory=15782184 CPUtime=1516.22 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) S 30128 30131 29981 0 -1 512 3834487 0 0 0 150960 662 0 0 20 0 1 0 557202460 16253554688 3945546 33554432000 4194304 6211132 140728165963760 140728165937320 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3968153 3945546 819 493 0 3961458 0
Current children cumulated CPU time: 1516.22 s
Current children cumulated vsize: 15872612 KiB
Current children cumulated memory: 15782184 KiB

[startup+1518.4 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 30334
/proc/meminfo: memFree=211164/32770624 swapFree=66937820/67108860
[pid=30131] ppid=30128 vsize=15872612 memory=15782184 CPUtime=1516.25 cores=0,2,4,6
/proc/30131/stat : 30131 (cosoco) S 30128 30131 29981 0 -1 512 3834487 0 0 0 150962 663 0 0 20 0 1 0 557202460 16253554688 3945546 33554432000 4194304 6211132 140728165963760 140728165937320 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 23789568 140728165966859 140728165966961 140728165966961 140728165969870 0
/proc/30131/statm: 3968153 3945546 819 493 0 3961458 0
Current children cumulated CPU time: 1516.25 s
Current children cumulated vsize: 15872612 KiB
Current children cumulated memory: 15782184 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1519.16
CPU time (s): 1517.02
CPU user time (s): 1509.62
CPU system time (s): 7.39375
CPU usage (%): 99.8587
Max. virtual memory (cumulated for all children) (KiB): 15872612
Max. memory (cumulated for all children) (KiB): 15782184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1509.62
system time used= 7.39375
maximum resident set size= 15782420
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3834487
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58846
involuntary context switches= 1995


# summary of solver processes directly reported to runsolver:
#   pid: 30131
#   total CPU time (s): 1517.02
#   total CPU user time (s): 1509.62
#   total CPU system time (s): 7.39375

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.39066 second user time and 10.3786 second system time

The end

Launcher Data 

Begin job on node141 at 2019-09-30 05:03:24
IDJOB=4409125
IDBENCH=139378
IDSOLVER=2876
FILE ID=node141/4409125-1569812647
RUNJOBID= node141-1569812557-30012
PBS_JOBID= 21705843
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_15_2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409125-1569812647/watcher-4409125-1569812647 -o /tmp/evaluation-result-4409125-1569812647/solver-4409125-1569812647 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node141-1569812557-30012 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409125-1569812647.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f96bf565600cbf50f8c2cf3fe757a5f
RANDOM SEED=1987389772

node141.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31533288 kB
MemAvailable:   31819564 kB
Buffers:          196644 kB
Cached:           433664 kB
SwapCached:        62076 kB
Active:           346652 kB
Inactive:         353364 kB
Active(anon):      21820 kB
Inactive(anon):   126388 kB
Active(file):     324832 kB
Inactive(file):   226976 kB
Unevictable:      107692 kB
Mlocked:          107692 kB
SwapTotal:      67108860 kB
SwapFree:       66937824 kB
Dirty:              2748 kB
Writeback:             0 kB
AnonPages:        115400 kB
Mapped:            28272 kB
Shmem:             69528 kB
Slab:             129876 kB
SReclaimable:     100608 kB
SUnreclaim:        29268 kB
KernelStack:        3536 kB
PageTables:         5704 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     571164 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      128384 kB
DirectMap2M:    33417216 kB

Free space on /tmp at the end= 61800 MiB
End job on node141 at 2019-09-30 05:28:43