Trace number 4390409

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1523.19 1525.23

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_14_1.xml
MD5SUM25e4edec3d9f4a5618481cbfa250deb6
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark261
Best CPU time to get the best result obtained on this benchmark2400.07
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":11,"count":111},{"size":48,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13440 MiB free)
  memory of node 1: 16384 MiB (15838 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390409-1568354056/watcher-4390409-1568354056 -o /tmp/evaluation-result-4390409-1568354056/solver-4390409-1568354056 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568325638-27861 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390409-1568354056.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2197, runsolver pid=2194
Current StackSize limit: 8192 KiB


[startup+0.100144 s]*
/proc/loadavg: 2.04 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29970544/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=39152 memory=15224 CPUtime=0.1 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 4006 0 0 0 10 0 0 0 20 0 1 0 411673277 40091648 3806 33554432000 4194304 6210612 140728527293744 140728527290280 139923950279043 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 9788 3806 809 493 0 3093 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15224 KiB

[startup+0.20974 s]*
/proc/loadavg: 2.04 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29968412/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=40728 memory=16868 CPUtime=0.21 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 4429 0 0 0 21 0 0 0 20 0 1 0 411673277 41705472 4217 33554432000 4194304 6210612 140728527293744 140728527290280 139923950347270 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 10182 4217 819 493 0 3487 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16868 KiB

[startup+0.308949 s]*
/proc/loadavg: 2.04 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29967296/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=41712 memory=17924 CPUtime=0.3 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 4681 0 0 0 30 0 0 0 20 0 1 0 411673277 42713088 4481 33554432000 4194304 6210612 140728527293744 140728527290280 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 10428 4481 819 493 0 3733 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17924 KiB

[startup+0.700274 s]
/proc/loadavg: 2.04 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29965436/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=45708 memory=21988 CPUtime=0.69 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 5674 0 0 0 69 0 0 0 20 0 1 0 411673277 46804992 5497 33554432000 4194304 6210612 140728527293744 140728527290280 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 11427 5497 819 493 0 4732 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45708 KiB
Current children cumulated memory: 21988 KiB

[startup+1.50029 s]
/proc/loadavg: 2.04 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29959576/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=54076 memory=30312 CPUtime=1.49 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 7741 0 0 0 148 1 0 0 20 0 1 0 411673277 55373824 7578 33554432000 4194304 6210612 140728527293744 140728527290280 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 13519 7578 819 493 0 6824 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54076 KiB
Current children cumulated memory: 30312 KiB

[startup+3.10945 s]
/proc/loadavg: 2.04 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29938744/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=70892 memory=46928 CPUtime=3.1 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 12065 0 0 0 309 1 0 0 20 0 1 0 411673277 72593408 11732 33554432000 4194304 6210612 140728527293744 140728527290280 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 17723 11732 819 493 0 11028 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70892 KiB
Current children cumulated memory: 46928 KiB

[startup+6.30027 s]
/proc/loadavg: 2.03 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29908036/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=104436 memory=79844 CPUtime=6.29 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 20480 0 0 0 627 2 0 0 20 0 1 0 411673277 106942464 19961 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 26109 19961 819 493 0 19414 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104436 KiB
Current children cumulated memory: 79844 KiB

[startup+12.7003 s]
/proc/loadavg: 2.03 2.03 2.05 3/198 2198
/proc/meminfo: memFree=29846040/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=169896 memory=145980 CPUtime=12.68 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 37181 0 0 0 1264 4 0 0 20 0 1 0 411673277 173973504 36495 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 42474 36495 819 493 0 35779 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 169896 KiB
Current children cumulated memory: 145980 KiB

[startup+25.5003 s]
/proc/loadavg: 2.03 2.02 2.05 3/198 2198
/proc/meminfo: memFree=29710960/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=303468 memory=278932 CPUtime=25.49 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 70276 0 0 0 2541 8 0 0 20 0 1 0 411673277 310751232 69733 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 75867 69733 819 493 0 69172 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 303468 KiB
Current children cumulated memory: 278932 KiB

[startup+51.1093 s]
/proc/loadavg: 2.02 2.02 2.05 3/198 2201
/proc/meminfo: memFree=29442220/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=571964 memory=542600 CPUtime=51.1 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 135869 0 0 0 5094 16 0 0 20 0 1 0 411673277 585691136 135650 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 142991 135650 819 493 0 136296 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 571964 KiB
Current children cumulated memory: 542600 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/198 2204
/proc/meminfo: memFree=28912720/32770624 swapFree=66932232/67108860
[pid=2197] ppid=2194 vsize=1112916 memory=1075132 CPUtime=102.27 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 265418 0 0 0 10193 34 0 0 20 0 1 0 411673277 1139625984 268783 33554432000 4194304 6210612 140728527293744 140728527267304 5453766 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 278229 268783 819 493 0 271534 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1112916 KiB
Current children cumulated memory: 1075132 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2209
/proc/meminfo: memFree=28287220/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=1740100 memory=1696044 CPUtime=162.25 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 416585 0 0 0 16169 56 0 0 20 0 1 0 411673277 1781862400 424011 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 435025 424011 819 493 0 428330 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1740100 KiB
Current children cumulated memory: 1696044 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2215
/proc/meminfo: memFree=27663748/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=2342812 memory=2317152 CPUtime=222.23 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 567253 0 0 0 22147 76 0 0 20 0 1 0 411673277 2399039488 579288 33554432000 4194304 6210612 140728527293744 140728527267304 5012860 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 585703 579288 819 493 0 579008 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 2342812 KiB
Current children cumulated memory: 2317152 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2226
/proc/meminfo: memFree=27040340/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=2982304 memory=2940484 CPUtime=282.21 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 718477 0 0 0 28126 95 0 0 20 0 1 0 411673277 3053879296 735121 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 745576 735121 819 493 0 738881 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 2982304 KiB
Current children cumulated memory: 2940484 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2254
/proc/meminfo: memFree=26418696/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=3640116 memory=3561036 CPUtime=342.19 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 869654 0 0 0 34104 115 0 0 20 0 1 0 411673277 3727478784 890259 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 910029 890259 819 493 0 903334 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 3640116 KiB
Current children cumulated memory: 3561036 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2260
/proc/meminfo: memFree=25794064/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=4242696 memory=4184316 CPUtime=402.19 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 1020435 0 0 0 40082 137 0 0 20 0 1 0 411673277 4344520704 1046079 33554432000 4194304 6210612 140728527293744 140728527267304 139923959368552 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 1060674 1046079 819 493 0 1053979 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 4242696 KiB
Current children cumulated memory: 4184316 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2264
/proc/meminfo: memFree=25172404/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=4845012 memory=4805088 CPUtime=462.17 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 1171196 0 0 0 46061 156 0 0 20 0 1 0 411673277 4961292288 1201272 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 1211253 1201272 819 493 0 1204558 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 4845012 KiB
Current children cumulated memory: 4805088 KiB


################
# More data... #
################

Current children cumulated vsize: 9869700 KiB
Current children cumulated memory: 9779256 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2314
/proc/meminfo: memFree=19567016/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=10471488 memory=10399288 CPUtime=1002.03 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 2529062 0 0 0 99830 373 0 0 20 0 1 0 411673277 10722803712 2599822 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 2617872 2599822 819 493 0 2611177 0
Current children cumulated CPU time: 1002.03 s
Current children cumulated vsize: 10471488 KiB
Current children cumulated memory: 10399288 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2318
/proc/meminfo: memFree=18942936/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=11073276 memory=11021712 CPUtime=1062.01 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 2679757 0 0 0 105802 399 0 0 20 0 1 0 411673277 11339034624 2755428 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 2768319 2755428 819 493 0 2761624 0
Current children cumulated CPU time: 1062.01 s
Current children cumulated vsize: 11073276 KiB
Current children cumulated memory: 11021712 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2324
/proc/meminfo: memFree=18321240/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=11674932 memory=11641820 CPUtime=1122 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 2830433 0 0 0 111774 426 0 0 20 0 1 0 411673277 11955130368 2910455 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 2918733 2910455 819 493 0 2912038 0
Current children cumulated CPU time: 1122 s
Current children cumulated vsize: 11674932 KiB
Current children cumulated memory: 11641820 KiB

[startup+1182.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/197 2329
/proc/meminfo: memFree=17698668/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=12463312 memory=12263084 CPUtime=1181.98 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 2981420 0 0 0 117742 456 0 0 20 0 1 0 411673277 12762431488 3065771 33554432000 4194304 6210612 140728527293744 140728527267304 5440420 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3115828 3065771 819 493 0 3109133 0
Current children cumulated CPU time: 1181.98 s
Current children cumulated vsize: 12463312 KiB
Current children cumulated memory: 12263084 KiB

[startup+1242.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/197 2333
/proc/meminfo: memFree=17078152/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=13064836 memory=12882928 CPUtime=1241.96 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 3132059 0 0 0 123711 485 0 0 20 0 1 0 411673277 13378392064 3220732 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3266209 3220732 819 493 0 3259514 0
Current children cumulated CPU time: 1241.96 s
Current children cumulated vsize: 13064836 KiB
Current children cumulated memory: 12882928 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2339
/proc/meminfo: memFree=16454040/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=13666228 memory=13505080 CPUtime=1301.96 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 3282689 0 0 0 129681 515 0 0 20 0 1 0 411673277 13994217472 3376270 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3416557 3376270 819 493 0 3409862 0
Current children cumulated CPU time: 1301.96 s
Current children cumulated vsize: 13666228 KiB
Current children cumulated memory: 13505080 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2343
/proc/meminfo: memFree=15832820/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=14267620 memory=14124924 CPUtime=1361.94 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 3433300 0 0 0 135648 546 0 0 20 0 1 0 411673277 14610042880 3531231 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3566905 3531231 819 493 0 3560210 0
Current children cumulated CPU time: 1361.94 s
Current children cumulated vsize: 14267620 KiB
Current children cumulated memory: 14124924 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2347
/proc/meminfo: memFree=15210436/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=14869012 memory=14746504 CPUtime=1421.93 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 3583904 0 0 0 141617 576 0 0 20 0 1 0 411673277 15225868288 3686626 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3717253 3686626 819 493 0 3710558 0
Current children cumulated CPU time: 1421.93 s
Current children cumulated vsize: 14869012 KiB
Current children cumulated memory: 14746504 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2360
/proc/meminfo: memFree=14589580/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=15470008 memory=15366184 CPUtime=1481.91 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 3734470 0 0 0 147583 608 0 0 20 0 1 0 411673277 15841288192 3841546 33554432000 4194304 6210612 140728527293744 140728527267304 5446088 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3867535 3841546 819 493 0 3860840 0
Current children cumulated CPU time: 1481.91 s
Current children cumulated vsize: 15470008 KiB
Current children cumulated memory: 15366184 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1522.5 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 2364
/proc/meminfo: memFree=14175748/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=15872872 memory=15783352 CPUtime=1522.1 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 4202496 3835384 0 0 0 151580 630 0 0 20 0 1 0 411673277 16253820928 3945838 33554432000 4194304 6210612 140728527293744 140728527267304 139923949423589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3968218 3945838 819 493 0 3961523 0
Current children cumulated CPU time: 1522.1 s
Current children cumulated vsize: 15872872 KiB
Current children cumulated memory: 15783352 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1525.23 s]
# the end of solver process 2197 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1516.13 s, system=7.05611 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1523.2 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2365
/proc/meminfo: memFree=13870972/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=15872872 memory=15783352 CPUtime=1522.24 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) S 2194 2197 27829 0 -1 512 3835388 0 0 0 151592 632 0 0 20 0 1 0 411673277 16253820928 3945838 33554432000 4194304 6210612 140728527293744 140728527267304 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3968218 3945838 819 493 0 3961523 0
Current children cumulated CPU time: 1522.24 s
Current children cumulated vsize: 15872872 KiB
Current children cumulated memory: 15783352 KiB

[startup+1524 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 2365
/proc/meminfo: memFree=13273044/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=15872872 memory=15783352 CPUtime=1522.37 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) R 2194 2197 27829 0 -1 512 3835388 0 0 0 151605 632 0 0 20 0 1 0 411673277 16253820928 3945838 33554432000 4194304 6210612 140728527293744 140728527267304 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3968218 3945838 819 493 0 3961523 0
Current children cumulated CPU time: 1522.37 s
Current children cumulated vsize: 15872872 KiB
Current children cumulated memory: 15783352 KiB

[startup+1524.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2365
/proc/meminfo: memFree=13273044/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=15872872 memory=15783352 CPUtime=1522.43 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) S 2194 2197 27829 0 -1 512 3835388 0 0 0 151611 632 0 0 20 0 1 0 411673277 16253820928 3945838 33554432000 4194304 6210612 140728527293744 140728527267304 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3968218 3945838 819 493 0 3961523 0
Current children cumulated CPU time: 1522.43 s
Current children cumulated vsize: 15872872 KiB
Current children cumulated memory: 15783352 KiB

[startup+1524.5 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 2365
/proc/meminfo: memFree=13273044/32770624 swapFree=66932240/67108860
[pid=2197] ppid=2194 vsize=15872872 memory=15783352 CPUtime=1522.44 cores=1,3,5,7
/proc/2197/stat : 2197 (cosoco) S 2194 2197 27829 0 -1 512 3835388 0 0 0 151612 632 0 0 20 0 1 0 411673277 16253820928 3945838 33554432000 4194304 6210612 140728527293744 140728527267304 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8308220 8313664 12791808 140728527295499 140728527295601 140728527295601 140728527298510 0
/proc/2197/statm: 3968218 3945838 819 493 0 3961523 0
Current children cumulated CPU time: 1522.44 s
Current children cumulated vsize: 15872872 KiB
Current children cumulated memory: 15783352 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1525.23
CPU time (s): 1523.19
CPU user time (s): 1516.13
CPU system time (s): 7.05611
CPU usage (%): 99.8658
Max. virtual memory (cumulated for all children) (KiB): 15872872
Max. memory (cumulated for all children) (KiB): 15783352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1516.13
system time used= 7.05611
maximum resident set size= 15783412
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3835388
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 146582
involuntary context switches= 1685


# summary of solver processes directly reported to runsolver:
#   pid: 2197
#   total CPU time (s): 1523.19
#   total CPU user time (s): 1516.13
#   total CPU system time (s): 7.05611

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.8642 second user time and 9.818 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-13 07:55:58
IDJOB=4390409
IDBENCH=139368
IDSOLVER=2831
FILE ID=node139/4390409-1568354056
RUNJOBID= node139-1568325638-27861
PBS_JOBID= 21701151
Free space on /tmp= 55336 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_14_1.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390409-1568354056/watcher-4390409-1568354056 -o /tmp/evaluation-result-4390409-1568354056/solver-4390409-1568354056 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568325638-27861 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390409-1568354056.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 25e4edec3d9f4a5618481cbfa250deb6
RANDOM SEED=1372605764

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29981712 kB
MemAvailable:   31807308 kB
Buffers:           94756 kB
Cached:          1991260 kB
SwapCached:        73392 kB
Active:           355292 kB
Inactive:        1806524 kB
Active(anon):       8076 kB
Inactive(anon):   108784 kB
Active(file):     347216 kB
Inactive(file):  1697740 kB
Unevictable:      110720 kB
Mlocked:          110720 kB
SwapTotal:      67108860 kB
SwapFree:       66932232 kB
Dirty:              2724 kB
Writeback:             0 kB
AnonPages:        114636 kB
Mapped:            43628 kB
Shmem:             32176 kB
Slab:             222076 kB
SReclaimable:     192948 kB
SUnreclaim:        29128 kB
KernelStack:        3536 kB
PageTables:         5896 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     519496 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 54764 MiB
End job on node139 at 2019-09-13 08:21:23