Trace number 4409148

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1556.8 1558.68

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_19_19.xml
MD5SUM96fe93baa9d8ae993bfc516e2d84a024
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1288.59
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":10,"count":111},{"size":48,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14122 MiB free)
  memory of node 1: 16384 MiB (15231 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409148-1569813371/watcher-4409148-1569813371 -o /tmp/evaluation-result-4409148-1569813371/solver-4409148-1569813371 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node124-1569787351-8456 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409148-1569813371.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=13869, runsolver pid=13866

[startup+0.100577 s]*
/proc/loadavg: 2.00 2.00 2.02 3/199 13870
/proc/meminfo: memFree=30046980/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=38884 memory=15084 CPUtime=0.09 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3976 0 0 0 9 0 0 0 20 0 1 0 557277081 39817216 3771 33554432000 4194304 6211132 140734940496560 140734940491720 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 9721 3771 809 493 0 3026 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 38884 KiB
Current children cumulated memory: 15084 KiB

[startup+0.209703 s]*
/proc/loadavg: 2.00 2.00 2.02 3/199 13870
/proc/meminfo: memFree=30045492/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=40588 memory=16732 CPUtime=0.2 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 4410 0 0 0 20 0 0 0 20 0 1 0 557277081 41562112 4183 33554432000 4194304 6211132 140734940496560 140734940491720 5443112 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 10147 4183 819 493 0 3452 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40588 KiB
Current children cumulated memory: 16732 KiB

[startup+0.309006 s]*
/proc/loadavg: 2.00 2.00 2.02 3/199 13870
/proc/meminfo: memFree=30044376/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=41708 memory=17788 CPUtime=0.3 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 4662 0 0 0 30 0 0 0 20 0 1 0 557277081 42708992 4447 33554432000 4194304 6211132 140734940496560 140734940491720 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 10427 4447 819 493 0 3732 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41708 KiB
Current children cumulated memory: 17788 KiB

[startup+0.700284 s]
/proc/loadavg: 2.00 2.00 2.02 3/199 13870
/proc/meminfo: memFree=30041772/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=45572 memory=21728 CPUtime=0.68 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 5631 0 0 0 68 0 0 0 20 0 1 0 557277081 46665728 5432 33554432000 4194304 6211132 140734940496560 140734940491720 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 11393 5432 819 493 0 4698 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 45572 KiB
Current children cumulated memory: 21728 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.00 2.02 3/199 13870
/proc/meminfo: memFree=30037016/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=53808 memory=29784 CPUtime=1.49 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 7654 0 0 0 148 1 0 0 20 0 1 0 557277081 55099392 7446 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 13452 7446 819 493 0 6757 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 53808 KiB
Current children cumulated memory: 29784 KiB

[startup+3.10948 s]
/proc/loadavg: 2.00 2.00 2.02 3/199 13870
/proc/meminfo: memFree=30016556/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=70228 memory=46016 CPUtime=3.09 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 11901 0 0 0 308 1 0 0 20 0 1 0 557277081 71913472 11504 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 17557 11504 819 493 0 10862 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 70228 KiB
Current children cumulated memory: 46016 KiB

[startup+6.30028 s]
/proc/loadavg: 1.92 1.99 2.01 3/199 13870
/proc/meminfo: memFree=29985820/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=103112 memory=78400 CPUtime=6.28 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 20154 0 0 0 626 2 0 0 20 0 1 0 557277081 105586688 19600 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 25778 19600 819 493 0 19083 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 103112 KiB
Current children cumulated memory: 78400 KiB

[startup+12.7003 s]
/proc/loadavg: 1.93 1.99 2.01 3/199 13870
/proc/meminfo: memFree=29925192/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=167384 memory=143348 CPUtime=12.68 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 36530 0 0 0 1264 4 0 0 20 0 1 0 557277081 171401216 35837 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 41846 35837 819 493 0 35151 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 167384 KiB
Current children cumulated memory: 143348 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 1.99 2.01 3/199 13870
/proc/meminfo: memFree=29791836/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=298316 memory=274164 CPUtime=25.48 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 69095 0 0 0 2539 9 0 0 20 0 1 0 557277081 305475584 68541 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 74579 68541 819 493 0 67884 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 298316 KiB
Current children cumulated memory: 274164 KiB

[startup+51.1095 s]
/proc/loadavg: 1.96 1.99 2.01 3/199 13872
/proc/meminfo: memFree=29528600/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=561664 memory=533032 CPUtime=51.09 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 132929 0 0 0 5092 17 0 0 20 0 1 0 557277081 575143936 133258 33554432000 4194304 6211132 140734940496560 140734940470120 5443090 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 140416 133258 819 493 0 133721 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 561664 KiB
Current children cumulated memory: 533032 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 1.99 2.01 3/199 13876
/proc/meminfo: memFree=29011224/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=1074860 memory=1050684 CPUtime=102.29 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 259459 0 0 0 10193 36 0 0 20 0 1 0 557277081 1100656640 262671 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 268715 262671 819 493 0 262020 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1074860 KiB
Current children cumulated memory: 1050684 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.01 3/199 13880
/proc/meminfo: memFree=28402032/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=1704588 memory=1658860 CPUtime=162.29 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 407409 0 0 0 16178 51 0 0 20 0 1 0 557277081 1745498112 414715 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 426147 414715 819 493 0 419452 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 1704588 KiB
Current children cumulated memory: 1658860 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.01 3/199 13886
/proc/meminfo: memFree=27792564/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=2293308 memory=2268020 CPUtime=222.29 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 554612 0 0 0 22159 70 0 0 20 0 1 0 557277081 2348347392 567005 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 573327 567005 819 493 0 566632 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2293308 KiB
Current children cumulated memory: 2268020 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.01 3/200 13898
/proc/meminfo: memFree=27182788/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=2918940 memory=2875192 CPUtime=282.29 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 702518 0 0 0 28141 88 0 0 20 0 1 0 557277081 2988994560 718798 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 729735 718798 819 493 0 723040 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2918940 KiB
Current children cumulated memory: 2875192 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.01 3/200 13902
/proc/meminfo: memFree=26575132/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=3507396 memory=3482232 CPUtime=342.29 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 849991 0 0 0 34122 107 0 0 20 0 1 0 557277081 3591573504 870558 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 876849 870558 819 493 0 870154 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 3507396 KiB
Current children cumulated memory: 3482232 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.01 3/200 13908
/proc/meminfo: memFree=25966556/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=4151348 memory=4089032 CPUtime=402.29 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 997996 0 0 0 40102 127 0 0 20 0 1 0 557277081 4250980352 1022258 33554432000 4194304 6211132 140734940496560 140734940470120 140573273479998 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 1037837 1022258 819 493 0 1031142 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 4151348 KiB
Current children cumulated memory: 4089032 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.01 3/200 13912
/proc/meminfo: memFree=25356364/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=4739672 memory=4697840 CPUtime=462.3 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 1145774 0 0 0 46084 146 0 0 20 0 1 0 557277081 4853424128 1174460 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 1184918 1174460 819 493 0 1178223 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 4739672 KiB
Current children cumulated memory: 4697840 KiB


################
# More data... #
################

Current children cumulated vsize: 10250912 KiB
Current children cumulated memory: 10170956 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 14032
/proc/meminfo: memFree=20153296/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=10840292 memory=10780836 CPUtime=1062.18 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 2623235 0 0 0 105821 397 0 0 20 0 1 0 557277081 11100459008 2695209 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 2710073 2695209 819 493 0 2703378 0
Current children cumulated CPU time: 1062.18 s
Current children cumulated vsize: 10840292 KiB
Current children cumulated memory: 10780836 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 14038
/proc/meminfo: memFree=19544028/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=11429540 memory=11388248 CPUtime=1122.16 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 2770802 0 0 0 111790 426 0 0 20 0 1 0 557277081 11703848960 2847062 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 2857385 2847062 819 493 0 2850690 0
Current children cumulated CPU time: 1122.16 s
Current children cumulated vsize: 11429540 KiB
Current children cumulated memory: 11388248 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 14042
/proc/meminfo: memFree=18933568/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=12205380 memory=11997376 CPUtime=1182.15 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 2918683 0 0 0 117757 458 0 0 20 0 1 0 557277081 12498309120 2999344 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3051345 2999344 819 493 0 3044650 0
Current children cumulated CPU time: 1182.15 s
Current children cumulated vsize: 12205380 KiB
Current children cumulated memory: 11997376 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 14046
/proc/meminfo: memFree=18324544/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=12794628 memory=12605056 CPUtime=1242.14 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3066255 0 0 0 123728 486 0 0 20 0 1 0 557277081 13101699072 3151264 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3198657 3151264 819 493 0 3191962 0
Current children cumulated CPU time: 1242.14 s
Current children cumulated vsize: 12794628 KiB
Current children cumulated memory: 12605056 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 14052
/proc/meminfo: memFree=17718344/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=13383612 memory=13212400 CPUtime=1302.13 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3213725 0 0 0 129699 514 0 0 20 0 1 0 557277081 13704818688 3303100 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3345903 3303100 819 493 0 3339208 0
Current children cumulated CPU time: 1302.13 s
Current children cumulated vsize: 13383612 KiB
Current children cumulated memory: 13212400 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 14056
/proc/meminfo: memFree=17108248/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=13972596 memory=13819820 CPUtime=1362.11 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3361235 0 0 0 135663 548 0 0 20 0 1 0 557277081 14307938304 3454955 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3493149 3454955 819 493 0 3486454 0
Current children cumulated CPU time: 1362.11 s
Current children cumulated vsize: 13972596 KiB
Current children cumulated memory: 13819820 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 14061
/proc/meminfo: memFree=16497672/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=14561316 memory=14429012 CPUtime=1422.1 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3508690 0 0 0 141631 579 0 0 20 0 1 0 557277081 14910787584 3607253 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3640329 3607253 819 493 0 3633634 0
Current children cumulated CPU time: 1422.1 s
Current children cumulated vsize: 14561316 KiB
Current children cumulated memory: 14429012 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 14074
/proc/meminfo: memFree=15887628/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15150168 memory=15036416 CPUtime=1482.09 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3656165 0 0 0 147598 611 0 0 20 0 1 0 557277081 15513772032 3759104 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3787542 3759104 819 493 0 3780847 0
Current children cumulated CPU time: 1482.09 s
Current children cumulated vsize: 15150168 KiB
Current children cumulated memory: 15036416 KiB

[startup+1542.3 s]
/proc/loadavg: 2.08 2.03 2.04 3/200 14078
/proc/meminfo: memFree=15278568/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15738756 memory=15643296 CPUtime=1542.08 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3803584 0 0 0 153564 644 0 0 20 0 1 0 557277081 16116486144 3910824 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3934689 3910824 819 493 0 3927994 0
Current children cumulated CPU time: 1542.08 s
Current children cumulated vsize: 15738756 KiB
Current children cumulated memory: 15643296 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1555.9 s]
/proc/loadavg: 2.29 2.08 2.06 3/200 14078
/proc/meminfo: memFree=15146340/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15872076 memory=15780828 CPUtime=1555.68 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) R 13866 13869 8424 0 -1 4202496 3837014 0 0 0 154915 653 0 0 20 0 1 0 557277081 16253005824 3945207 33554432000 4194304 6211132 140734940496560 140734940470120 140573273484261 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3968019 3945207 819 493 0 3961324 0
Current children cumulated CPU time: 1555.68 s
Current children cumulated vsize: 15872076 KiB
Current children cumulated memory: 15780828 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1558.68 s]
# the end of solver process 13869 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1549.46 s, system=7.33536 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1556.8 s]
/proc/loadavg: 2.29 2.08 2.06 3/201 14079
/proc/meminfo: memFree=15085720/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15872076 memory=15780828 CPUtime=1555.82 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) S 13866 13869 8424 0 -1 512 3837018 0 0 0 154928 654 0 0 20 0 1 0 557277081 16253005824 3945207 33554432000 4194304 6211132 140734940496560 140734940470120 5189800 0 16384 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3968019 3945207 819 493 0 3961324 0
Current children cumulated CPU time: 1555.82 s
Current children cumulated vsize: 15872076 KiB
Current children cumulated memory: 15780828 KiB

[startup+1557.6 s]
/proc/loadavg: 2.29 2.08 2.06 3/201 14079
/proc/meminfo: memFree=14535252/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15872076 memory=15780828 CPUtime=1555.96 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) S 13866 13869 8424 0 -1 512 3837018 0 0 0 154941 655 0 0 20 0 1 0 557277081 16253005824 3945207 33554432000 4194304 6211132 140734940496560 140734940470120 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3968019 3945207 819 493 0 3961324 0
Current children cumulated CPU time: 1555.96 s
Current children cumulated vsize: 15872076 KiB
Current children cumulated memory: 15780828 KiB

[startup+1557.8 s]
/proc/loadavg: 2.29 2.08 2.06 3/201 14079
/proc/meminfo: memFree=14535252/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15872076 memory=15780828 CPUtime=1555.99 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) S 13866 13869 8424 0 -1 512 3837018 0 0 0 154944 655 0 0 20 0 1 0 557277081 16253005824 3945207 33554432000 4194304 6211132 140734940496560 140734940470120 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3968019 3945207 819 493 0 3961324 0
Current children cumulated CPU time: 1555.99 s
Current children cumulated vsize: 15872076 KiB
Current children cumulated memory: 15780828 KiB

[startup+1557.9 s]
/proc/loadavg: 2.29 2.08 2.06 3/201 14079
/proc/meminfo: memFree=14535252/32770624 swapFree=66976580/67108860
[pid=13869] ppid=13866 vsize=15872076 memory=15780828 CPUtime=1556.01 cores=1,3,5,7
/proc/13869/stat : 13869 (cosoco) S 13866 13869 8424 0 -1 512 3837018 0 0 0 154946 655 0 0 20 0 1 0 557277081 16253005824 3945207 33554432000 4194304 6211132 140734940496560 140734940470120 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 28262400 140734940505099 140734940505201 140734940505201 140734940508110 0
/proc/13869/statm: 3968019 3945207 819 493 0 3961324 0
Current children cumulated CPU time: 1556.01 s
Current children cumulated vsize: 15872076 KiB
Current children cumulated memory: 15780828 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1558.68
CPU time (s): 1556.8
CPU user time (s): 1549.46
CPU system time (s): 7.33536
CPU usage (%): 99.879
Max. virtual memory (cumulated for all children) (KiB): 15872076
Max. memory (cumulated for all children) (KiB): 15780828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1549.46
system time used= 7.33536
maximum resident set size= 15780916
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3837018
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 137106
involuntary context switches= 1061


# summary of solver processes directly reported to runsolver:
#   pid: 13869
#   total CPU time (s): 1556.8
#   total CPU user time (s): 1549.46
#   total CPU system time (s): 7.33536

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.77835 second user time and 10.3358 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-30 05:15:29
IDJOB=4409148
IDBENCH=139614
IDSOLVER=2876
FILE ID=node124/4409148-1569813371
RUNJOBID= node124-1569787351-8456
PBS_JOBID= 21705829
Free space on /tmp= 61948 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_19_19.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409148-1569813371/watcher-4409148-1569813371 -o /tmp/evaluation-result-4409148-1569813371/solver-4409148-1569813371 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node124-1569787351-8456 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409148-1569813371.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 96fe93baa9d8ae993bfc516e2d84a024
RANDOM SEED=1186475149

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30059036 kB
MemAvailable:   31031788 kB
Buffers:          114224 kB
Cached:          1199496 kB
SwapCached:        29128 kB
Active:          1775180 kB
Inactive:         387104 kB
Active(anon):     817072 kB
Inactive(anon):   113716 kB
Active(file):     958108 kB
Inactive(file):   273388 kB
Unevictable:      108828 kB
Mlocked:          108828 kB
SwapTotal:      67108860 kB
SwapFree:       66976580 kB
Dirty:              2728 kB
Writeback:             0 kB
AnonPages:        929608 kB
Mapped:            28740 kB
Shmem:             73488 kB
Slab:             143016 kB
SReclaimable:     114180 kB
SUnreclaim:        28836 kB
KernelStack:        3472 kB
PageTables:         7032 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1399140 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    878592 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61492 MiB
End job on node124 at 2019-09-30 05:41:28