Trace number 4408445

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1511.25 1513.17

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_15_2.xml
MD5SUM5f96bf565600cbf50f8c2cf3fe757a5f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark105
Best CPU time to get the best result obtained on this benchmark2520.58
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":11,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14728 MiB free)
  memory of node 1: 16384 MiB (15546 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408445-1569811456/watcher-4408445-1569811456 -o /tmp/evaluation-result-4408445-1569811456/solver-4408445-1569811456 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1569787347-31155 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408445-1569811456.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2784, runsolver pid=2781
Current StackSize limit: 8192 KiB


[startup+0.10016 s]*
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30991116/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=39156 memory=15232 CPUtime=0.09 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 4008 0 0 0 9 0 0 0 20 0 1 0 557394146 40095744 3808 33554432000 4194304 6211132 140720829423104 140720829420376 140406138127488 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 9789 3808 809 493 0 3094 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 39156 KiB
Current children cumulated memory: 15232 KiB

[startup+0.209799 s]*
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30989628/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=40732 memory=17008 CPUtime=0.2 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 4431 0 0 0 20 0 0 0 20 0 1 0 557394146 41709568 4252 33554432000 4194304 6211132 140720829423104 140720829420376 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 10183 4252 819 493 0 3488 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40732 KiB
Current children cumulated memory: 17008 KiB

[startup+0.309043 s]*
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30988148/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=41716 memory=18064 CPUtime=0.3 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 4689 0 0 0 30 0 0 0 20 0 1 0 557394146 42717184 4516 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 10429 4516 819 493 0 3734 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41716 KiB
Current children cumulated memory: 18064 KiB

[startup+0.700277 s]
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30985916/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=45844 memory=21996 CPUtime=0.69 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 5687 0 0 0 68 1 0 0 20 0 1 0 557394146 46944256 5499 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 11461 5499 819 493 0 4766 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45844 KiB
Current children cumulated memory: 21996 KiB

[startup+1.50028 s]
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30981080/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=54212 memory=30320 CPUtime=1.49 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 7768 0 0 0 148 1 0 0 20 0 1 0 557394146 55513088 7580 33554432000 4194304 6211132 140720829423104 140720829396664 5012856 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 13553 7580 819 493 0 6858 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54212 KiB
Current children cumulated memory: 30320 KiB

[startup+3.10956 s]
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30960144/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=71160 memory=47076 CPUtime=3.09 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 12125 0 0 0 308 1 0 0 20 0 1 0 557394146 72867840 11769 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 17790 11769 819 493 0 11095 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 71160 KiB
Current children cumulated memory: 47076 KiB

[startup+6.30027 s]
/proc/loadavg: 2.01 2.02 2.05 3/202 2785
/proc/meminfo: memFree=30928936/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=104968 memory=80264 CPUtime=6.28 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 20600 0 0 0 626 2 0 0 20 0 1 0 557394146 107487232 20066 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 26242 20066 819 493 0 19547 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 104968 KiB
Current children cumulated memory: 80264 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.02 2.05 3/201 2785
/proc/meminfo: memFree=30866208/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=170956 memory=146788 CPUtime=12.68 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 37423 0 0 0 1264 4 0 0 20 0 1 0 557394146 175058944 36697 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 42739 36697 819 493 0 36044 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 170956 KiB
Current children cumulated memory: 146788 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 2785
/proc/meminfo: memFree=30729040/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=305320 memory=281324 CPUtime=25.48 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 70839 0 0 0 2540 8 0 0 20 0 1 0 557394146 312647680 70331 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 76330 70331 819 493 0 69635 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 305320 KiB
Current children cumulated memory: 281324 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 2788
/proc/meminfo: memFree=30458904/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=575796 memory=547028 CPUtime=51.09 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 136416 0 0 0 5092 17 0 0 20 0 1 0 557394146 589615104 136757 33554432000 4194304 6211132 140720829423104 140720829396664 5479708 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 143949 136757 819 493 0 137254 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 575796 KiB
Current children cumulated memory: 547028 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2793
/proc/meminfo: memFree=29926640/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=1119388 memory=1079672 CPUtime=102.27 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 266667 0 0 0 10194 33 0 0 20 0 1 0 557394146 1146253312 269918 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 279847 269918 819 493 0 273152 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1119388 KiB
Current children cumulated memory: 1079672 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2797
/proc/meminfo: memFree=29298628/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=1749080 memory=1705268 CPUtime=162.26 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 418499 0 0 0 16175 51 0 0 20 0 1 0 557394146 1791057920 426317 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 437270 426317 819 493 0 430575 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 1749080 KiB
Current children cumulated memory: 1705268 KiB

[startup+222.3 s]
/proc/loadavg: 1.96 2.00 2.04 3/200 2861
/proc/meminfo: memFree=28556188/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=2356280 memory=2331140 CPUtime=222.25 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 570326 0 0 0 22151 74 0 0 20 0 1 0 557394146 2412830720 582785 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 589070 582785 819 493 0 582375 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 2356280 KiB
Current children cumulated memory: 2331140 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/200 2867
/proc/meminfo: memFree=27307332/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=3000920 memory=2959236 CPUtime=282.24 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 722816 0 0 0 28128 96 0 0 20 0 1 0 557394146 3072942080 739809 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 750230 739809 819 493 0 743535 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 3000920 KiB
Current children cumulated memory: 2959236 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/200 2871
/proc/meminfo: memFree=26061744/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=3663880 memory=3587392 CPUtime=342.23 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 875250 0 0 0 34107 116 0 0 20 0 1 0 557394146 3751813120 896848 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 915970 896848 819 493 0 909275 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 3663880 KiB
Current children cumulated memory: 3587392 KiB

[startup+402.3 s]
/proc/loadavg: 1.92 1.98 2.03 3/200 2883
/proc/meminfo: memFree=24819768/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=4271344 memory=4213396 CPUtime=402.22 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 1027158 0 0 0 40085 137 0 0 20 0 1 0 557394146 4373856256 1053349 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 1067836 1053349 819 493 0 1061141 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 4271344 KiB
Current children cumulated memory: 4213396 KiB

[startup+462.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/200 2889
/proc/meminfo: memFree=23570000/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=4878940 memory=4841384 CPUtime=462.21 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 1179092 0 0 0 46062 159 0 0 20 0 1 0 557394146 4996034560 1210346 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 1219735 1210346 819 493 0 1213040 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 4878940 KiB
Current children cumulated memory: 4841384 KiB


################
# More data... #
################

Current children cumulated vsize: 9336952 KiB
Current children cumulated memory: 9228448 KiB

[startup+942.3 s]
/proc/loadavg: 2.03 2.07 2.06 3/199 2927
/proc/meminfo: memFree=13598152/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=9943888 memory=9855568 CPUtime=942.14 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 2395295 0 0 0 93856 358 0 0 20 0 1 0 557394146 10182541312 2463892 33554432000 4194304 6211132 140720829423104 140720829396664 140406122060606 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 2485972 2463892 819 493 0 2479277 0
Current children cumulated CPU time: 942.14 s
Current children cumulated vsize: 9943888 KiB
Current children cumulated memory: 9855568 KiB

[startup+1002.3 s]
/proc/loadavg: 2.01 2.06 2.05 3/200 2941
/proc/meminfo: memFree=12352652/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=10550560 memory=10480864 CPUtime=1002.13 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 2547069 0 0 0 99827 386 0 0 20 0 1 0 557394146 10803773440 2620216 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 2637640 2620216 819 493 0 2630945 0
Current children cumulated CPU time: 1002.13 s
Current children cumulated vsize: 10550560 KiB
Current children cumulated memory: 10480864 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/201 2968
/proc/meminfo: memFree=11108128/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=11157364 memory=11108204 CPUtime=1062.13 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 2698863 0 0 0 105799 414 0 0 20 0 1 0 557394146 11425140736 2777051 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 2789341 2777051 819 493 0 2782646 0
Current children cumulated CPU time: 1062.13 s
Current children cumulated vsize: 11157364 KiB
Current children cumulated memory: 11108204 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 2972
/proc/meminfo: memFree=9862088/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=11763904 memory=11732968 CPUtime=1122.13 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 2850563 0 0 0 111766 447 0 0 20 0 1 0 557394146 12046237696 2933242 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 2940976 2933242 819 493 0 2934281 0
Current children cumulated CPU time: 1122.13 s
Current children cumulated vsize: 11763904 KiB
Current children cumulated memory: 11732968 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 2978
/proc/meminfo: memFree=8616624/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=12557300 memory=12359340 CPUtime=1182.11 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3002642 0 0 0 117738 473 0 0 20 0 1 0 557394146 12858675200 3089835 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3139325 3089835 819 493 0 3132630 0
Current children cumulated CPU time: 1182.11 s
Current children cumulated vsize: 12557300 KiB
Current children cumulated memory: 12359340 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 2982
/proc/meminfo: memFree=7372256/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=13163708 memory=12986432 CPUtime=1242.11 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3154331 0 0 0 123708 503 0 0 20 0 1 0 557394146 13479636992 3246608 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3290927 3246608 819 493 0 3284232 0
Current children cumulated CPU time: 1242.11 s
Current children cumulated vsize: 13163708 KiB
Current children cumulated memory: 12986432 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 2986
/proc/meminfo: memFree=6127716/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=13770116 memory=13611244 CPUtime=1302.1 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3306005 0 0 0 129678 532 0 0 20 0 1 0 557394146 14100598784 3402811 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3442529 3402811 819 493 0 3435834 0
Current children cumulated CPU time: 1302.1 s
Current children cumulated vsize: 13770116 KiB
Current children cumulated memory: 13611244 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 2992
/proc/meminfo: memFree=4881688/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=14376392 memory=14238052 CPUtime=1362.09 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3457663 0 0 0 135645 564 0 0 20 0 1 0 557394146 14721425408 3559513 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3594098 3559513 819 493 0 3587403 0
Current children cumulated CPU time: 1362.09 s
Current children cumulated vsize: 14376392 KiB
Current children cumulated memory: 14238052 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2996
/proc/meminfo: memFree=3638464/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=14982668 memory=14862764 CPUtime=1422.08 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3609349 0 0 0 141610 598 0 0 20 0 1 0 557394146 15342252032 3715691 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3745667 3715691 819 493 0 3738972 0
Current children cumulated CPU time: 1422.08 s
Current children cumulated vsize: 14982668 KiB
Current children cumulated memory: 14862764 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 3000
/proc/meminfo: memFree=2393612/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=15588944 memory=15489312 CPUtime=1482.08 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3760983 0 0 0 147576 632 0 0 20 0 1 0 557394146 15963078656 3872328 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3897236 3872328 819 493 0 3890541 0
Current children cumulated CPU time: 1482.08 s
Current children cumulated vsize: 15588944 KiB
Current children cumulated memory: 15489312 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1510.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 3003
/proc/meminfo: memFree=1812780/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=15872876 memory=15781636 CPUtime=1510.17 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 4202496 3832034 0 0 0 150369 648 0 0 20 0 1 0 557394146 16253825024 3945409 33554432000 4194304 6211132 140720829423104 140720829396664 140406122064869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3968219 3945409 819 493 0 3961524 0
Current children cumulated CPU time: 1510.17 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781636 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1513.17 s]
# the end of solver process 2784 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1503.97 s, system=7.27956 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1511.2 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 3004
/proc/meminfo: memFree=1475092/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=15872876 memory=15781636 CPUtime=1510.3 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) S 2781 2784 31123 0 -1 512 3832038 0 0 0 150380 650 0 0 20 0 1 0 557394146 16253825024 3945409 33554432000 4194304 6211132 140720829423104 140720829396664 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3968219 3945409 819 493 0 3961524 0
Current children cumulated CPU time: 1510.3 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781636 KiB

[startup+1512 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 3004
/proc/meminfo: memFree=986844/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=15872876 memory=15781636 CPUtime=1510.42 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) R 2781 2784 31123 0 -1 512 3832038 0 0 0 150392 650 0 0 20 0 1 0 557394146 16253825024 3945409 33554432000 4194304 6211132 140720829423104 140720829396664 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3968219 3945409 819 493 0 3961524 0
Current children cumulated CPU time: 1510.42 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781636 KiB

[startup+1512.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 3004
/proc/meminfo: memFree=986844/32770624 swapFree=67002192/67108860
[pid=2784] ppid=2781 vsize=15872876 memory=15781636 CPUtime=1510.48 cores=1,3,5,7
/proc/2784/stat : 2784 (cosoco) S 2781 2784 31123 0 -1 512 3832038 0 0 0 150397 651 0 0 20 0 1 0 557394146 16253825024 3945409 33554432000 4194304 6211132 140720829423104 140720829396664 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 22974464 140720829428747 140720829428849 140720829428849 140720829431758 0
/proc/2784/statm: 3968219 3945409 819 493 0 3961524 0
Current children cumulated CPU time: 1510.48 s
Current children cumulated vsize: 15872876 KiB
Current children cumulated memory: 15781636 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1513.17
CPU time (s): 1511.25
CPU user time (s): 1503.97
CPU system time (s): 7.27956
CPU usage (%): 99.8735
Max. virtual memory (cumulated for all children) (KiB): 15872876
Max. memory (cumulated for all children) (KiB): 15781636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1503.97
system time used= 7.27956
maximum resident set size= 15781740
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3832038
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 124360
involuntary context switches= 2193


# summary of solver processes directly reported to runsolver:
#   pid: 2784
#   total CPU time (s): 1511.25
#   total CPU user time (s): 1503.97
#   total CPU system time (s): 7.27956

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.13855 second user time and 10.2691 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-30 04:43:31
IDJOB=4408445
IDBENCH=139378
IDSOLVER=2874
FILE ID=node136/4408445-1569811456
RUNJOBID= node136-1569787347-31155
PBS_JOBID= 21705824
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_15_2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408445-1569811456/watcher-4408445-1569811456 -o /tmp/evaluation-result-4408445-1569811456/solver-4408445-1569811456 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1569787347-31155 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408445-1569811456.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f96bf565600cbf50f8c2cf3fe757a5f
RANDOM SEED=635550199

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31002872 kB
MemAvailable:   31456076 kB
Buffers:          102312 kB
Cached:           672008 kB
SwapCached:         3864 kB
Active:           948552 kB
Inactive:         233756 kB
Active(anon):     401764 kB
Inactive(anon):    87688 kB
Active(file):     546788 kB
Inactive(file):   146068 kB
Unevictable:      106792 kB
Mlocked:          106792 kB
SwapTotal:      67108860 kB
SwapFree:       67002192 kB
Dirty:              2724 kB
Writeback:             0 kB
AnonPages:        515336 kB
Mapped:            28916 kB
Shmem:             72848 kB
Slab:             182268 kB
SReclaimable:     152368 kB
SUnreclaim:        29900 kB
KernelStack:        3600 kB
PageTables:         6016 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     968684 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    464896 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61540 MiB
End job on node136 at 2019-09-30 05:08:44