Trace number 4409155

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1563.35 1565.26

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_5_11.xml
MD5SUMbb782f0c2876622a4bcf03fe44f48018
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark432
Best CPU time to get the best result obtained on this benchmark2400.09
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":18,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15294 MiB free)
  memory of node 1: 16384 MiB (15551 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409155-1569812650/watcher-4409155-1569812650 -o /tmp/evaluation-result-4409155-1569812650/solver-4409155-1569812650 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node127-1569812554-14458 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409155-1569812650.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=14938, runsolver pid=14935

[startup+0.100014 s]*
/proc/loadavg: 1.54 1.50 1.79 3/200 14939
/proc/meminfo: memFree=31573928/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=39160 memory=15368 CPUtime=0.1 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 4012 0 0 0 10 0 0 0 20 0 1 0 557533756 40099840 3842 33554432000 4194304 6211132 140732205332912 140732205329448 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 9790 3842 809 493 0 3095 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39160 KiB
Current children cumulated memory: 15368 KiB

[startup+0.209759 s]*
/proc/loadavg: 1.54 1.50 1.79 3/200 14939
/proc/meminfo: memFree=31570952/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=40736 memory=17008 CPUtime=0.2 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 4431 0 0 0 20 0 0 0 20 0 1 0 557533756 41713664 4252 33554432000 4194304 6211132 140732205332912 140732205329448 140153246585875 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 10184 4252 819 493 0 3489 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40736 KiB
Current children cumulated memory: 17008 KiB

[startup+0.309025 s]*
/proc/loadavg: 1.54 1.50 1.79 3/200 14939
/proc/meminfo: memFree=31569092/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=41720 memory=18064 CPUtime=0.3 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 4683 0 0 0 30 0 0 0 20 0 1 0 557533756 42721280 4516 33554432000 4194304 6211132 140732205332912 140732205329448 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 10430 4516 819 493 0 3735 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41720 KiB
Current children cumulated memory: 18064 KiB

[startup+0.700276 s]
/proc/loadavg: 1.54 1.50 1.79 3/200 14939
/proc/meminfo: memFree=31565124/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=45716 memory=21736 CPUtime=0.69 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 5651 0 0 0 69 0 0 0 20 0 1 0 557533756 46813184 5434 33554432000 4194304 6211132 140732205332912 140732205329448 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 11429 5434 819 493 0 4734 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45716 KiB
Current children cumulated memory: 21736 KiB

[startup+1.50028 s]
/proc/loadavg: 1.54 1.50 1.79 3/200 14939
/proc/meminfo: memFree=31555452/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=53820 memory=30056 CPUtime=1.49 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 7677 0 0 0 148 1 0 0 20 0 1 0 557533756 55111680 7514 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 13455 7514 819 493 0 6760 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 53820 KiB
Current children cumulated memory: 30056 KiB

[startup+3.10945 s]
/proc/loadavg: 1.57 1.51 1.80 3/200 14939
/proc/meminfo: memFree=31514580/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=70372 memory=46280 CPUtime=3.1 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 11919 0 0 0 308 2 0 0 20 0 1 0 557533756 72060928 11570 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 17593 11570 819 493 0 10898 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70372 KiB
Current children cumulated memory: 46280 KiB

[startup+6.30027 s]
/proc/loadavg: 1.57 1.51 1.80 3/200 14939
/proc/meminfo: memFree=31453448/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=103256 memory=78416 CPUtime=6.29 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 20163 0 0 0 627 2 0 0 20 0 1 0 557533756 105734144 19604 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 25814 19604 819 493 0 19119 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 103256 KiB
Current children cumulated memory: 78416 KiB

[startup+12.7003 s]
/proc/loadavg: 1.61 1.52 1.80 3/200 14939
/proc/meminfo: memFree=31331184/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=167396 memory=143356 CPUtime=12.69 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 36529 0 0 0 1265 4 0 0 20 0 1 0 557533756 171413504 35839 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 41849 35839 819 493 0 35154 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 167396 KiB
Current children cumulated memory: 143356 KiB

[startup+25.5003 s]
/proc/loadavg: 1.69 1.54 1.80 3/200 14940
/proc/meminfo: memFree=31062348/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=298196 memory=273920 CPUtime=25.49 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 68999 0 0 0 2541 8 0 0 20 0 1 0 557533756 305352704 68480 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 74549 68480 819 493 0 67854 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 298196 KiB
Current children cumulated memory: 273920 KiB

[startup+51.1094 s]
/proc/loadavg: 1.80 1.58 1.80 3/200 14942
/proc/meminfo: memFree=30533152/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=561148 memory=531520 CPUtime=51.09 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 133092 0 0 0 5092 17 0 0 20 0 1 0 557533756 574615552 132880 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 140287 132880 819 493 0 133592 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 561148 KiB
Current children cumulated memory: 531520 KiB

[startup+102.3 s]
/proc/loadavg: 1.91 1.64 1.81 3/200 14946
/proc/meminfo: memFree=29492060/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=1073288 memory=1048924 CPUtime=102.27 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 259525 0 0 0 10194 33 0 0 20 0 1 0 557533756 1099046912 262231 33554432000 4194304 6211132 140732205332912 140732205306472 140153245657918 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 268322 262231 819 493 0 261627 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1073288 KiB
Current children cumulated memory: 1048924 KiB

[startup+162.3 s]
/proc/loadavg: 1.97 1.71 1.83 3/199 14950
/proc/meminfo: memFree=28264956/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=1701564 memory=1655436 CPUtime=162.27 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 407089 0 0 0 16174 53 0 0 20 0 1 0 557533756 1742401536 413859 33554432000 4194304 6211132 140732205332912 140732205306472 140153246582708 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 425391 413859 819 493 0 418696 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 1701564 KiB
Current children cumulated memory: 1655436 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.76 1.84 3/199 14956
/proc/meminfo: memFree=27039160/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=2288964 memory=2263276 CPUtime=222.26 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 553927 0 0 0 22155 71 0 0 20 0 1 0 557533756 2343899136 565819 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 572241 565819 819 493 0 565546 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 2288964 KiB
Current children cumulated memory: 2263276 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.81 1.85 3/199 14960
/proc/meminfo: memFree=25814844/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=2913144 memory=2869152 CPUtime=282.25 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 701491 0 0 0 28135 90 0 0 20 0 1 0 557533756 2983059456 717288 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 728286 717288 819 493 0 721591 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 2913144 KiB
Current children cumulated memory: 2869152 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.84 1.86 3/199 14964
/proc/meminfo: memFree=24588860/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=3500280 memory=3474900 CPUtime=342.23 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 848626 0 0 0 34112 111 0 0 20 0 1 0 557533756 3584286720 868725 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 875070 868725 819 493 0 868375 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 3500280 KiB
Current children cumulated memory: 3474900 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.87 1.87 3/200 14978
/proc/meminfo: memFree=23364924/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=4142780 memory=4080404 CPUtime=402.23 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 996271 0 0 0 40089 134 0 0 20 0 1 0 557533756 4242206720 1020101 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 1035695 1020101 819 493 0 1029000 0
Current children cumulated CPU time: 402.23 s
Current children cumulated vsize: 4142780 KiB
Current children cumulated memory: 4080404 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.89 1.87 3/200 14982
/proc/meminfo: memFree=22139500/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=4729652 memory=4687664 CPUtime=462.22 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 1143677 0 0 0 46064 158 0 0 20 0 1 0 557533756 4843163648 1171916 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 1182413 1171916 819 493 0 1175718 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 4729652 KiB
Current children cumulated memory: 4687664 KiB


################
# More data... #
################

Current children cumulated vsize: 9629732 KiB
Current children cumulated memory: 9531056 KiB

[startup+1002.3 s]
/proc/loadavg: 2.02 2.05 1.95 3/199 15031
/proc/meminfo: memFree=11125088/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=10215944 memory=10135692 CPUtime=1002.14 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 2471117 0 0 0 99838 376 0 0 20 0 1 0 557533756 10461126656 2533923 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 2553986 2533923 819 493 0 2547291 0
Current children cumulated CPU time: 1002.14 s
Current children cumulated vsize: 10215944 KiB
Current children cumulated memory: 10135692 KiB

[startup+1062.3 s]
/proc/loadavg: 2.01 2.04 1.95 3/199 15035
/proc/meminfo: memFree=9903024/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=10802024 memory=10740032 CPUtime=1062.13 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 2618672 0 0 0 105808 405 0 0 20 0 1 0 557533756 11061272576 2685008 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 2700506 2685008 819 493 0 2693811 0
Current children cumulated CPU time: 1062.13 s
Current children cumulated vsize: 10802024 KiB
Current children cumulated memory: 10740032 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.04 1.95 3/199 15041
/proc/meminfo: memFree=8681700/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=11387972 memory=11344520 CPUtime=1122.12 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 2766016 0 0 0 111774 438 0 0 20 0 1 0 557533756 11661283328 2836130 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 2846993 2836130 819 493 0 2840298 0
Current children cumulated CPU time: 1122.12 s
Current children cumulated vsize: 11387972 KiB
Current children cumulated memory: 11344520 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.03 1.95 3/199 15045
/proc/meminfo: memFree=7458056/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=11973788 memory=11949228 CPUtime=1182.11 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 2913475 0 0 0 117742 469 0 0 20 0 1 0 557533756 12261158912 2987307 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 2993447 2987307 819 493 0 2986752 0
Current children cumulated CPU time: 1182.11 s
Current children cumulated vsize: 11973788 KiB
Current children cumulated memory: 11949228 KiB

[startup+1242.3 s]
/proc/loadavg: 1.97 2.01 1.95 3/199 15049
/proc/meminfo: memFree=6235412/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=12746724 memory=12554808 CPUtime=1242.11 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3061101 0 0 0 123711 500 0 0 20 0 1 0 557533756 13052645376 3138702 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3186681 3138702 819 493 0 3179986 0
Current children cumulated CPU time: 1242.11 s
Current children cumulated vsize: 12746724 KiB
Current children cumulated memory: 12554808 KiB

[startup+1302.3 s]
/proc/loadavg: 1.99 2.01 1.95 3/199 15056
/proc/meminfo: memFree=5012008/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=13332672 memory=13159148 CPUtime=1302.1 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3208610 0 0 0 129680 530 0 0 20 0 1 0 557533756 13652656128 3289787 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3333168 3289787 819 493 0 3326473 0
Current children cumulated CPU time: 1302.1 s
Current children cumulated vsize: 13332672 KiB
Current children cumulated memory: 13159148 KiB

[startup+1362.3 s]
/proc/loadavg: 2.03 2.02 1.96 3/199 15060
/proc/meminfo: memFree=3789204/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=13918620 memory=13765420 CPUtime=1362.11 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3355958 0 0 0 135650 561 0 0 20 0 1 0 557533756 14252666880 3441355 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3479655 3441355 819 493 0 3472960 0
Current children cumulated CPU time: 1362.11 s
Current children cumulated vsize: 13918620 KiB
Current children cumulated memory: 13765420 KiB

[startup+1422.3 s]
/proc/loadavg: 2.01 2.02 1.96 3/199 15064
/proc/meminfo: memFree=2565832/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=14504304 memory=14369640 CPUtime=1422.11 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3503260 0 0 0 141618 593 0 0 20 0 1 0 557533756 14852407296 3592410 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3626076 3592410 819 493 0 3619381 0
Current children cumulated CPU time: 1422.11 s
Current children cumulated vsize: 14504304 KiB
Current children cumulated memory: 14369640 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/203 15092
/proc/meminfo: memFree=1343956/32770624 swapFree=66960356/67108860
[pid=14938] ppid=14935 vsize=15089856 memory=14973708 CPUtime=1482.11 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3650685 0 0 0 147584 627 0 0 20 0 1 0 557533756 15452012544 3743427 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3772464 3743427 819 493 0 3765769 0
Current children cumulated CPU time: 1482.11 s
Current children cumulated vsize: 15089856 KiB
Current children cumulated memory: 14973708 KiB

[startup+1542.3 s]
/proc/loadavg: 2.29 2.08 1.98 3/203 15166
/proc/meminfo: memFree=16099004/32770624 swapFree=66959824/67108860
[pid=14938] ppid=14935 vsize=15675408 memory=15577472 CPUtime=1542.09 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3797764 0 0 0 153546 663 0 0 20 0 1 0 557533756 16051617792 3894368 33554432000 4194304 6211132 140732205332912 140732205306472 5440737 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3918852 3894368 819 493 0 3912157 0
Current children cumulated CPU time: 1542.09 s
Current children cumulated vsize: 15675408 KiB
Current children cumulated memory: 15577472 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1562.4 s]
/proc/loadavg: 2.20 2.07 1.98 3/204 15168
/proc/meminfo: memFree=15896164/32770624 swapFree=66959824/67108860
[pid=14938] ppid=14935 vsize=15872352 memory=15780660 CPUtime=1562.17 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 4202496 3847042 0 0 0 155543 674 0 0 20 0 1 0 557533756 16253288448 3945165 33554432000 4194304 6211132 140732205332912 140732205306472 140153245662181 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3968088 3945165 819 493 0 3961393 0
Current children cumulated CPU time: 1562.17 s
Current children cumulated vsize: 15872352 KiB
Current children cumulated memory: 15780660 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1565.26 s]
# the end of solver process 14938 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1555.74 s, system=7.61553 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1563.2 s]
/proc/loadavg: 2.19 2.07 1.98 3/205 15169
/proc/meminfo: memFree=15579016/32770624 swapFree=66959824/67108860
[pid=14938] ppid=14935 vsize=15872352 memory=15780660 CPUtime=1562.29 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) R 14935 14938 14426 0 -1 512 3847047 0 0 0 155555 674 0 0 20 0 1 0 557533756 16253288448 3945165 33554432000 4194304 6211132 140732205332912 140732205306472 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3968088 3945165 819 493 0 3961393 0
Current children cumulated CPU time: 1562.29 s
Current children cumulated vsize: 15872352 KiB
Current children cumulated memory: 15780660 KiB

[startup+1564 s]*
/proc/loadavg: 2.19 2.07 1.98 3/204 15169
/proc/meminfo: memFree=14983360/32770624 swapFree=66959824/67108860
[pid=14938] ppid=14935 vsize=15872352 memory=15780660 CPUtime=1562.42 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) S 14935 14938 14426 0 -1 512 3847047 0 0 0 155567 675 0 0 20 0 1 0 557533756 16253288448 3945165 33554432000 4194304 6211132 140732205332912 140732205306472 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3968088 3945165 819 493 0 3961393 0
Current children cumulated CPU time: 1562.42 s
Current children cumulated vsize: 15872352 KiB
Current children cumulated memory: 15780660 KiB

[startup+1564.4 s]
/proc/loadavg: 2.19 2.07 1.98 3/204 15169
/proc/meminfo: memFree=14983360/32770624 swapFree=66959824/67108860
[pid=14938] ppid=14935 vsize=15872352 memory=15780660 CPUtime=1562.48 cores=1,3,5,7
/proc/14938/stat : 14938 (cosoco) S 14935 14938 14426 0 -1 512 3847047 0 0 0 155573 675 0 0 20 0 1 0 557533756 16253288448 3945165 33554432000 4194304 6211132 140732205332912 140732205306472 5189800 0 16384 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 35426304 140732205335563 140732205335665 140732205335665 140732205338574 0
/proc/14938/statm: 3968088 3945165 819 493 0 3961393 0
Current children cumulated CPU time: 1562.48 s
Current children cumulated vsize: 15872352 KiB
Current children cumulated memory: 15780660 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1565.26
CPU time (s): 1563.35
CPU user time (s): 1555.74
CPU system time (s): 7.61553
CPU usage (%): 99.8781
Max. virtual memory (cumulated for all children) (KiB): 15872352
Max. memory (cumulated for all children) (KiB): 15780660

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1555.74
system time used= 7.61553
maximum resident set size= 15780832
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3847047
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 135437
involuntary context switches= 2805


# summary of solver processes directly reported to runsolver:
#   pid: 14938
#   total CPU time (s): 1563.35
#   total CPU user time (s): 1555.74
#   total CPU system time (s): 7.61553

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.64688 second user time and 10.4035 second system time

The end

Launcher Data 

Begin job on node127 at 2019-09-30 05:03:29
IDJOB=4409155
IDBENCH=139384
IDSOLVER=2876
FILE ID=node127/4409155-1569812650
RUNJOBID= node127-1569812554-14458
PBS_JOBID= 21705842
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_5_11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409155-1569812650/watcher-4409155-1569812650 -o /tmp/evaluation-result-4409155-1569812650/solver-4409155-1569812650 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node127-1569812554-14458 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409155-1569812650.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bb782f0c2876622a4bcf03fe44f48018
RANDOM SEED=684257306

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31586836 kB
MemAvailable:   31707368 kB
Buffers:          140852 kB
Cached:           307456 kB
SwapCached:        44636 kB
Active:           387880 kB
Inactive:         221256 kB
Active(anon):     113488 kB
Inactive(anon):   129308 kB
Active(file):     274392 kB
Inactive(file):    91948 kB
Unevictable:      107508 kB
Mlocked:          107508 kB
SwapTotal:      67108860 kB
SwapFree:       66960356 kB
Dirty:              3320 kB
Writeback:            28 kB
AnonPages:        237188 kB
Mapped:            27940 kB
Shmem:             73608 kB
Slab:             169264 kB
SReclaimable:     140052 kB
SUnreclaim:        29212 kB
KernelStack:        3552 kB
PageTables:         5356 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     679504 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     81920 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 61496 MiB
End job on node127 at 2019-09-30 05:29:34