Trace number 4409747

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallel? (TO) 2520.49 2523.24

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_20_8.xml
MD5SUM6b176121d3671d41526f7ff611fbc0d5
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark202
Best CPU time to get the best result obtained on this benchmark20086.7
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":11,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15393 MiB free)
  memory of node 1: 16384 MiB (15661 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409747-1569838521/watcher-4409747-1569838521 -o /tmp/evaluation-result-4409747-1569838521/solver-4409747-1569838521 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node139-1569831066-18324 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409747-1569838521.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=19182, runsolver pid=19179
Current StackSize limit: 8192 KiB


[startup+0.100154 s]*
/proc/loadavg: 8.63 8.38 8.36 2/189 19183
/proc/meminfo: memFree=31765320/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=67088 memory=42968 CPUtime=0.09 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 10958 0 0 0 8 1 0 0 20 0 1 0 560124440 68698112 10742 33554432000 4194304 6211132 140735058215136 140735058211672 140171551890405 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 16805 10742 754 493 0 10110 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 67088 KiB
Current children cumulated memory: 42968 KiB

[startup+0.208906 s]*
/proc/loadavg: 8.63 8.38 8.36 2/189 19183
/proc/meminfo: memFree=31735064/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=93216 memory=69368 CPUtime=0.2 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 17530 0 0 0 18 2 0 0 20 0 1 0 560124440 95453184 17342 33554432000 4194304 6211132 140735058215136 140735058211672 140171551890405 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 23304 17342 809 493 0 16609 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 93216 KiB
Current children cumulated memory: 69368 KiB

[startup+0.308462 s]*
/proc/loadavg: 8.63 8.38 8.36 2/189 19183
/proc/meminfo: memFree=31733628/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=94664 memory=70716 CPUtime=0.3 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 17900 0 0 0 28 2 0 0 20 0 1 0 560124440 96935936 17679 33554432000 4194304 6211132 140735058215136 140735058188696 5451514 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 23666 17679 819 493 0 16971 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 94664 KiB
Current children cumulated memory: 70716 KiB

[startup+0.700325 s]
/proc/loadavg: 8.63 8.38 8.36 2/189 19183
/proc/meminfo: memFree=31731552/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=98632 memory=74940 CPUtime=0.69 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 18898 0 0 0 67 2 0 0 20 0 1 0 560124440 100999168 18735 33554432000 4194304 6211132 140735058215136 140735058188696 5013001 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 24658 18735 819 493 0 17963 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 98632 KiB
Current children cumulated memory: 74940 KiB

[startup+1.50033 s]
/proc/loadavg: 8.02 8.26 8.32 2/189 19183
/proc/meminfo: memFree=31727200/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=107084 memory=83100 CPUtime=1.48 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 20976 0 0 0 146 2 0 0 20 0 1 0 560124440 109654016 20775 33554432000 4194304 6211132 140735058215136 140735058188696 5443038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 26771 20775 819 493 0 20076 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 107084 KiB
Current children cumulated memory: 83100 KiB

[startup+3.10902 s]
/proc/loadavg: 8.02 8.26 8.32 2/189 19183
/proc/meminfo: memFree=31706856/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=124032 memory=99884 CPUtime=3.09 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 25393 0 0 0 306 3 0 0 20 0 1 0 560124440 127008768 24971 33554432000 4194304 6211132 140735058215136 140735058188696 140171551890405 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 31008 24971 819 493 0 24313 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 124032 KiB
Current children cumulated memory: 99884 KiB

[startup+6.30032 s]
/proc/loadavg: 7.46 8.14 8.28 2/189 19183
/proc/meminfo: memFree=31675260/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=157840 memory=133072 CPUtime=6.28 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 33857 0 0 0 624 4 0 0 20 0 1 0 560124440 161628160 33268 33554432000 4194304 6211132 140735058215136 140735058188696 5440748 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 39460 33268 819 493 0 32765 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 157840 KiB
Current children cumulated memory: 133072 KiB

[startup+12.7004 s]
/proc/loadavg: 6.94 8.02 8.24 2/189 19183
/proc/meminfo: memFree=31612864/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=224092 memory=199856 CPUtime=12.68 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 50693 0 0 0 1261 7 0 0 20 0 1 0 560124440 229470208 49964 33554432000 4194304 6211132 140735058215136 140735058188696 5012992 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 56023 49964 819 493 0 49328 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 224092 KiB
Current children cumulated memory: 199856 KiB

[startup+25.5003 s]
/proc/loadavg: 6.03 7.79 8.16 2/189 19183
/proc/meminfo: memFree=31475660/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=358852 memory=334304 CPUtime=25.47 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 84015 0 0 0 2536 11 0 0 20 0 1 0 560124440 367464448 83576 33554432000 4194304 6211132 140735058215136 140735058188696 5013034 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 89713 83576 819 493 0 83018 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 358852 KiB
Current children cumulated memory: 334304 KiB

[startup+51.1084 s]
/proc/loadavg: 4.05 7.14 7.93 2/189 19186
/proc/meminfo: memFree=31203348/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=630384 memory=603360 CPUtime=51.07 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 150260 0 0 0 5086 21 0 0 20 0 1 0 560124440 645513216 150840 33554432000 4194304 6211132 140735058215136 140735058188696 140171552814082 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 157596 150840 819 493 0 150901 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 630384 KiB
Current children cumulated memory: 603360 KiB

[startup+102.3 s]
/proc/loadavg: 2.32 6.19 7.57 2/189 19188
/proc/meminfo: memFree=30668056/32770624 swapFree=66906104/67108860
[pid=19182] ppid=19179 vsize=1177672 memory=1139652 CPUtime=102.22 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 281284 0 0 0 10176 46 0 0 20 0 1 0 560124440 1205936128 284913 33554432000 4194304 6211132 140735058215136 140735058188696 140171552814082 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 294418 284913 819 493 0 287723 0
Current children cumulated CPU time: 102.22 s
Current children cumulated vsize: 1177672 KiB
Current children cumulated memory: 1139652 KiB

[startup+162.3 s]
/proc/loadavg: 1.49 5.25 7.16 2/190 19199
/proc/meminfo: memFree=30037652/32770624 swapFree=66906112/67108860
[pid=19182] ppid=19179 vsize=1811588 memory=1767356 CPUtime=162.2 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 434155 0 0 0 16142 78 0 0 20 0 1 0 560124440 1855066112 441839 33554432000 4194304 6211132 140735058215136 140735058188696 5451568 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 452897 441839 819 493 0 446202 0
Current children cumulated CPU time: 162.2 s
Current children cumulated vsize: 1811588 KiB
Current children cumulated memory: 1767356 KiB

[startup+222.3 s]
/proc/loadavg: 1.18 4.47 6.77 2/191 19204
/proc/meminfo: memFree=29409300/32770624 swapFree=66906112/67108860
[pid=19182] ppid=19179 vsize=2420900 memory=2396052 CPUtime=222.16 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 586720 0 0 0 22109 107 0 0 20 0 1 0 560124440 2479001600 599013 33554432000 4194304 6211132 140735058215136 140735058188696 5443128 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 605225 599013 819 493 0 598530 0
Current children cumulated CPU time: 222.16 s
Current children cumulated vsize: 2420900 KiB
Current children cumulated memory: 2396052 KiB

[startup+282.3 s]
/proc/loadavg: 1.06 3.84 6.41 2/190 19207
/proc/meminfo: memFree=28779496/32770624 swapFree=66906112/67108860
[pid=19182] ppid=19179 vsize=3067124 memory=3024976 CPUtime=282.13 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 739407 0 0 0 28077 136 0 0 20 0 1 0 560124440 3140734976 756244 33554432000 4194304 6211132 140735058215136 140735058188696 5446662 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 766781 756244 819 493 0 760086 0
Current children cumulated CPU time: 282.13 s
Current children cumulated vsize: 3067124 KiB
Current children cumulated memory: 3024976 KiB

[startup+342.3 s]
/proc/loadavg: 1.02 3.32 6.07 2/190 19210
/proc/meminfo: memFree=28148548/32770624 swapFree=66906112/67108860
[pid=19182] ppid=19179 vsize=3731800 memory=3654920 CPUtime=342.09 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 892304 0 0 0 34037 172 0 0 20 0 1 0 560124440 3821363200 913730 33554432000 4194304 6211132 140735058215136 140735058188696 140171552810912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 932950 913730 819 493 0 926255 0
Current children cumulated CPU time: 342.09 s
Current children cumulated vsize: 3731800 KiB
Current children cumulated memory: 3654920 KiB

[startup+402.3 s]
/proc/loadavg: 1.01 2.90 5.76 2/191 19215
/proc/meminfo: memFree=27517204/32770624 swapFree=66906112/67108860
[pid=19182] ppid=19179 vsize=4340980 memory=4284536 CPUtime=402.06 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 1044638 0 0 0 40001 205 0 0 20 0 1 0 560124440 4445163520 1071134 33554432000 4194304 6211132 140735058215136 140735058188696 5453944 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 1085245 1071134 819 493 0 1078550 0
Current children cumulated CPU time: 402.06 s
Current children cumulated vsize: 4340980 KiB
Current children cumulated memory: 4284536 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.56 5.46 2/189 19219
/proc/meminfo: memFree=26888596/32770624 swapFree=66906112/67108860
[pid=19182] ppid=19179 vsize=4950160 memory=4912040 CPUtime=462.02 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 1196986 0 0 0 45964 238 0 0 20 0 1 0 560124440 5068963840 1228010 33554432000 4194304 6211132 140735058215136 140735058188696 4982624 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 1237540 1228010 819 493 0 1230845 0
Current children cumulated CPU time: 462.02 s
Current children cumulated vsize: 4950160 KiB
Current children cumulated memory: 4912040 KiB


################
# More data... #
################

Current children cumulated vsize: 20218564 KiB
Current children cumulated memory: 19977560 KiB

[startup+1962.3 s]
/proc/loadavg: 1.45 1.14 1.93 2/190 19334
/proc/meminfo: memFree=11166304/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=20825104 memory=20602548 CPUtime=1961.45 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5001505 0 0 0 194892 1253 0 0 20 0 1 0 560124440 21324906496 5150637 33554432000 4194304 6211132 140735058215136 140735058188696 140171552814090 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 5206276 5150637 819 493 0 5199581 0
Current children cumulated CPU time: 1961.45 s
Current children cumulated vsize: 20825104 KiB
Current children cumulated memory: 20602548 KiB

[startup+2022.3 s]
/proc/loadavg: 1.16 1.11 1.87 2/191 19339
/proc/meminfo: memFree=10538628/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=21431512 memory=21229524 CPUtime=2021.44 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5153223 0 0 0 200844 1300 0 0 20 0 1 0 560124440 21945868288 5307381 33554432000 4194304 6211132 140735058215136 140735058188696 140171561835348 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 5357878 5307381 819 493 0 5351183 0
Current children cumulated CPU time: 2021.44 s
Current children cumulated vsize: 21431512 KiB
Current children cumulated memory: 21229524 KiB

[startup+2082.3 s]
/proc/loadavg: 1.06 1.09 1.82 2/190 19342
/proc/meminfo: memFree=9911928/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=22038052 memory=21854516 CPUtime=2081.42 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5304940 0 0 0 206791 1351 0 0 20 0 1 0 560124440 22566965248 5463629 33554432000 4194304 6211132 140735058215136 140735058188696 140171552814294 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 5509513 5463629 819 493 0 5502818 0
Current children cumulated CPU time: 2081.42 s
Current children cumulated vsize: 22038052 KiB
Current children cumulated memory: 21854516 KiB

[startup+2142.3 s]
/proc/loadavg: 1.02 1.07 1.76 2/190 19345
/proc/meminfo: memFree=9284024/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=22644196 memory=22481024 CPUtime=2141.4 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5456567 0 0 0 212738 1402 0 0 20 0 1 0 560124440 23187656704 5620256 33554432000 4194304 6211132 140735058215136 140735058188696 140171551890405 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 5661049 5620256 819 493 0 5654354 0
Current children cumulated CPU time: 2141.4 s
Current children cumulated vsize: 22644196 KiB
Current children cumulated memory: 22481024 KiB

[startup+2202.3 s]
/proc/loadavg: 1.01 1.06 1.72 2/191 19350
/proc/meminfo: memFree=8658944/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=23250340 memory=23107728 CPUtime=2201.38 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5608218 0 0 0 218681 1457 0 0 20 0 1 0 560124440 23808348160 5776932 33554432000 4194304 6211132 140735058215136 140735058188696 5443135 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 5812585 5776932 819 493 0 5805890 0
Current children cumulated CPU time: 2201.38 s
Current children cumulated vsize: 23250340 KiB
Current children cumulated memory: 23107728 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.05 1.67 2/189 19354
/proc/meminfo: memFree=8029764/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=23856352 memory=23732192 CPUtime=2261.36 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5759821 0 0 0 224627 1509 0 0 20 0 1 0 560124440 24428904448 5933048 33554432000 4194304 6211132 140735058215136 140735058188696 5452193 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 5964088 5933048 819 493 0 5957393 0
Current children cumulated CPU time: 2261.36 s
Current children cumulated vsize: 23856352 KiB
Current children cumulated memory: 23732192 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.04 1.63 2/189 19357
/proc/meminfo: memFree=7401896/32770624 swapFree=66906132/67108860
[pid=19182] ppid=19179 vsize=24462232 memory=24358652 CPUtime=2321.34 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 5911405 0 0 0 230570 1564 0 0 20 0 1 0 560124440 25049325568 6089663 33554432000 4194304 6211132 140735058215136 140735058188696 140171552816531 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6115558 6089663 819 493 0 6108863 0
Current children cumulated CPU time: 2321.34 s
Current children cumulated vsize: 24462232 KiB
Current children cumulated memory: 24358652 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.04 1.59 2/194 19383
/proc/meminfo: memFree=6773404/32770624 swapFree=66906184/67108860
[pid=19182] ppid=19179 vsize=25068112 memory=24982832 CPUtime=2381.32 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 6062966 0 0 0 236514 1618 0 0 20 0 1 0 560124440 25669746688 6245708 33554432000 4194304 6211132 140735058215136 140735058188696 5013015 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6267028 6245708 819 493 0 6260333 0
Current children cumulated CPU time: 2381.32 s
Current children cumulated vsize: 25068112 KiB
Current children cumulated memory: 24982832 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.03 1.55 2/189 19388
/proc/meminfo: memFree=6146448/32770624 swapFree=66906188/67108860
[pid=19182] ppid=19179 vsize=25673860 memory=25609008 CPUtime=2441.3 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 6214500 0 0 0 242454 1676 0 0 20 0 1 0 560124440 26290032640 6402252 33554432000 4194304 6211132 140735058215136 140735058188696 5446680 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6418465 6402252 819 493 0 6411770 0
Current children cumulated CPU time: 2441.3 s
Current children cumulated vsize: 25673860 KiB
Current children cumulated memory: 25609008 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.02 1.52 2/189 19391
/proc/meminfo: memFree=5521100/32770624 swapFree=66906188/67108860
[pid=19182] ppid=19179 vsize=26279344 memory=26232944 CPUtime=2501.29 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 6365963 0 0 0 248392 1737 0 0 20 0 1 0 560124440 26910048256 6558236 33554432000 4194304 6211132 140735058215136 140735058188696 5446189 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6569836 6558236 819 493 0 6563141 0
Current children cumulated CPU time: 2501.29 s
Current children cumulated vsize: 26279344 KiB
Current children cumulated memory: 26232944 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.02 1.51 2/189 19394
/proc/meminfo: memFree=5332728/32770624 swapFree=66906188/67108860
[pid=19182] ppid=19179 vsize=26458336 memory=26417932 CPUtime=2518.99 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 4202496 6410748 0 0 0 250148 1751 0 0 20 0 1 0 560124440 27093336064 6604483 33554432000 4194304 6211132 140735058215136 140735058188696 140171551890405 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6614584 6604483 819 493 0 6607889 0
Current children cumulated CPU time: 2518.99 s
Current children cumulated vsize: 26458336 KiB
Current children cumulated memory: 26417932 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.24 s]
# the end of solver process 19182 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2501.73 s, system=18.758 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.02 1.51 2/189 19394
/proc/meminfo: memFree=5332728/32770624 swapFree=66906188/67108860
[pid=19182] ppid=19179 vsize=26458336 memory=26417932 CPUtime=2519.1 cores=0-7
/proc/19182/stat : 19182 (cosoco) S 19179 19182 18297 0 -1 512 6410754 0 0 0 250159 1751 0 0 20 0 1 0 560124440 27093336064 6604483 33554432000 4194304 6211132 140735058215136 140735058188696 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6614584 6604483 819 493 0 6607889 0
Current children cumulated CPU time: 2519.1 s
Current children cumulated vsize: 26458336 KiB
Current children cumulated memory: 26417932 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.02 1.51 2/190 19395
/proc/meminfo: memFree=4832168/32770624 swapFree=66906188/67108860
[pid=19182] ppid=19179 vsize=26458336 memory=26417932 CPUtime=2519.19 cores=0-7
/proc/19182/stat : 19182 (cosoco) S 19179 19182 18297 0 -1 512 6410754 0 0 0 250168 1751 0 0 20 0 1 0 560124440 27093336064 6604483 33554432000 4194304 6211132 140735058215136 140735058188696 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6614584 6604483 819 493 0 6607889 0
Current children cumulated CPU time: 2519.19 s
Current children cumulated vsize: 26458336 KiB
Current children cumulated memory: 26417932 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.02 1.51 2/190 19395
/proc/meminfo: memFree=4419596/32770624 swapFree=66906188/67108860
[pid=19182] ppid=19179 vsize=26458336 memory=26417932 CPUtime=2519.25 cores=0-7
/proc/19182/stat : 19182 (cosoco) R 19179 19182 18297 0 -1 512 6410754 0 0 0 250173 1752 0 0 20 0 1 0 560124440 27093336064 6604483 33554432000 4194304 6211132 140735058215136 140735058188696 5189582 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 20926464 140735058220049 140735058220141 140735058220141 140735058223054 0
/proc/19182/statm: 6614584 6604483 819 493 0 6607889 0
Current children cumulated CPU time: 2519.25 s
Current children cumulated vsize: 26458336 KiB
Current children cumulated memory: 26417932 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.24
CPU time (s): 2520.49
CPU user time (s): 2501.73
CPU system time (s): 18.758
CPU usage (%): 99.8909
Max. virtual memory (cumulated for all children) (KiB): 26458336
Max. memory (cumulated for all children) (KiB): 26417932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2501.73
system time used= 18.758
maximum resident set size= 26418164
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6410754
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 114352
involuntary context switches= 1584


# summary of solver processes directly reported to runsolver:
#   pid: 19182
#   total CPU time (s): 2520.49
#   total CPU user time (s): 2501.73
#   total CPU system time (s): 18.758

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.82202 second user time and 15.1735 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-30 12:17:50
IDJOB=4409747
IDBENCH=139577
IDSOLVER=2877
FILE ID=node139/4409747-1569838521
RUNJOBID= node139-1569831066-18324
PBS_JOBID= 21705949
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_20_8.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409747-1569838521/watcher-4409747-1569838521 -o /tmp/evaluation-result-4409747-1569838521/solver-4409747-1569838521 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node139-1569831066-18324 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409747-1569838521.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6b176121d3671d41526f7ff611fbc0d5
RANDOM SEED=1086959657

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31800636 kB
MemAvailable:   31843872 kB
Buffers:           74660 kB
Cached:           274956 kB
SwapCached:        74552 kB
Active:           106324 kB
Inactive:         321704 kB
Active(anon):      15096 kB
Inactive(anon):   106208 kB
Active(file):      91228 kB
Inactive(file):   215496 kB
Unevictable:      109076 kB
Mlocked:          109076 kB
SwapTotal:      67108860 kB
SwapFree:       66906104 kB
Dirty:              2768 kB
Writeback:             0 kB
AnonPages:        114028 kB
Mapped:            26080 kB
Shmem:             34012 kB
Slab:             133832 kB
SReclaimable:     104696 kB
SUnreclaim:        29136 kB
KernelStack:        3344 kB
PageTables:         5760 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     531180 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 61588 MiB
End job on node139 at 2019-09-30 12:59:53