Trace number 4398469

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (TO) 2520.6 2523.22

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_14_1.xml
MD5SUM25e4edec3d9f4a5618481cbfa250deb6
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark218
Best CPU time to get the best result obtained on this benchmark20087
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":11,"count":111},{"size":48,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15295 MiB free)
  memory of node 1: 16384 MiB (15603 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398469-1568613879/watcher-4398469-1568613879 -o /tmp/evaluation-result-4398469-1568613879/solver-4398469-1568613879 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node103-1568608678-25776 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398469-1568613879.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=27113, runsolver pid=27110
Current StackSize limit: 8192 KiB


[startup+0.100157 s]*
/proc/loadavg: 8.20 8.27 8.31 2/192 27114
/proc/meminfo: memFree=31605172/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=67852 memory=43724 CPUtime=0.1 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 11115 0 0 0 8 2 0 0 20 0 1 0 437640932 69480448 10931 33554432000 4194304 6211092 140734627650176 140734627646712 139766267124542 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 16963 10931 754 493 0 10268 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 67852 KiB
Current children cumulated memory: 43724 KiB

[startup+0.209167 s]*
/proc/loadavg: 8.20 8.27 8.31 2/192 27114
/proc/meminfo: memFree=31575412/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=93320 memory=69332 CPUtime=0.2 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 17531 0 0 0 18 2 0 0 20 0 1 0 437640932 95559680 17333 33554432000 4194304 6211092 140734627650176 140734627646712 139766267128805 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 23330 17333 809 493 0 16635 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 93320 KiB
Current children cumulated memory: 69332 KiB

[startup+0.308818 s]*
/proc/loadavg: 8.20 8.27 8.31 2/192 27114
/proc/meminfo: memFree=31573800/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=94628 memory=70804 CPUtime=0.3 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 17896 0 0 0 28 2 0 0 20 0 1 0 437640932 96899072 17701 33554432000 4194304 6211092 140734627650176 140734627646712 139766267128805 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 23657 17701 819 493 0 16962 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 94628 KiB
Current children cumulated memory: 70804 KiB

[startup+0.70033 s]
/proc/loadavg: 8.20 8.27 8.31 2/192 27114
/proc/meminfo: memFree=31571684/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=98604 memory=74764 CPUtime=0.68 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 18889 0 0 0 66 2 0 0 20 0 1 0 437640932 100970496 18691 33554432000 4194304 6211092 140734627650176 140734627623736 5455650 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 24684 18691 819 493 0 17989 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 98604 KiB
Current children cumulated memory: 74764 KiB

[startup+1.50033 s]
/proc/loadavg: 7.63 8.15 8.27 2/192 27114
/proc/meminfo: memFree=31566848/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=107056 memory=83064 CPUtime=1.49 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 20964 0 0 0 146 3 0 0 20 0 1 0 437640932 109625344 20766 33554432000 4194304 6211092 140734627650176 140734627623736 139766277073802 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 26764 20766 819 493 0 20069 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 107056 KiB
Current children cumulated memory: 83064 KiB

[startup+3.10945 s]
/proc/loadavg: 7.63 8.15 8.27 2/192 27114
/proc/meminfo: memFree=31546196/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=123872 memory=99560 CPUtime=3.1 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 25366 0 0 0 306 4 0 0 20 0 1 0 437640932 126844928 24890 33554432000 4194304 6211092 140734627650176 140734627623736 139766268052694 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 30968 24890 819 493 0 24273 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 123872 KiB
Current children cumulated memory: 99560 KiB

[startup+6.30032 s]
/proc/loadavg: 7.10 8.04 8.24 2/192 27114
/proc/meminfo: memFree=31515200/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=157548 memory=132744 CPUtime=6.28 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 33888 0 0 0 624 4 0 0 20 0 1 0 437640932 161329152 33186 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 39387 33186 819 493 0 32692 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 157548 KiB
Current children cumulated memory: 132744 KiB

[startup+12.7003 s]
/proc/loadavg: 6.61 7.92 8.20 2/192 27114
/proc/meminfo: memFree=31452960/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=223272 memory=199268 CPUtime=12.68 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 50730 0 0 0 1262 6 0 0 20 0 1 0 437640932 228630528 49817 33554432000 4194304 6211092 140734627650176 140734627623736 5446260 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 55818 49817 819 493 0 49123 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 223272 KiB
Current children cumulated memory: 199268 KiB

[startup+25.5003 s]
/proc/loadavg: 5.75 7.69 8.12 2/192 27117
/proc/meminfo: memFree=31318340/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=356844 memory=331944 CPUtime=25.47 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 83877 0 0 0 2536 11 0 0 20 0 1 0 437640932 365408256 82986 33554432000 4194304 6211092 140734627650176 140734627623736 5451532 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 89211 82986 819 493 0 82516 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 356844 KiB
Current children cumulated memory: 331944 KiB

[startup+51.1088 s]
/proc/loadavg: 3.88 7.05 7.89 2/192 27117
/proc/meminfo: memFree=31048016/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=626132 memory=598644 CPUtime=51.07 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 149669 0 0 0 5088 19 0 0 20 0 1 0 437640932 641159168 149661 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 156533 149661 819 493 0 149838 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 626132 KiB
Current children cumulated memory: 598644 KiB

[startup+102.3 s]
/proc/loadavg: 2.25 6.12 7.53 2/191 27120
/proc/meminfo: memFree=30517244/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=1169592 memory=1129896 CPUtime=102.23 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 279373 0 0 0 10186 37 0 0 20 0 1 0 437640932 1197662208 282474 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 292398 282474 819 493 0 285703 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 1169592 KiB
Current children cumulated memory: 1129896 KiB

[startup+162.3 s]
/proc/loadavg: 1.46 5.19 7.12 2/191 27125
/proc/meminfo: memFree=29891644/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=1799284 memory=1754788 CPUtime=162.21 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 431641 0 0 0 16165 56 0 0 20 0 1 0 437640932 1842466816 438697 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 449821 438697 819 493 0 443126 0
Current children cumulated CPU time: 162.21 s
Current children cumulated vsize: 1799284 KiB
Current children cumulated memory: 1754788 KiB

[startup+222.3 s]
/proc/loadavg: 1.17 4.43 6.74 2/191 27128
/proc/meminfo: memFree=29265360/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=2404240 memory=2380076 CPUtime=222.18 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 583029 0 0 0 22143 75 0 0 20 0 1 0 437640932 2461941760 595019 33554432000 4194304 6211092 140734627650176 140734627623736 139766268052723 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 601060 595019 819 493 0 594365 0
Current children cumulated CPU time: 222.18 s
Current children cumulated vsize: 2404240 KiB
Current children cumulated memory: 2380076 KiB

[startup+282.3 s]
/proc/loadavg: 1.06 3.80 6.38 2/191 27131
/proc/meminfo: memFree=28640944/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=3046240 memory=3003728 CPUtime=282.15 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 734982 0 0 0 28120 95 0 0 20 0 1 0 437640932 3119349760 750932 33554432000 4194304 6211092 140734627650176 140734627623736 5013005 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 761560 750932 819 493 0 754865 0
Current children cumulated CPU time: 282.15 s
Current children cumulated vsize: 3046240 KiB
Current children cumulated memory: 3003728 KiB

[startup+342.3 s]
/proc/loadavg: 1.02 3.29 6.04 2/191 27136
/proc/meminfo: memFree=28015884/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=3706692 memory=3628092 CPUtime=342.13 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 886670 0 0 0 34095 118 0 0 20 0 1 0 437640932 3795652608 907023 33554432000 4194304 6211092 140734627650176 140734627623736 5455634 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 926673 907023 819 493 0 919978 0
Current children cumulated CPU time: 342.13 s
Current children cumulated vsize: 3706692 KiB
Current children cumulated memory: 3628092 KiB

[startup+402.3 s]
/proc/loadavg: 1.01 2.87 5.73 2/191 27146
/proc/meminfo: memFree=27388600/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=4311780 memory=4252900 CPUtime=402.1 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 1038569 0 0 0 40073 137 0 0 20 0 1 0 437640932 4415262720 1063225 33554432000 4194304 6211092 140734627650176 140734627623736 5443006 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 1077945 1063225 819 493 0 1071250 0
Current children cumulated CPU time: 402.1 s
Current children cumulated vsize: 4311780 KiB
Current children cumulated memory: 4252900 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.53 5.43 2/191 27149
/proc/meminfo: memFree=26761680/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=4916736 memory=4878236 CPUtime=462.08 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 1190192 0 0 0 46051 157 0 0 20 0 1 0 437640932 5034737664 1219559 33554432000 4194304 6211092 140734627650176 140734627623736 139766277073806 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 1229184 1219559 819 493 0 1222489 0
Current children cumulated CPU time: 462.08 s
Current children cumulated vsize: 4916736 KiB
Current children cumulated memory: 4878236 KiB


################
# More data... #
################

Current children cumulated vsize: 20084688 KiB
Current children cumulated memory: 19839284 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.02 1.91 2/191 27259
/proc/meminfo: memFree=11148740/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=20687136 memory=20460248 CPUtime=1961.59 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 4981446 0 0 0 195212 947 0 0 20 0 1 0 437640932 21183627264 5115062 33554432000 4194304 6211092 140734627650176 140734627623736 5446111 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 5171784 5115062 819 493 0 5165089 0
Current children cumulated CPU time: 1961.59 s
Current children cumulated vsize: 20687136 KiB
Current children cumulated memory: 20460248 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.85 2/191 27262
/proc/meminfo: memFree=10525160/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=21289452 memory=21082948 CPUtime=2021.58 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 5132658 0 0 0 201166 992 0 0 20 0 1 0 437640932 21800398848 5270737 33554432000 4194304 6211092 140734627650176 140734627623736 5451532 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 5322363 5270737 819 493 0 5315668 0
Current children cumulated CPU time: 2021.58 s
Current children cumulated vsize: 21289452 KiB
Current children cumulated memory: 21082948 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.80 2/191 27265
/proc/meminfo: memFree=9903100/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=21891768 memory=21703712 CPUtime=2081.55 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 5284016 0 0 0 207121 1034 0 0 20 0 1 0 437640932 22417170432 5425928 33554432000 4194304 6211092 140734627650176 140734627623736 139766268052482 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 5472942 5425928 819 493 0 5466247 0
Current children cumulated CPU time: 2081.55 s
Current children cumulated vsize: 21891768 KiB
Current children cumulated memory: 21703712 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.75 2/191 27270
/proc/meminfo: memFree=9278552/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=22493952 memory=22326192 CPUtime=2141.53 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 5435186 0 0 0 213071 1082 0 0 20 0 1 0 437640932 23033806848 5581548 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 5623488 5581548 819 493 0 5616793 0
Current children cumulated CPU time: 2141.53 s
Current children cumulated vsize: 22493952 KiB
Current children cumulated memory: 22326192 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.70 2/192 27281
/proc/meminfo: memFree=8656996/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=23096136 memory=22946916 CPUtime=2201.52 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 5586496 0 0 0 219024 1128 0 0 20 0 1 0 437640932 23650443264 5736729 33554432000 4194304 6211092 140734627650176 140734627623736 5452215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 5774034 5736729 819 493 0 5767339 0
Current children cumulated CPU time: 2201.52 s
Current children cumulated vsize: 23096136 KiB
Current children cumulated memory: 22946916 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.66 2/192 27284
/proc/meminfo: memFree=8033624/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=23698056 memory=23569396 CPUtime=2261.49 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 5737605 0 0 0 224975 1174 0 0 20 0 1 0 437640932 24266809344 5892349 33554432000 4194304 6211092 140734627650176 140734627623736 139766268052486 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 5924514 5892349 819 493 0 5917819 0
Current children cumulated CPU time: 2261.49 s
Current children cumulated vsize: 23698056 KiB
Current children cumulated memory: 23569396 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.61 2/192 27290
/proc/meminfo: memFree=7411516/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=24300108 memory=24189856 CPUtime=2321.47 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 5888910 0 0 0 230924 1223 0 0 20 0 1 0 437640932 24883310592 6047464 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6075027 6047464 819 493 0 6068332 0
Current children cumulated CPU time: 2321.47 s
Current children cumulated vsize: 24300108 KiB
Current children cumulated memory: 24189856 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.58 2/192 27293
/proc/meminfo: memFree=6787820/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=24902028 memory=24812360 CPUtime=2381.45 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 6040155 0 0 0 236870 1275 0 0 20 0 1 0 437640932 25499676672 6203090 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6225507 6203090 819 493 0 6218812 0
Current children cumulated CPU time: 2381.45 s
Current children cumulated vsize: 24902028 KiB
Current children cumulated memory: 24812360 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.54 2/192 27296
/proc/meminfo: memFree=6166652/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=25503816 memory=25432292 CPUtime=2441.43 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 6191345 0 0 0 242817 1326 0 0 20 0 1 0 437640932 26115907584 6358073 33554432000 4194304 6211092 140734627650176 140734627623736 139766268049315 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6375954 6358073 819 493 0 6369259 0
Current children cumulated CPU time: 2441.43 s
Current children cumulated vsize: 25503816 KiB
Current children cumulated memory: 25432292 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.51 2/191 27301
/proc/meminfo: memFree=5543700/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=26105340 memory=26054532 CPUtime=2501.42 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 6342491 0 0 0 248764 1378 0 0 20 0 1 0 437640932 26731868160 6513633 33554432000 4194304 6211092 140734627650176 140734627623736 5455658 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6526335 6513633 819 493 0 6519640 0
Current children cumulated CPU time: 2501.42 s
Current children cumulated vsize: 26105340 KiB
Current children cumulated memory: 26054532 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.50 2/191 27301
/proc/meminfo: memFree=5358696/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=26282748 memory=26236052 CPUtime=2519.12 cores=0-7
/proc/27113/stat : 27113 (cosoco) R 27110 27113 25749 0 -1 4202496 6386977 0 0 0 250517 1395 0 0 20 0 1 0 437640932 26913533952 6559013 33554432000 4194304 6211092 140734627650176 140734627623736 139766267128805 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6570687 6559013 819 493 0 6563992 0
Current children cumulated CPU time: 2519.12 s
Current children cumulated vsize: 26282748 KiB
Current children cumulated memory: 26236052 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.22 s]
# the end of solver process 27113 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2505.42 s, system=15.1759 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.50 2/191 27301
/proc/meminfo: memFree=5358696/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=26282748 memory=26236052 CPUtime=2519.22 cores=0-7
/proc/27113/stat : 27113 (cosoco) S 27110 27113 25749 0 -1 512 6386983 0 0 0 250527 1395 0 0 20 0 1 0 437640932 26913533952 6559013 33554432000 4194304 6211092 140734627650176 140734627623736 5189550 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6570687 6559013 819 493 0 6563992 0
Current children cumulated CPU time: 2519.22 s
Current children cumulated vsize: 26282748 KiB
Current children cumulated memory: 26236052 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.50 2/192 27302
/proc/meminfo: memFree=4871236/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=26282748 memory=26236052 CPUtime=2519.33 cores=0-7
/proc/27113/stat : 27113 (cosoco) S 27110 27113 25749 0 -1 512 6386983 0 0 0 250537 1396 0 0 20 0 1 0 437640932 26913533952 6559013 33554432000 4194304 6211092 140734627650176 140734627623736 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6570687 6559013 819 493 0 6563992 0
Current children cumulated CPU time: 2519.33 s
Current children cumulated vsize: 26282748 KiB
Current children cumulated memory: 26236052 KiB

[startup+2522 s]*
/proc/loadavg: 1.08 1.03 1.50 2/192 27302
/proc/meminfo: memFree=4429444/32770624 swapFree=66997348/67108860
[pid=27113] ppid=27110 vsize=26282748 memory=26236052 CPUtime=2519.37 cores=0-7
/proc/27113/stat : 27113 (cosoco) S 27110 27113 25749 0 -1 512 6386983 0 0 0 250541 1396 0 0 20 0 1 0 437640932 26913533952 6559013 33554432000 4194304 6211092 140734627650176 140734627623736 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 25587712 140734627652625 140734627652717 140734627652717 140734627655630 0
/proc/27113/statm: 6570687 6559013 819 493 0 6563992 0
Current children cumulated CPU time: 2519.37 s
Current children cumulated vsize: 26282748 KiB
Current children cumulated memory: 26236052 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.22
CPU time (s): 2520.6
CPU user time (s): 2505.42
CPU system time (s): 15.1759
CPU usage (%): 99.8961
Max. virtual memory (cumulated for all children) (KiB): 26282748
Max. memory (cumulated for all children) (KiB): 26236052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2505.42
system time used= 15.1759
maximum resident set size= 26236084
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6386983
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 116375
involuntary context switches= 2007


# summary of solver processes directly reported to runsolver:
#   pid: 27113
#   total CPU time (s): 2520.6
#   total CPU user time (s): 2505.42
#   total CPU system time (s): 15.1759

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.17571 second user time and 16.4587 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-16 08:03:40
IDJOB=4398469
IDBENCH=139368
IDSOLVER=2851
FILE ID=node103/4398469-1568613879
RUNJOBID= node103-1568608678-25776
PBS_JOBID= 21703432
Free space on /tmp= 61716 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_14_1.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398469-1568613879/watcher-4398469-1568613879 -o /tmp/evaluation-result-4398469-1568613879/solver-4398469-1568613879 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node103-1568608678-25776 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398469-1568613879.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 25e4edec3d9f4a5618481cbfa250deb6
RANDOM SEED=2029157682

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31640872 kB
MemAvailable:   31886256 kB
Buffers:           40452 kB
Cached:           501476 kB
SwapCached:         8864 kB
Active:           338892 kB
Inactive:         214580 kB
Active(anon):       4032 kB
Inactive(anon):    57192 kB
Active(file):     334860 kB
Inactive(file):   157388 kB
Unevictable:      111164 kB
Mlocked:          111164 kB
SwapTotal:      67108860 kB
SwapFree:       66997348 kB
Dirty:              2780 kB
Writeback:             0 kB
AnonPages:        115072 kB
Mapped:            47192 kB
Shmem:             40852 kB
Slab:             166936 kB
SReclaimable:     137940 kB
SUnreclaim:        28996 kB
KernelStack:        3360 kB
PageTables:         5248 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     505660 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 61268 MiB
End job on node103 at 2019-09-16 08:45:43