Trace number 4398496

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (TO) 2520.75 2523.22

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_12_14.xml
MD5SUMb79ed9a63f5f06b259b31d8f3686f277
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark228
Best CPU time to get the best result obtained on this benchmark2520.17
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":14,"count":111},{"size":49,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15532 MiB free)
  memory of node 1: 16384 MiB (15717 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398496-1568614292/watcher-4398496-1568614292 -o /tmp/evaluation-result-4398496-1568614292/solver-4398496-1568614292 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node143-1568609536-722 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398496-1568614292.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1449, runsolver pid=1446

[startup+0.100158 s]*
/proc/loadavg: 4.36 4.71 6.28 2/193 1450
/proc/meminfo: memFree=31985292/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=40476 memory=16660 CPUtime=0.05 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 4328 0 1 0 5 0 0 0 20 0 1 0 437366554 41447424 4165 33554432000 4194304 6211092 140724890794752 140724890791240 140373782178789 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 10152 4165 754 493 0 3457 0
Current children cumulated CPU time: 0.05 s
Current children cumulated vsize: 40476 KiB
Current children cumulated memory: 16660 KiB

[startup+0.209567 s]*
/proc/loadavg: 4.36 4.71 6.28 2/193 1450
/proc/meminfo: memFree=31929864/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=92256 memory=68404 CPUtime=0.16 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 17265 0 1 0 15 1 0 0 20 0 1 0 437366554 94470144 17101 33554432000 4194304 6211092 140724890794752 140724890791240 5443096 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 23064 17101 808 493 0 16369 0
Current children cumulated CPU time: 0.16 s
Current children cumulated vsize: 92256 KiB
Current children cumulated memory: 68404 KiB

[startup+0.309451 s]*
/proc/loadavg: 4.36 4.71 6.28 2/193 1450
/proc/meminfo: memFree=31928004/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=94100 memory=70276 CPUtime=0.25 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 17764 0 1 0 24 1 0 0 20 0 1 0 437366554 96358400 17569 33554432000 4194304 6211092 140724890794752 140724890791240 140373782178789 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 23525 17569 819 493 0 16830 0
Current children cumulated CPU time: 0.25 s
Current children cumulated vsize: 94100 KiB
Current children cumulated memory: 70276 KiB

[startup+0.700274 s]
/proc/loadavg: 4.36 4.71 6.28 2/193 1450
/proc/meminfo: memFree=31925772/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=98208 memory=74236 CPUtime=0.64 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 18762 0 1 0 63 1 0 0 20 0 1 0 437366554 100564992 18559 33554432000 4194304 6211092 140724890794752 140724890791240 5012952 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 24552 18559 819 493 0 17857 0
Current children cumulated CPU time: 0.64 s
Current children cumulated vsize: 98208 KiB
Current children cumulated memory: 74236 KiB

[startup+1.50029 s]
/proc/loadavg: 4.36 4.71 6.28 2/193 1450
/proc/meminfo: memFree=31920564/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=106660 memory=82548 CPUtime=1.44 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 20834 0 1 0 142 2 0 0 20 0 1 0 437366554 109219840 20637 33554432000 4194304 6211092 140724890794752 140724890768312 5455650 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 26665 20637 819 493 0 19970 0
Current children cumulated CPU time: 1.44 s
Current children cumulated vsize: 106660 KiB
Current children cumulated memory: 82548 KiB

[startup+3.10927 s]
/proc/loadavg: 4.36 4.71 6.28 2/193 1450
/proc/meminfo: memFree=31899820/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=123608 memory=99308 CPUtime=3.04 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 25176 0 1 0 302 2 0 0 20 0 1 0 437366554 126574592 24827 33554432000 4194304 6211092 140724890794752 140724890768312 5455653 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 30902 24827 819 493 0 24207 0
Current children cumulated CPU time: 3.04 s
Current children cumulated vsize: 123608 KiB
Current children cumulated memory: 99308 KiB

[startup+6.30027 s]
/proc/loadavg: 4.09 4.65 6.25 2/193 1451
/proc/meminfo: memFree=31868380/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=157548 memory=132756 CPUtime=6.24 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 33649 0 1 0 620 4 0 0 20 0 1 0 437366554 161329152 33189 33554432000 4194304 6211092 140724890794752 140724890768312 5479670 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 39387 33189 819 493 0 32692 0
Current children cumulated CPU time: 6.24 s
Current children cumulated vsize: 157548 KiB
Current children cumulated memory: 132756 KiB

[startup+12.7003 s]
/proc/loadavg: 3.85 4.58 6.22 2/194 1453
/proc/meminfo: memFree=31806032/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=223668 memory=199544 CPUtime=12.63 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 50495 0 1 0 1257 6 0 0 20 0 1 0 437366554 229036032 49886 33554432000 4194304 6211092 140724890794752 140724890768312 5013034 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 55917 49886 819 493 0 49222 0
Current children cumulated CPU time: 12.63 s
Current children cumulated vsize: 223668 KiB
Current children cumulated memory: 199544 KiB

[startup+25.5003 s]
/proc/loadavg: 3.22 4.41 6.14 2/193 1453
/proc/meminfo: memFree=31670424/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=358560 memory=334244 CPUtime=25.43 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 83891 0 1 0 2530 13 0 0 20 0 1 0 437366554 367165440 83495 33554432000 4194304 6211092 140724890794752 140724890768312 140373792123732 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 89640 83495 819 493 0 82945 0
Current children cumulated CPU time: 25.43 s
Current children cumulated vsize: 358560 KiB
Current children cumulated memory: 334244 KiB

[startup+51.1092 s]
/proc/loadavg: 2.46 4.14 6.00 2/193 1453
/proc/meminfo: memFree=31399616/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=630224 memory=601276 CPUtime=51.03 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 150148 0 1 0 5082 21 0 0 20 0 1 0 437366554 645349376 150319 33554432000 4194304 6211092 140724890794752 140724890768312 140373782178789 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 157556 150319 819 493 0 150861 0
Current children cumulated CPU time: 51.03 s
Current children cumulated vsize: 630224 KiB
Current children cumulated memory: 601276 KiB

[startup+102.3 s]
/proc/loadavg: 1.63 3.65 5.74 2/194 1458
/proc/meminfo: memFree=30863200/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=1177116 memory=1139344 CPUtime=102.21 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 281080 0 1 0 10182 39 0 0 20 0 1 0 437366554 1205366784 284836 33554432000 4194304 6211092 140724890794752 140724890768312 5455650 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 294279 284836 819 493 0 287584 0
Current children cumulated CPU time: 102.21 s
Current children cumulated vsize: 1177116 KiB
Current children cumulated memory: 1139344 KiB

[startup+162.3 s]
/proc/loadavg: 1.23 3.17 5.44 2/193 1461
/proc/meminfo: memFree=30234448/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=1810900 memory=1766788 CPUtime=162.19 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 433902 0 1 0 16159 60 0 0 20 0 1 0 437366554 1854361600 441697 33554432000 4194304 6211092 140724890794752 140724890768312 5443096 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 452725 441697 819 493 0 446030 0
Current children cumulated CPU time: 162.19 s
Current children cumulated vsize: 1810900 KiB
Current children cumulated memory: 1766788 KiB

[startup+222.3 s]
/proc/loadavg: 1.09 2.77 5.16 2/193 1464
/proc/meminfo: memFree=29604944/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=2420080 memory=2395224 CPUtime=222.17 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 586391 0 1 0 22137 80 0 0 20 0 1 0 437366554 2478161920 598806 33554432000 4194304 6211092 140724890794752 140724890768312 5479594 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 605020 598806 819 493 0 598325 0
Current children cumulated CPU time: 222.17 s
Current children cumulated vsize: 2420080 KiB
Current children cumulated memory: 2395224 KiB

[startup+282.3 s]
/proc/loadavg: 1.03 2.45 4.90 2/194 1469
/proc/meminfo: memFree=28973460/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=3066172 memory=3024148 CPUtime=282.16 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 739105 0 1 0 28115 101 0 0 20 0 1 0 437366554 3139760128 756037 33554432000 4194304 6211092 140724890794752 140724890768312 140373783104955 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 766543 756037 819 493 0 759848 0
Current children cumulated CPU time: 282.16 s
Current children cumulated vsize: 3066172 KiB
Current children cumulated memory: 3024148 KiB

[startup+342.3 s]
/proc/loadavg: 1.01 2.19 4.66 2/191 1472
/proc/meminfo: memFree=28343280/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=3730584 memory=3653836 CPUtime=342.15 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 891937 0 1 0 34092 123 0 0 20 0 1 0 437366554 3820118016 913459 33554432000 4194304 6211092 140724890794752 140724890768312 5443003 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 932646 913459 819 493 0 925951 0
Current children cumulated CPU time: 342.15 s
Current children cumulated vsize: 3730584 KiB
Current children cumulated memory: 3653836 KiB

[startup+402.3 s]
/proc/loadavg: 1.00 1.97 4.43 2/191 1475
/proc/meminfo: memFree=27715316/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=4339632 memory=4283460 CPUtime=402.13 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 1044241 0 1 0 40069 144 0 0 20 0 1 0 437366554 4443783168 1070865 33554432000 4194304 6211092 140724890794752 140724890768312 5451521 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 1084908 1070865 819 493 0 1078213 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 4339632 KiB
Current children cumulated memory: 4283460 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 1.80 4.22 2/192 1480
/proc/meminfo: memFree=27084512/32770624 swapFree=67015320/67108860
[pid=1449] ppid=1446 vsize=4948680 memory=4910732 CPUtime=462.11 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 1196543 0 1 0 46045 166 0 0 20 0 1 0 437366554 5067448320 1227683 33554432000 4194304 6211092 140724890794752 140724890768312 140373782178789 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 1237170 1227683 819 493 0 1230475 0
Current children cumulated CPU time: 462.11 s
Current children cumulated vsize: 4948680 KiB
Current children cumulated memory: 4910732 KiB


################
# More data... #
################

Current children cumulated vsize: 20209956 KiB
Current children cumulated memory: 19969268 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.64 2/192 1596
/proc/meminfo: memFree=11370364/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=20816232 memory=20593980 CPUtime=1961.7 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 4999119 0 1 0 195190 980 0 0 20 0 1 0 437366554 21315821568 5148495 33554432000 4194304 6211092 140724890794752 140724890768312 5446648 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 5204058 5148495 819 493 0 5197363 0
Current children cumulated CPU time: 1961.7 s
Current children cumulated vsize: 20816232 KiB
Current children cumulated memory: 20593980 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.60 2/192 1599
/proc/meminfo: memFree=10742436/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=21422508 memory=21220480 CPUtime=2021.68 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 5150777 0 1 0 201147 1021 0 0 20 0 1 0 437366554 21936648192 5305120 33554432000 4194304 6211092 140724890794752 140724890768312 5451566 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 5355627 5305120 819 493 0 5348932 0
Current children cumulated CPU time: 2021.68 s
Current children cumulated vsize: 21422508 KiB
Current children cumulated memory: 21220480 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.56 2/192 1604
/proc/meminfo: memFree=10116316/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=22028520 memory=21844964 CPUtime=2081.67 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 5302375 0 1 0 207102 1065 0 0 20 0 1 0 437366554 22557204480 5461241 33554432000 4194304 6211092 140724890794752 140724890768312 140373783102674 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 5507130 5461241 819 493 0 5500435 0
Current children cumulated CPU time: 2081.67 s
Current children cumulated vsize: 22028520 KiB
Current children cumulated memory: 21844964 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.53 2/191 1607
/proc/meminfo: memFree=9488736/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=22634400 memory=22471448 CPUtime=2141.65 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 5453956 0 1 0 213056 1109 0 0 20 0 1 0 437366554 23177625600 5617862 33554432000 4194304 6211092 140724890794752 140724890768312 140373782178789 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 5658600 5617862 819 493 0 5651905 0
Current children cumulated CPU time: 2141.65 s
Current children cumulated vsize: 22634400 KiB
Current children cumulated memory: 22471448 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.50 2/191 1610
/proc/meminfo: memFree=8863228/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=23240412 memory=23095912 CPUtime=2201.64 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 5605541 0 1 0 219008 1156 0 0 20 0 1 0 437366554 23798181888 5773978 33554432000 4194304 6211092 140724890794752 140724890768312 140373783099316 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 5810103 5773978 819 493 0 5803408 0
Current children cumulated CPU time: 2201.64 s
Current children cumulated vsize: 23240412 KiB
Current children cumulated memory: 23095912 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.47 2/192 1615
/proc/meminfo: memFree=8235772/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=23846160 memory=23722112 CPUtime=2261.61 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 5757092 0 1 0 224956 1205 0 0 20 0 1 0 437366554 24418467840 5930528 33554432000 4194304 6211092 140724890794752 140724890768312 140373782178789 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 5961540 5930528 819 493 0 5954845 0
Current children cumulated CPU time: 2261.61 s
Current children cumulated vsize: 23846160 KiB
Current children cumulated memory: 23722112 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.44 2/191 1618
/proc/meminfo: memFree=7610072/32770624 swapFree=67015328/67108860
[pid=1449] ppid=1446 vsize=24452040 memory=24346332 CPUtime=2321.6 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 5908643 0 1 0 230906 1254 0 0 20 0 1 0 437366554 25038888960 6086583 33554432000 4194304 6211092 140724890794752 140724890768312 5013001 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6113010 6086583 819 493 0 6106315 0
Current children cumulated CPU time: 2321.6 s
Current children cumulated vsize: 24452040 KiB
Current children cumulated memory: 24346332 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.41 2/191 1628
/proc/meminfo: memFree=6982904/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=25057656 memory=24972532 CPUtime=2381.58 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 6060160 0 1 0 236854 1304 0 0 20 0 1 0 437366554 25659039744 6243133 33554432000 4194304 6211092 140724890794752 140724890768312 140373782183253 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6264414 6243133 819 493 0 6257719 0
Current children cumulated CPU time: 2381.58 s
Current children cumulated vsize: 25057656 KiB
Current children cumulated memory: 24972532 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.38 2/192 1633
/proc/meminfo: memFree=6357504/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=25663140 memory=25596424 CPUtime=2441.56 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 6211619 0 1 0 242804 1352 0 0 20 0 1 0 437366554 26279055360 6399106 33554432000 4194304 6211092 140724890794752 140724890768312 140373792123712 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6415785 6399106 819 493 0 6409090 0
Current children cumulated CPU time: 2441.56 s
Current children cumulated vsize: 25663140 KiB
Current children cumulated memory: 25596424 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.36 2/191 1636
/proc/meminfo: memFree=5730716/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=26268360 memory=26222152 CPUtime=2501.55 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 6363029 0 1 0 248749 1406 0 0 20 0 1 0 437366554 26898800640 6555538 33554432000 4194304 6211092 140724890794752 140724890768312 140373783104960 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6567090 6555538 819 493 0 6560395 0
Current children cumulated CPU time: 2501.55 s
Current children cumulated vsize: 26268360 KiB
Current children cumulated memory: 26222152 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.35 2/191 1636
/proc/meminfo: memFree=5542384/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=26447088 memory=26406892 CPUtime=2519.24 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 4202496 6407740 0 1 0 250503 1421 0 0 20 0 1 0 437366554 27081818112 6601723 33554432000 4194304 6211092 140724890794752 140724890768312 140373783104955 0 0 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6611772 6601723 819 493 0 6605077 0
Current children cumulated CPU time: 2519.24 s
Current children cumulated vsize: 26447088 KiB
Current children cumulated memory: 26406892 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.22 s]
# the end of solver process 1449 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2505.29 s, system=15.4584 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.35 2/191 1636
/proc/meminfo: memFree=5542384/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=26447088 memory=26406892 CPUtime=2519.32 cores=0-7
/proc/1449/stat : 1449 (cosoco) S 1446 1449 695 0 -1 512 6407750 0 1 0 250511 1421 0 0 20 0 1 0 437366554 27081818112 6601723 33554432000 4194304 6211092 140724890794752 140724890768312 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6611772 6601723 819 493 0 6605077 0
Current children cumulated CPU time: 2519.32 s
Current children cumulated vsize: 26447088 KiB
Current children cumulated memory: 26406892 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.35 2/192 1637
/proc/meminfo: memFree=5188472/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=26447088 memory=26406892 CPUtime=2519.46 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 512 6407750 0 1 0 250523 1423 0 0 20 0 1 0 437366554 27081818112 6601723 33554432000 4194304 6211092 140724890794752 140724890768312 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6611772 6601723 819 493 0 6605077 0
Current children cumulated CPU time: 2519.46 s
Current children cumulated vsize: 26447088 KiB
Current children cumulated memory: 26406892 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.01 1.35 2/192 1637
/proc/meminfo: memFree=4639088/32770624 swapFree=67015332/67108860
[pid=1449] ppid=1446 vsize=26447088 memory=26406892 CPUtime=2519.52 cores=0-7
/proc/1449/stat : 1449 (cosoco) R 1446 1449 695 0 -1 512 6407750 0 1 0 250528 1424 0 0 20 0 1 0 437366554 27081818112 6601723 33554432000 4194304 6211092 140724890794752 140724890768312 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 1 0 0 8312316 8317760 20914176 140724890797073 140724890797165 140724890797165 140724890800078 0
/proc/1449/statm: 6611772 6601723 819 493 0 6605077 0
Current children cumulated CPU time: 2519.52 s
Current children cumulated vsize: 26447088 KiB
Current children cumulated memory: 26406892 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.22
CPU time (s): 2520.75
CPU user time (s): 2505.29
CPU system time (s): 15.4584
CPU usage (%): 99.9019
Max. virtual memory (cumulated for all children) (KiB): 26447088
Max. memory (cumulated for all children) (KiB): 26406892

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2505.29
system time used= 15.4584
maximum resident set size= 26407144
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6407750
page faults= 1
swaps= 0
block input operations= 9984
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 114126
involuntary context switches= 2027


# summary of solver processes directly reported to runsolver:
#   pid: 1449
#   total CPU time (s): 2520.75
#   total CPU user time (s): 2505.29
#   total CPU system time (s): 15.4584

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.814 second user time and 13.8023 second system time

The end

Launcher Data 

Begin job on node143 at 2019-09-16 08:10:51
IDJOB=4398496
IDBENCH=139629
IDSOLVER=2851
FILE ID=node143/4398496-1568614292
RUNJOBID= node143-1568609536-722
PBS_JOBID= 21703438
Free space on /tmp= 59272 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_12_14.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398496-1568614292/watcher-4398496-1568614292 -o /tmp/evaluation-result-4398496-1568614292/solver-4398496-1568614292 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node143-1568609536-722 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398496-1568614292.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b79ed9a63f5f06b259b31d8f3686f277
RANDOM SEED=551762287

node143.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31999896 kB
MemAvailable:   31911448 kB
Buffers:           34736 kB
Cached:           134932 kB
SwapCached:        39624 kB
Active:            84192 kB
Inactive:         138716 kB
Active(anon):       1724 kB
Inactive(anon):   101360 kB
Active(file):      82468 kB
Inactive(file):    37356 kB
Unevictable:      109584 kB
Mlocked:          109584 kB
SwapTotal:      67108860 kB
SwapFree:       67015320 kB
Dirty:              2436 kB
Writeback:             0 kB
AnonPages:        123672 kB
Mapped:            39504 kB
Shmem:             40932 kB
Slab:             138652 kB
SReclaimable:     109700 kB
SUnreclaim:        28952 kB
KernelStack:        3408 kB
PageTables:         5328 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     509000 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      132480 kB
DirectMap2M:    33413120 kB

Free space on /tmp at the end= 58832 MiB
End job on node143 at 2019-09-16 08:52:54