Trace number 4408469

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1523.9 1525.7

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_9_13.xml
MD5SUM3c8d95ae467c6bf4a4f8a8c9b5dc34f0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark244
Best CPU time to get the best result obtained on this benchmark19937.7
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":15,"count":111},{"size":50,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13885 MiB free)
  memory of node 1: 16384 MiB (10767 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408469-1569811795/watcher-4408469-1569811795 -o /tmp/evaluation-result-4408469-1569811795/solver-4408469-1569811795 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node145-1569787350-23554 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408469-1569811795.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=28538, runsolver pid=28535
Current StackSize limit: 8192 KiB


[startup+0.100802 s]*
/proc/loadavg: 2.01 2.26 2.23 3/200 28539
/proc/meminfo: memFree=25232884/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=39156 memory=15228 CPUtime=0.1 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 4008 0 0 0 9 1 0 0 20 0 1 0 557115833 40095744 3807 33554432000 4194304 6211132 140735509043120 140735509038280 139824166716544 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 9789 3807 809 493 0 3094 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39156 KiB
Current children cumulated memory: 15228 KiB

[startup+0.209774 s]*
/proc/loadavg: 2.01 2.26 2.23 3/200 28539
/proc/meminfo: memFree=25230756/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=40732 memory=17004 CPUtime=0.21 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 4429 0 0 0 20 1 0 0 20 0 1 0 557115833 41709568 4251 33554432000 4194304 6211132 140735509043120 140735509038280 139824150723456 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 10183 4251 819 493 0 3488 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40732 KiB
Current children cumulated memory: 17004 KiB

[startup+0.309124 s]*
/proc/loadavg: 2.01 2.26 2.23 3/200 28539
/proc/meminfo: memFree=25228980/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=41716 memory=18060 CPUtime=0.31 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 4683 0 0 0 30 1 0 0 20 0 1 0 557115833 42717184 4515 33554432000 4194304 6211132 140735509043120 140735509038280 5443093 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 10429 4515 819 493 0 3734 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41716 KiB
Current children cumulated memory: 18060 KiB

[startup+0.70034 s]
/proc/loadavg: 2.01 2.26 2.23 3/200 28539
/proc/meminfo: memFree=25223860/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=45712 memory=21992 CPUtime=0.69 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 5673 0 0 0 68 1 0 0 20 0 1 0 557115833 46809088 5498 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 11428 5498 819 493 0 4733 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45712 KiB
Current children cumulated memory: 21992 KiB

[startup+1.50034 s]
/proc/loadavg: 2.01 2.26 2.22 3/200 28539
/proc/meminfo: memFree=25214312/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=54080 memory=30316 CPUtime=1.49 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 7746 0 0 0 148 1 0 0 20 0 1 0 557115833 55377920 7579 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 13520 7579 819 493 0 6825 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54080 KiB
Current children cumulated memory: 30316 KiB

[startup+3.10945 s]
/proc/loadavg: 2.01 2.26 2.22 3/200 28539
/proc/meminfo: memFree=25171840/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=71028 memory=46808 CPUtime=3.09 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 12081 0 0 0 308 1 0 0 20 0 1 0 557115833 72732672 11702 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 17757 11702 819 493 0 11062 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 71028 KiB
Current children cumulated memory: 46808 KiB

[startup+6.30033 s]
/proc/loadavg: 2.01 2.26 2.22 3/200 28539
/proc/meminfo: memFree=25111188/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=104572 memory=79996 CPUtime=6.29 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 20513 0 0 0 626 3 0 0 20 0 1 0 557115833 107081728 19999 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 26143 19999 819 493 0 19448 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104572 KiB
Current children cumulated memory: 79996 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.25 2.22 3/201 28541
/proc/meminfo: memFree=24987572/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=170296 memory=146256 CPUtime=12.69 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 37252 0 0 0 1264 5 0 0 20 0 1 0 557115833 174383104 36564 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 42574 36564 819 493 0 35879 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 170296 KiB
Current children cumulated memory: 146256 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.24 2.22 3/200 28541
/proc/meminfo: memFree=24720260/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=304000 memory=278748 CPUtime=25.49 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 70731 0 0 0 2539 10 0 0 20 0 1 0 557115833 311296000 69687 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 76000 69687 819 493 0 69305 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 304000 KiB
Current children cumulated memory: 278748 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.22 2.22 3/201 28549
/proc/meminfo: memFree=24183636/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=573288 memory=545704 CPUtime=51.1 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 136597 0 0 0 5093 17 0 0 20 0 1 0 557115833 587046912 136426 33554432000 4194304 6211132 140735509043120 140735509016680 139824150649662 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 143322 136426 819 493 0 136627 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 573288 KiB
Current children cumulated memory: 545704 KiB

[startup+102.3 s]
/proc/loadavg: 2.07 2.20 2.21 3/201 28555
/proc/meminfo: memFree=23138724/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=1114240 memory=1074388 CPUtime=102.29 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 265870 0 0 0 10194 35 0 0 20 0 1 0 557115833 1140981760 268597 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 278560 268597 819 493 0 271865 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1114240 KiB
Current children cumulated memory: 1074388 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.16 2.20 3/201 28560
/proc/meminfo: memFree=21907208/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=1741160 memory=1696620 CPUtime=162.28 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 417329 0 0 0 16171 57 0 0 20 0 1 0 557115833 1782947840 424155 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 435290 424155 819 493 0 428595 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1741160 KiB
Current children cumulated memory: 1696620 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.13 2.19 3/201 28564
/proc/meminfo: memFree=20674096/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=2343476 memory=2319244 CPUtime=222.28 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 567911 0 0 0 22152 76 0 0 20 0 1 0 557115833 2399719424 579811 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 585869 579811 819 493 0 579174 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2343476 KiB
Current children cumulated memory: 2319244 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.11 2.18 3/202 28570
/proc/meminfo: memFree=19444592/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=2982572 memory=2940168 CPUtime=282.28 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 719183 0 0 0 28131 97 0 0 20 0 1 0 557115833 3054153728 735042 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 745643 735042 819 493 0 738948 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2982572 KiB
Current children cumulated memory: 2940168 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.09 2.16 3/201 28574
/proc/meminfo: memFree=18214200/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=3640120 memory=3560984 CPUtime=342.27 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 870156 0 0 0 34111 116 0 0 20 0 1 0 557115833 3727482880 890246 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 910030 890246 819 493 0 903335 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 3640120 KiB
Current children cumulated memory: 3560984 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.07 2.15 3/200 28579
/proc/meminfo: memFree=16979936/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=4242172 memory=4183244 CPUtime=402.27 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 1021615 0 0 0 40089 138 0 0 20 0 1 0 557115833 4343984128 1045811 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 1060543 1045811 819 493 0 1053848 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 4242172 KiB
Current children cumulated memory: 4183244 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.06 2.14 3/200 28585
/proc/meminfo: memFree=15749680/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=4843960 memory=4805436 CPUtime=462.27 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 1172573 0 0 0 46064 163 0 0 20 0 1 0 557115833 4960215040 1201359 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 1210990 1201359 819 493 0 1204295 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 4843960 KiB
Current children cumulated memory: 4805436 KiB


################
# More data... #
################

Current children cumulated vsize: 9863500 KiB
Current children cumulated memory: 9772512 KiB

[startup+1002.3 s]
/proc/loadavg: 2.04 2.03 2.10 3/200 28659
/proc/meminfo: memFree=4679524/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=10464628 memory=10391844 CPUtime=1002.25 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 2533327 0 0 0 99824 401 0 0 20 0 1 0 557115833 10715779072 2597961 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 2616157 2597961 819 493 0 2609462 0
Current children cumulated CPU time: 1002.25 s
Current children cumulated vsize: 10464628 KiB
Current children cumulated memory: 10391844 KiB

[startup+1062.3 s]
/proc/loadavg: 2.01 2.03 2.09 3/199 28663
/proc/meminfo: memFree=3450268/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=11065624 memory=11013484 CPUtime=1062.25 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 2684421 0 0 0 105794 431 0 0 20 0 1 0 557115833 11331198976 2753371 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 2766406 2753371 819 493 0 2759711 0
Current children cumulated CPU time: 1062.25 s
Current children cumulated vsize: 11065624 KiB
Current children cumulated memory: 11013484 KiB

[startup+1122.3 s]
/proc/loadavg: 2.05 2.04 2.09 3/199 28667
/proc/meminfo: memFree=2222492/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=11666488 memory=11632816 CPUtime=1122.25 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 2835502 0 0 0 111764 461 0 0 20 0 1 0 557115833 11946483712 2908204 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 2916622 2908204 819 493 0 2909927 0
Current children cumulated CPU time: 1122.25 s
Current children cumulated vsize: 11666488 KiB
Current children cumulated memory: 11632816 KiB

[startup+1182.3 s]
/proc/loadavg: 2.02 2.03 2.09 3/200 28673
/proc/meminfo: memFree=994396/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=12454076 memory=12253476 CPUtime=1182.25 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 2987401 0 0 0 117733 492 0 0 20 0 1 0 557115833 12752973824 3063369 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3113519 3063369 819 493 0 3106824 0
Current children cumulated CPU time: 1182.25 s
Current children cumulated vsize: 12454076 KiB
Current children cumulated memory: 12253476 KiB

[startup+1242.3 s]
/proc/loadavg: 2.66 2.17 2.13 2/198 28683
/proc/meminfo: memFree=15894072/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=13054016 memory=12871616 CPUtime=1242.25 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 3139249 0 0 0 123701 524 0 0 20 0 1 0 557115833 13367312384 3217904 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3263504 3217904 819 493 0 3256809 0
Current children cumulated CPU time: 1242.25 s
Current children cumulated vsize: 13054016 KiB
Current children cumulated memory: 12871616 KiB

[startup+1302.3 s]
/proc/loadavg: 2.27 2.15 2.13 3/202 28755
/proc/meminfo: memFree=16287096/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=13655012 memory=13493256 CPUtime=1302.24 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 3290342 0 0 0 129669 555 0 0 20 0 1 0 557115833 13982732288 3373314 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3413753 3373314 819 493 0 3407058 0
Current children cumulated CPU time: 1302.24 s
Current children cumulated vsize: 13655012 KiB
Current children cumulated memory: 13493256 KiB

[startup+1362.3 s]
/proc/loadavg: 2.10 2.13 2.12 3/203 28761
/proc/meminfo: memFree=15663712/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=14258912 memory=14115476 CPUtime=1362.22 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 3441594 0 0 0 135633 589 0 0 20 0 1 0 557115833 14601125888 3528869 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3564728 3528869 819 493 0 3558033 0
Current children cumulated CPU time: 1362.22 s
Current children cumulated vsize: 14258912 KiB
Current children cumulated memory: 14115476 KiB

[startup+1422.3 s]
/proc/loadavg: 2.04 2.10 2.12 3/202 28765
/proc/meminfo: memFree=15037784/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=14862548 memory=14739740 CPUtime=1422.21 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 3592756 0 0 0 141595 626 0 0 20 0 1 0 557115833 15219249152 3684935 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3715637 3684935 819 493 0 3708942 0
Current children cumulated CPU time: 1422.21 s
Current children cumulated vsize: 14862548 KiB
Current children cumulated memory: 14739740 KiB

[startup+1482.3 s]
/proc/loadavg: 2.01 2.08 2.11 3/201 28769
/proc/meminfo: memFree=14416084/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=15465524 memory=15360968 CPUtime=1482.19 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 3743809 0 0 0 147547 672 0 0 20 0 1 0 557115833 15836696576 3840242 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3866381 3840242 819 493 0 3859686 0
Current children cumulated CPU time: 1482.19 s
Current children cumulated vsize: 15465524 KiB
Current children cumulated memory: 15360968 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1522.8 s]
/proc/loadavg: 2.01 2.07 2.11 3/202 28774
/proc/meminfo: memFree=13995872/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=15872744 memory=15782556 CPUtime=1522.67 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 4202496 3845762 0 0 0 151565 702 0 0 20 0 1 0 557115833 16253689856 3945639 33554432000 4194304 6211132 140735509043120 140735509016680 139824150653925 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3968186 3945639 819 493 0 3961491 0
Current children cumulated CPU time: 1522.67 s
Current children cumulated vsize: 15872744 KiB
Current children cumulated memory: 15782556 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1525.7 s]
# the end of solver process 28538 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1515.95 s, system=7.95015 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1523.2 s]
/proc/loadavg: 2.01 2.07 2.11 3/203 28775
/proc/meminfo: memFree=13882164/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=15872744 memory=15782556 CPUtime=1522.73 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) S 28535 28538 23523 0 -1 512 3845768 0 0 0 151570 703 0 0 20 0 1 0 557115833 16253689856 3945639 33554432000 4194304 6211132 140735509043120 140735509016680 5189800 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3968186 3945639 819 493 0 3961491 0
Current children cumulated CPU time: 1522.73 s
Current children cumulated vsize: 15872744 KiB
Current children cumulated memory: 15782556 KiB

[startup+1524 s]*
/proc/loadavg: 2.01 2.07 2.11 3/203 28775
/proc/meminfo: memFree=13320296/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=15872744 memory=15782556 CPUtime=1522.87 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) R 28535 28538 23523 0 -1 512 3845768 0 0 0 151583 704 0 0 20 0 1 0 557115833 16253689856 3945639 33554432000 4194304 6211132 140735509043120 140735509016680 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3968186 3945639 819 493 0 3961491 0
Current children cumulated CPU time: 1522.87 s
Current children cumulated vsize: 15872744 KiB
Current children cumulated memory: 15782556 KiB

[startup+1524.4 s]
/proc/loadavg: 2.01 2.07 2.11 3/203 28775
/proc/meminfo: memFree=13320296/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=15872744 memory=15782556 CPUtime=1522.94 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) S 28535 28538 23523 0 -1 512 3845768 0 0 0 151589 705 0 0 20 0 1 0 557115833 16253689856 3945639 33554432000 4194304 6211132 140735509043120 140735509016680 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3968186 3945639 819 493 0 3961491 0
Current children cumulated CPU time: 1522.94 s
Current children cumulated vsize: 15872744 KiB
Current children cumulated memory: 15782556 KiB

[startup+1524.8 s]
/proc/loadavg: 2.01 2.07 2.11 3/203 28775
/proc/meminfo: memFree=13320296/32770624 swapFree=66966920/67108860
[pid=28538] ppid=28535 vsize=15872744 memory=15782556 CPUtime=1523 cores=0,2,4,6
/proc/28538/stat : 28538 (cosoco) S 28535 28538 23523 0 -1 512 3845768 0 0 0 151595 705 0 0 20 0 1 0 557115833 16253689856 3945639 33554432000 4194304 6211132 140735509043120 140735509016680 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 29491200 140735509050379 140735509050481 140735509050481 140735509053390 0
/proc/28538/statm: 3968186 3945639 819 493 0 3961491 0
Current children cumulated CPU time: 1523 s
Current children cumulated vsize: 15872744 KiB
Current children cumulated memory: 15782556 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1525.7
CPU time (s): 1523.9
CPU user time (s): 1515.95
CPU system time (s): 7.95015
CPU usage (%): 99.8823
Max. virtual memory (cumulated for all children) (KiB): 15872744
Max. memory (cumulated for all children) (KiB): 15782556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1515.95
system time used= 7.95015
maximum resident set size= 15782700
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3845768
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 137976
involuntary context switches= 1910


# summary of solver processes directly reported to runsolver:
#   pid: 28538
#   total CPU time (s): 1523.9
#   total CPU user time (s): 1515.95
#   total CPU system time (s): 7.95015

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.40606 second user time and 10.7011 second system time

The end

Launcher Data 

Begin job on node145 at 2019-09-30 04:49:12
IDJOB=4408469
IDBENCH=139552
IDSOLVER=2874
FILE ID=node145/4408469-1569811795
RUNJOBID= node145-1569787350-23554
PBS_JOBID= 21705820
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_9_13.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408469-1569811795/watcher-4408469-1569811795 -o /tmp/evaluation-result-4408469-1569811795/solver-4408469-1569811795 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node145-1569787350-23554 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408469-1569811795.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3c8d95ae467c6bf4a4f8a8c9b5dc34f0
RANDOM SEED=189498301

node145.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25245320 kB
MemAvailable:   28471112 kB
Buffers:          240608 kB
Cached:          3308684 kB
SwapCached:        32684 kB
Active:          4678876 kB
Inactive:        2256988 kB
Active(anon):    3372280 kB
Inactive(anon):    96120 kB
Active(file):    1306596 kB
Inactive(file):  2160868 kB
Unevictable:      108080 kB
Mlocked:          108080 kB
SwapTotal:      67108860 kB
SwapFree:       66966920 kB
Dirty:              2352 kB
Writeback:             0 kB
AnonPages:       3462228 kB
Mapped:            28504 kB
Shmem:             73436 kB
Slab:             178596 kB
SReclaimable:     148324 kB
SUnreclaim:        30272 kB
KernelStack:        3600 kB
PageTables:        11700 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    3923188 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    638976 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61488 MiB
End job on node145 at 2019-09-30 05:14:37