Trace number 4409130

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1537.47 1539.81

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_16_2.xml
MD5SUM8e5b61791e512734038a023d36a5924c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark97
Best CPU time to get the best result obtained on this benchmark2400.44
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":10,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14609 MiB free)
  memory of node 1: 16384 MiB (15448 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409130-1569813007/watcher-4409130-1569813007 -o /tmp/evaluation-result-4409130-1569813007/solver-4409130-1569813007 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1569787352-8873 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409130-1569813007.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=13313, runsolver pid=13310
Current StackSize limit: 8192 KiB


[startup+0.100199 s]*
/proc/loadavg: 2.00 2.01 2.05 3/204 13314
/proc/meminfo: memFree=30768180/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=39152 memory=15220 CPUtime=0.1 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 4007 0 0 0 10 0 0 0 20 0 1 0 557540206 40091648 3805 33554432000 4194304 6211132 140730409126736 140730409123272 139630394380018 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 9788 3805 809 493 0 3093 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15220 KiB

[startup+0.210112 s]*
/proc/loadavg: 2.00 2.01 2.05 3/204 13314
/proc/meminfo: memFree=30766444/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=40728 memory=16868 CPUtime=0.21 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 4429 0 0 0 21 0 0 0 20 0 1 0 557540206 41705472 4217 33554432000 4194304 6211132 140730409126736 140730409123272 5451532 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 10182 4217 819 493 0 3487 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16868 KiB

[startup+0.309356 s]*
/proc/loadavg: 2.00 2.01 2.05 3/204 13314
/proc/meminfo: memFree=30765700/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=41712 memory=17924 CPUtime=0.31 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 4682 0 0 0 31 0 0 0 20 0 1 0 557540206 42713088 4481 33554432000 4194304 6211132 140730409126736 140730409123272 139630394387304 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 10428 4481 819 493 0 3733 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17924 KiB

[startup+0.700338 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 13314
/proc/meminfo: memFree=30763468/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=45708 memory=21988 CPUtime=0.69 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 5664 0 0 0 69 0 0 0 20 0 1 0 557540206 46804992 5497 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 11427 5497 819 493 0 4732 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45708 KiB
Current children cumulated memory: 21988 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 13314
/proc/meminfo: memFree=30758608/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=53944 memory=30048 CPUtime=1.49 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 7719 0 0 0 149 0 0 0 20 0 1 0 557540206 55238656 7512 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 13486 7512 819 493 0 6791 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 53944 KiB
Current children cumulated memory: 30048 KiB

[startup+3.10975 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 13314
/proc/meminfo: memFree=30737844/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=70760 memory=46544 CPUtime=3.09 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 12023 0 0 0 309 0 0 0 20 0 1 0 557540206 72458240 11636 33554432000 4194304 6211132 140730409126736 140730409100296 139630385366226 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 17690 11636 819 493 0 10995 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 70760 KiB
Current children cumulated memory: 46544 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 13316
/proc/meminfo: memFree=30706740/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=104040 memory=79464 CPUtime=6.29 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 20386 0 0 0 628 1 0 0 20 0 1 0 557540206 106536960 19866 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 26010 19866 819 493 0 19315 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104040 KiB
Current children cumulated memory: 79464 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 13316
/proc/meminfo: memFree=30645308/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=169236 memory=145196 CPUtime=12.69 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 36995 0 0 0 1265 4 0 0 20 0 1 0 557540206 173297664 36299 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 42309 36299 819 493 0 35614 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 169236 KiB
Current children cumulated memory: 145196 KiB

[startup+25.5002 s]
/proc/loadavg: 1.92 2.00 2.04 3/204 13317
/proc/meminfo: memFree=30511848/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=301752 memory=276360 CPUtime=25.49 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 70148 0 0 0 2541 8 0 0 20 0 1 0 557540206 308994048 69090 33554432000 4194304 6211132 140730409126736 140730409100296 139630385366253 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 75438 69090 819 493 0 68743 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 301752 KiB
Current children cumulated memory: 276360 KiB

[startup+51.1095 s]
/proc/loadavg: 1.95 2.00 2.04 3/206 13388
/proc/meminfo: memFree=30200348/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=568136 memory=540444 CPUtime=51.09 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 134679 0 0 0 5092 17 0 0 20 0 1 0 557540206 581771264 135111 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 142034 135111 819 493 0 135339 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 568136 KiB
Current children cumulated memory: 540444 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/205 13391
/proc/meminfo: memFree=29144712/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=1088328 memory=1064664 CPUtime=102.26 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 262682 0 0 0 10194 32 0 0 20 0 1 0 557540206 1114447872 266166 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 272082 266166 819 493 0 265387 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1088328 KiB
Current children cumulated memory: 1064664 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/205 13395
/proc/meminfo: memFree=27900828/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=1726372 memory=1681592 CPUtime=162.24 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 412859 0 0 0 16171 53 0 0 20 0 1 0 557540206 1767804928 420398 33554432000 4194304 6211132 140730409126736 140730409100296 139630385368512 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 431593 420398 819 493 0 424898 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 1726372 KiB
Current children cumulated memory: 1681592 KiB

[startup+222.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/204 13399
/proc/meminfo: memFree=26656248/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=2323408 memory=2297156 CPUtime=222.22 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 562132 0 0 0 22148 74 0 0 20 0 1 0 557540206 2379169792 574289 33554432000 4194304 6211132 140730409126736 140730409100296 5013001 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 580852 574289 819 493 0 574157 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 2323408 KiB
Current children cumulated memory: 2297156 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/204 13405
/proc/meminfo: memFree=25411116/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=2957356 memory=2914784 CPUtime=282.21 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 711990 0 0 0 28126 95 0 0 20 0 1 0 557540206 3028332544 728696 33554432000 4194304 6211132 140730409126736 140730409100296 5478438 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 739339 728696 819 493 0 732644 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 2957356 KiB
Current children cumulated memory: 2914784 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/203 13409
/proc/meminfo: memFree=24166940/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=3554128 memory=3530100 CPUtime=342.19 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 861263 0 0 0 34102 117 0 0 20 0 1 0 557540206 3639427072 882525 33554432000 4194304 6211132 140730409126736 140730409100296 139630385366259 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 888532 882525 819 493 0 881837 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 3554128 KiB
Current children cumulated memory: 3530100 KiB

[startup+402.3 s]
/proc/loadavg: 2.13 2.04 2.05 3/202 13413
/proc/meminfo: memFree=22923704/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=4206264 memory=4147100 CPUtime=402.18 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 1011073 0 0 0 40078 140 0 0 20 0 1 0 557540206 4307214336 1036775 33554432000 4194304 6211132 140730409126736 140730409100296 5013005 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 1051566 1036775 819 493 0 1044871 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 4206264 KiB
Current children cumulated memory: 4147100 KiB

[startup+462.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/204 13421
/proc/meminfo: memFree=21680392/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=4802904 memory=4762360 CPUtime=462.16 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 1160401 0 0 0 46055 161 0 0 20 0 1 0 557540206 4918173696 1190590 33554432000 4194304 6211132 140730409126736 140730409100296 5451532 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 1200726 1190590 819 493 0 1194031 0
Current children cumulated CPU time: 462.16 s
Current children cumulated vsize: 4802904 KiB
Current children cumulated memory: 4762360 KiB


################
# More data... #
################

Current children cumulated vsize: 9782052 KiB
Current children cumulated memory: 9688596 KiB

[startup+1002.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/204 13474
/proc/meminfo: memFree=10497140/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=10378164 memory=10303404 CPUtime=1002.02 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 2504970 0 0 0 99813 389 0 0 20 0 1 0 557540206 10627239936 2575851 33554432000 4194304 6211132 140730409126736 140730409100296 5479708 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 2594541 2575851 819 493 0 2587846 0
Current children cumulated CPU time: 1002.02 s
Current children cumulated vsize: 10378164 KiB
Current children cumulated memory: 10303404 KiB

[startup+1062.3 s]
/proc/loadavg: 2.43 2.11 2.08 3/204 13478
/proc/meminfo: memFree=9255504/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=10974144 memory=10917624 CPUtime=1062 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 2654178 0 0 0 105784 416 0 0 20 0 1 0 557540206 11237523456 2729406 33554432000 4194304 6211132 140730409126736 140730409100296 5013088 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 2743536 2729406 819 493 0 2736841 0
Current children cumulated CPU time: 1062 s
Current children cumulated vsize: 10974144 KiB
Current children cumulated memory: 10917624 KiB

[startup+1122.3 s]
/proc/loadavg: 2.23 2.12 2.08 3/204 13484
/proc/meminfo: memFree=8013636/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=11569728 memory=11533744 CPUtime=1121.98 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 2803398 0 0 0 111753 445 0 0 20 0 1 0 557540206 11847401472 2883436 33554432000 4194304 6211132 140730409126736 140730409100296 5440648 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 2892432 2883436 819 493 0 2885737 0
Current children cumulated CPU time: 1121.98 s
Current children cumulated vsize: 11569728 KiB
Current children cumulated memory: 11533744 KiB

[startup+1182.3 s]
/proc/loadavg: 2.08 2.10 2.07 3/204 13490
/proc/meminfo: memFree=6772484/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=12352168 memory=12147164 CPUtime=1181.96 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 2953438 0 0 0 117721 475 0 0 20 0 1 0 557540206 12648620032 3036791 33554432000 4194304 6211132 140730409126736 140730409100296 5439860 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3088042 3036791 819 493 0 3081347 0
Current children cumulated CPU time: 1181.96 s
Current children cumulated vsize: 12352168 KiB
Current children cumulated memory: 12147164 KiB

[startup+1242.3 s]
/proc/loadavg: 2.14 2.11 2.08 3/205 13502
/proc/meminfo: memFree=5530272/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=12947884 memory=12763488 CPUtime=1241.95 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 3102629 0 0 0 123689 506 0 0 20 0 1 0 557540206 13258633216 3190872 33554432000 4194304 6211132 140730409126736 140730409100296 139630385366264 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3236971 3190872 819 493 0 3230276 0
Current children cumulated CPU time: 1241.95 s
Current children cumulated vsize: 12947884 KiB
Current children cumulated memory: 12763488 KiB

[startup+1302.3 s]
/proc/loadavg: 2.05 2.09 2.07 3/204 13506
/proc/meminfo: memFree=4290840/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=13543732 memory=13377768 CPUtime=1301.93 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 3251837 0 0 0 129657 536 0 0 20 0 1 0 557540206 13868781568 3344442 33554432000 4194304 6211132 140730409126736 140730409100296 5451564 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3385933 3344442 819 493 0 3379238 0
Current children cumulated CPU time: 1301.93 s
Current children cumulated vsize: 13543732 KiB
Current children cumulated memory: 13377768 KiB

[startup+1362.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/204 13512
/proc/meminfo: memFree=3048900/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=14139316 memory=13993828 CPUtime=1361.92 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 3401019 0 0 0 135626 566 0 0 20 0 1 0 557540206 14478659584 3498457 33554432000 4194304 6211132 140730409126736 140730409100296 5013066 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3534829 3498457 819 493 0 3528134 0
Current children cumulated CPU time: 1361.92 s
Current children cumulated vsize: 14139316 KiB
Current children cumulated memory: 13993828 KiB

[startup+1422.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/204 13517
/proc/meminfo: memFree=1808344/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=14734900 memory=14607844 CPUtime=1421.9 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 3550182 0 0 0 141595 595 0 0 20 0 1 0 557540206 15088537600 3651961 33554432000 4194304 6211132 140730409126736 140730409100296 139630385366243 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3683725 3651961 819 493 0 3677030 0
Current children cumulated CPU time: 1421.9 s
Current children cumulated vsize: 14734900 KiB
Current children cumulated memory: 14607844 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/204 13521
/proc/meminfo: memFree=567240/32770624 swapFree=67003184/67108860
[pid=13313] ppid=13310 vsize=15329824 memory=15221068 CPUtime=1481.89 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 3699170 0 0 0 147556 633 0 0 20 0 1 0 557540206 15697739776 3805267 33554432000 4194304 6211132 140730409126736 140730409100296 5453936 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3832456 3805267 819 493 0 3825761 0
Current children cumulated CPU time: 1481.89 s
Current children cumulated vsize: 15329824 KiB
Current children cumulated memory: 15221068 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1537 s]*
/proc/loadavg: 2.00 2.04 2.05 3/204 13528
/proc/meminfo: memFree=208696/32770624 swapFree=67002888/67108860
[pid=13313] ppid=13310 vsize=15872212 memory=15780512 CPUtime=1536.59 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 4202496 3837232 0 0 0 152992 667 0 0 20 0 1 0 557540206 16253145088 3945128 33554432000 4194304 6211132 140730409126736 140730409100296 139630384442341 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3968053 3945128 819 493 0 3961358 0
Current children cumulated CPU time: 1536.59 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15780512 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1539.81 s]
# the end of solver process 13313 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1530.01 s, system=7.45897 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1537.6 s]
/proc/loadavg: 2.00 2.04 2.05 3/204 13528
/proc/meminfo: memFree=208696/32770624 swapFree=67002888/67108860
[pid=13313] ppid=13310 vsize=15872212 memory=15780512 CPUtime=1536.59 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) S 13310 13313 8842 0 -1 512 3837241 0 0 0 152992 667 0 0 20 0 1 0 557540206 16253145088 3945128 33554432000 4194304 6211132 140730409126736 140730409100296 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3968053 3945128 819 493 0 3961358 0
Current children cumulated CPU time: 1536.59 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15780512 KiB

[startup+1538.4 s]
/proc/loadavg: 2.00 2.04 2.05 3/205 13529
/proc/meminfo: memFree=187676/32770624 swapFree=67002888/67108860
[pid=13313] ppid=13310 vsize=15872212 memory=15779364 CPUtime=1536.62 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) R 13310 13313 8842 0 -1 512 3837241 0 0 0 152995 667 0 0 20 0 1 0 557540206 16253145088 3944841 33554432000 4194304 6211132 140730409126736 140730409100296 5189800 0 16384 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3968053 3944841 532 493 0 3961358 0
Current children cumulated CPU time: 1536.62 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15779364 KiB

[startup+1538.8 s]
/proc/loadavg: 2.00 2.04 2.05 3/205 13529
/proc/meminfo: memFree=187676/32770624 swapFree=67002888/67108860
[pid=13313] ppid=13310 vsize=15872212 memory=15779364 CPUtime=1536.67 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) S 13310 13313 8842 0 -1 512 3837241 0 0 0 152999 668 0 0 20 0 1 0 557540206 16253145088 3944841 33554432000 4194304 6211132 140730409126736 140730409100296 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3968053 3944841 532 493 0 3961358 0
Current children cumulated CPU time: 1536.67 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15779364 KiB

[startup+1539 s]*
/proc/loadavg: 2.00 2.04 2.05 1/205 13529
/proc/meminfo: memFree=162708/32770624 swapFree=66967820/67108860
[pid=13313] ppid=13310 vsize=15872212 memory=15779360 CPUtime=1536.69 cores=0,2,4,6
/proc/13313/stat : 13313 (cosoco) S 13310 13313 8842 0 -1 512 3837241 0 0 0 153001 668 0 0 20 0 1 0 557540206 16253145088 3944840 33554432000 4194304 6211132 140730409126736 140730409100296 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 36851712 140730409133067 140730409133169 140730409133169 140730409136078 0
/proc/13313/statm: 3968053 3944840 531 493 0 3961358 0
Current children cumulated CPU time: 1536.69 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15779360 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1539.81
CPU time (s): 1537.47
CPU user time (s): 1530.01
CPU system time (s): 7.45897
CPU usage (%): 99.848
Max. virtual memory (cumulated for all children) (KiB): 15872212
Max. memory (cumulated for all children) (KiB): 15780512

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1530.01
system time used= 7.45897
maximum resident set size= 15780512
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3837241
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 43679
involuntary context switches= 2377


# summary of solver processes directly reported to runsolver:
#   pid: 13313
#   total CPU time (s): 1537.47
#   total CPU user time (s): 1530.01
#   total CPU system time (s): 7.45897

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.5454 second user time and 10.4818 second system time

The end

Launcher Data 

Begin job on node133 at 2019-09-30 05:09:26
IDJOB=4409130
IDBENCH=139548
IDSOLVER=2876
FILE ID=node133/4409130-1569813007
RUNJOBID= node133-1569787352-8873
PBS_JOBID= 21705825
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_16_2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409130-1569813007/watcher-4409130-1569813007 -o /tmp/evaluation-result-4409130-1569813007/solver-4409130-1569813007 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1569787352-8873 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409130-1569813007.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e5b61791e512734038a023d36a5924c
RANDOM SEED=1262183509

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30779608 kB
MemAvailable:   31841264 kB
Buffers:          216828 kB
Cached:          1177300 kB
SwapCached:         4960 kB
Active:           805140 kB
Inactive:         623076 kB
Active(anon):      45260 kB
Inactive(anon):    69492 kB
Active(file):     759880 kB
Inactive(file):   553584 kB
Unevictable:      107960 kB
Mlocked:          107960 kB
SwapTotal:      67108860 kB
SwapFree:       67003184 kB
Dirty:              3028 kB
Writeback:             0 kB
AnonPages:        138904 kB
Mapped:            28392 kB
Shmem:             71596 kB
Slab:             157704 kB
SReclaimable:     128056 kB
SUnreclaim:        29648 kB
KernelStack:        3600 kB
PageTables:         5712 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     593800 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     92160 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 61860 MiB
End job on node133 at 2019-09-30 05:35:07