Trace number 4389926

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1524.38 1526.87

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_10_9.xml
MD5SUM3187efa1e901acb6cc373eb045baee33
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark142
Best CPU time to get the best result obtained on this benchmark2520.15
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":12,"count":111},{"size":47,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15254 MiB free)
  memory of node 1: 16384 MiB (15552 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389926-1568359219/watcher-4389926-1568359219 -o /tmp/evaluation-result-4389926-1568359219/solver-4389926-1568359219 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node121-1568352647-26640 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389926-1568359219.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=28177, runsolver pid=28174
Current StackSize limit: 8192 KiB


[startup+0.100202 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31535444/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=39152 memory=15352 CPUtime=0.1 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 4007 0 0 0 10 0 0 0 20 0 1 0 412184560 40091648 3838 33554432000 4194304 6210612 140727936240432 140727936235592 5817732 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 9788 3838 809 493 0 3093 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15352 KiB

[startup+0.20992 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31533872/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=40728 memory=16868 CPUtime=0.21 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 4429 0 0 0 21 0 0 0 20 0 1 0 412184560 41705472 4217 33554432000 4194304 6210612 140727936240432 140727936235592 139763805164800 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 10182 4217 819 493 0 3487 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16868 KiB

[startup+0.309012 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31533128/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=41712 memory=17924 CPUtime=0.31 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 4683 0 0 0 31 0 0 0 20 0 1 0 412184560 42713088 4481 33554432000 4194304 6210612 140727936240432 140727936235592 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 10428 4481 819 493 0 3733 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17924 KiB

[startup+0.700352 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31531020/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=45708 memory=21988 CPUtime=0.69 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 5670 0 0 0 69 0 0 0 20 0 1 0 412184560 46804992 5497 33554432000 4194304 6210612 140727936240432 140727936235592 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 11427 5497 819 493 0 4732 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45708 KiB
Current children cumulated memory: 21988 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31525812/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=54076 memory=30048 CPUtime=1.49 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 7734 0 0 0 148 1 0 0 20 0 1 0 412184560 55373824 7512 33554432000 4194304 6210612 140727936240432 140727936213992 5012488 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 13519 7512 819 493 0 6824 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54076 KiB
Current children cumulated memory: 30048 KiB

[startup+3.10936 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31504360/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=70892 memory=46800 CPUtime=3.1 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 12051 0 0 0 309 1 0 0 20 0 1 0 412184560 72593408 11700 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 17723 11700 819 493 0 11028 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70892 KiB
Current children cumulated memory: 46800 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28178
/proc/meminfo: memFree=31473608/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=104304 memory=79724 CPUtime=6.29 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 20449 0 0 0 626 3 0 0 20 0 1 0 412184560 106807296 19931 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 26076 19931 819 493 0 19381 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104304 KiB
Current children cumulated memory: 79724 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28180
/proc/meminfo: memFree=31409980/32770624 swapFree=66980416/67108860
[pid=28177] ppid=28174 vsize=169764 memory=145724 CPUtime=12.69 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 37123 0 0 0 1264 5 0 0 20 0 1 0 412184560 173838336 36431 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 42441 36431 819 493 0 35746 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 169764 KiB
Current children cumulated memory: 145724 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28187
/proc/meminfo: memFree=31273712/32770624 swapFree=66980424/67108860
[pid=28177] ppid=28174 vsize=303072 memory=278932 CPUtime=25.48 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 70262 0 0 0 2537 11 0 0 20 0 1 0 412184560 310345728 69733 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 75768 69733 819 493 0 69073 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 303072 KiB
Current children cumulated memory: 278932 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28188
/proc/meminfo: memFree=31006512/32770624 swapFree=66980424/67108860
[pid=28177] ppid=28174 vsize=571172 memory=542532 CPUtime=51.09 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 135291 0 0 0 5088 21 0 0 20 0 1 0 412184560 584880128 135633 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 142793 135633 819 493 0 136098 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 571172 KiB
Current children cumulated memory: 542532 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28193
/proc/meminfo: memFree=30476160/32770624 swapFree=66980424/67108860
[pid=28177] ppid=28174 vsize=1110276 memory=1070172 CPUtime=102.26 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 264341 0 0 0 10189 37 0 0 20 0 1 0 412184560 1136922624 267543 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 277569 267543 819 493 0 270874 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1110276 KiB
Current children cumulated memory: 1070172 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28197
/proc/meminfo: memFree=29845244/32770624 swapFree=66980424/67108860
[pid=28177] ppid=28174 vsize=1736800 memory=1693132 CPUtime=162.23 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 415449 0 0 0 16165 58 0 0 20 0 1 0 412184560 1778483200 423283 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 434200 423283 819 493 0 427505 0
Current children cumulated CPU time: 162.23 s
Current children cumulated vsize: 1736800 KiB
Current children cumulated memory: 1693132 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28201
/proc/meminfo: memFree=29223352/32770624 swapFree=66980424/67108860
[pid=28177] ppid=28174 vsize=2338984 memory=2313712 CPUtime=222.2 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 565987 0 0 0 22145 75 0 0 20 0 1 0 412184560 2395119616 578428 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 584746 578428 819 493 0 578051 0
Current children cumulated CPU time: 222.2 s
Current children cumulated vsize: 2338984 KiB
Current children cumulated memory: 2313712 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28207
/proc/meminfo: memFree=28599680/32770624 swapFree=66980424/67108860
[pid=28177] ppid=28174 vsize=2978080 memory=2936368 CPUtime=282.17 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 717143 0 0 0 28123 94 0 0 20 0 1 0 412184560 3049553920 734092 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 744520 734092 819 493 0 737825 0
Current children cumulated CPU time: 282.17 s
Current children cumulated vsize: 2978080 KiB
Current children cumulated memory: 2936368 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28212
/proc/meminfo: memFree=27978400/32770624 swapFree=66980432/67108860
[pid=28177] ppid=28174 vsize=3580000 memory=3556244 CPUtime=342.14 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 868052 0 0 0 34102 112 0 0 20 0 1 0 412184560 3665920000 889061 33554432000 4194304 6210612 140727936240432 140727936213992 5012488 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 895000 889061 819 493 0 888305 0
Current children cumulated CPU time: 342.14 s
Current children cumulated vsize: 3580000 KiB
Current children cumulated memory: 3556244 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28216
/proc/meminfo: memFree=27353864/32770624 swapFree=66980432/67108860
[pid=28177] ppid=28174 vsize=4237284 memory=4179256 CPUtime=402.1 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 1018803 0 0 0 40076 134 0 0 20 0 1 0 412184560 4338978816 1044814 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 1059321 1044814 819 493 0 1052626 0
Current children cumulated CPU time: 402.1 s
Current children cumulated vsize: 4237284 KiB
Current children cumulated memory: 4179256 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28222
/proc/meminfo: memFree=26732412/32770624 swapFree=66980432/67108860
[pid=28177] ppid=28174 vsize=4839072 memory=4799544 CPUtime=462.07 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 1169390 0 0 0 46051 156 0 0 20 0 1 0 412184560 4955209728 1199886 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 1209768 1199886 819 493 0 1203073 0
Current children cumulated CPU time: 462.07 s
Current children cumulated vsize: 4839072 KiB
Current children cumulated memory: 4799544 KiB


################
# More data... #
################

Current children cumulated vsize: 9858744 KiB
Current children cumulated memory: 9766496 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28272
/proc/meminfo: memFree=21129168/32770624 swapFree=66980436/67108860
[pid=28177] ppid=28174 vsize=10459872 memory=10388120 CPUtime=1001.79 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 2525887 0 0 0 99809 370 0 0 20 0 1 0 412184560 10710908928 2597030 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 2614968 2597030 819 493 0 2608273 0
Current children cumulated CPU time: 1001.79 s
Current children cumulated vsize: 10459872 KiB
Current children cumulated memory: 10388120 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28276
/proc/meminfo: memFree=20508204/32770624 swapFree=66980436/67108860
[pid=28177] ppid=28174 vsize=11061132 memory=11007700 CPUtime=1061.76 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 2676451 0 0 0 105780 396 0 0 20 0 1 0 412184560 11326599168 2751925 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 2765283 2751925 819 493 0 2758588 0
Current children cumulated CPU time: 1061.76 s
Current children cumulated vsize: 11061132 KiB
Current children cumulated memory: 11007700 KiB

[startup+1122.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/199 28340
/proc/meminfo: memFree=19445336/32770624 swapFree=66980436/67108860
[pid=28177] ppid=28174 vsize=11662128 memory=11629216 CPUtime=1121.74 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 2826937 0 0 0 111749 425 0 0 20 0 1 0 412184560 11942019072 2907304 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 2915532 2907304 819 493 0 2908837 0
Current children cumulated CPU time: 1121.74 s
Current children cumulated vsize: 11662128 KiB
Current children cumulated memory: 11629216 KiB

[startup+1182.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/200 28346
/proc/meminfo: memFree=18088244/32770624 swapFree=66980436/67108860
[pid=28177] ppid=28174 vsize=12450112 memory=12248104 CPUtime=1181.71 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 2977822 0 0 0 117719 452 0 0 20 0 1 0 412184560 12748914688 3062026 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3112528 3062026 819 493 0 3105833 0
Current children cumulated CPU time: 1181.71 s
Current children cumulated vsize: 12450112 KiB
Current children cumulated memory: 12248104 KiB

[startup+1242.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/200 28358
/proc/meminfo: memFree=16729104/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=13051108 memory=12869728 CPUtime=1241.69 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 3128346 0 0 0 123688 481 0 0 20 0 1 0 412184560 13364334592 3217432 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3262777 3217432 819 493 0 3256082 0
Current children cumulated CPU time: 1241.69 s
Current children cumulated vsize: 13051108 KiB
Current children cumulated memory: 12869728 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 28362
/proc/meminfo: memFree=15371716/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=13652104 memory=13489044 CPUtime=1301.67 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 3278848 0 0 0 129654 513 0 0 20 0 1 0 412184560 13979754496 3372261 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3413026 3372261 819 493 0 3406331 0
Current children cumulated CPU time: 1301.67 s
Current children cumulated vsize: 13652104 KiB
Current children cumulated memory: 13489044 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 28368
/proc/meminfo: memFree=14013300/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=14252968 memory=14110404 CPUtime=1361.63 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 3429310 0 0 0 135620 543 0 0 20 0 1 0 412184560 14595039232 3527601 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3563242 3527601 819 493 0 3556547 0
Current children cumulated CPU time: 1361.63 s
Current children cumulated vsize: 14252968 KiB
Current children cumulated memory: 14110404 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28372
/proc/meminfo: memFree=12658372/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=14853700 memory=14729720 CPUtime=1421.61 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 3579769 0 0 0 141586 575 0 0 20 0 1 0 412184560 15210188800 3682430 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3713425 3682430 819 493 0 3706730 0
Current children cumulated CPU time: 1421.61 s
Current children cumulated vsize: 14853700 KiB
Current children cumulated memory: 14729720 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28376
/proc/meminfo: memFree=11299012/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=15454300 memory=15350616 CPUtime=1481.59 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 3730227 0 0 0 147550 609 0 0 20 0 1 0 412184560 15825203200 3837654 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3863575 3837654 819 493 0 3856880 0
Current children cumulated CPU time: 1481.59 s
Current children cumulated vsize: 15454300 KiB
Current children cumulated memory: 15350616 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1524.11 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28380
/proc/meminfo: memFree=10348112/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=15872476 memory=15781048 CPUtime=1523.38 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) R 28174 28177 25389 0 -1 4202496 3834976 0 0 0 151704 634 0 0 20 0 1 0 412184560 16253415424 3945262 33554432000 4194304 6210612 140727936240432 140727936213992 139763804240869 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3968119 3945262 819 493 0 3961424 0
Current children cumulated CPU time: 1523.38 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15781048 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1526.87 s]
# the end of solver process 28177 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1517.25 s, system=7.13037 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1524.8 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28380
/proc/meminfo: memFree=10348112/32770624 swapFree=66980444/67108860
[pid=28177] ppid=28174 vsize=15872476 memory=15781308 CPUtime=1523.41 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) S 28174 28177 25389 0 -1 512 3834980 0 0 0 151707 634 0 0 20 0 1 0 412184560 16253415424 3945327 33554432000 4194304 6210612 140727936240432 140727936213992 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3968119 3945327 820 493 0 3961424 0
Current children cumulated CPU time: 1523.41 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15781308 KiB

[startup+1525.6 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 28381
/proc/meminfo: memFree=10096748/32770624 swapFree=66980456/67108860
[pid=28177] ppid=28174 vsize=15872476 memory=15781308 CPUtime=1523.53 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) S 28174 28177 25389 0 -1 512 3834980 0 0 0 151718 635 0 0 20 0 1 0 412184560 16253415424 3945327 33554432000 4194304 6210612 140727936240432 140727936213992 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3968119 3945327 820 493 0 3961424 0
Current children cumulated CPU time: 1523.53 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15781308 KiB

[startup+1526 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 28381
/proc/meminfo: memFree=9568260/32770624 swapFree=66980456/67108860
[pid=28177] ppid=28174 vsize=15872476 memory=15781308 CPUtime=1523.59 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) S 28174 28177 25389 0 -1 512 3834980 0 0 0 151723 636 0 0 20 0 1 0 412184560 16253415424 3945327 33554432000 4194304 6210612 140727936240432 140727936213992 5188952 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3968119 3945327 820 493 0 3961424 0
Current children cumulated CPU time: 1523.59 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15781308 KiB

[startup+1526.11 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28381
/proc/meminfo: memFree=9568260/32770624 swapFree=66980456/67108860
[pid=28177] ppid=28174 vsize=15872476 memory=15781308 CPUtime=1523.6 cores=0,2,4,6
/proc/28177/stat : 28177 (cosoco) S 28174 28177 25389 0 -1 512 3834980 0 0 0 151724 636 0 0 20 0 1 0 412184560 16253415424 3945327 33554432000 4194304 6210612 140727936240432 140727936213992 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 8773632 140727936242699 140727936242801 140727936242801 140727936245710 0
/proc/28177/statm: 3968119 3945327 820 493 0 3961424 0
Current children cumulated CPU time: 1523.6 s
Current children cumulated vsize: 15872476 KiB
Current children cumulated memory: 15781308 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1526.87
CPU time (s): 1524.38
CPU user time (s): 1517.25
CPU system time (s): 7.13037
CPU usage (%): 99.8364
Max. virtual memory (cumulated for all children) (KiB): 15872476
Max. memory (cumulated for all children) (KiB): 15781308

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1517.25
system time used= 7.13037
maximum resident set size= 15781308
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3834980
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 99568
involuntary context switches= 1531


# summary of solver processes directly reported to runsolver:
#   pid: 28177
#   total CPU time (s): 1524.38
#   total CPU user time (s): 1517.25
#   total CPU system time (s): 7.13037

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.54786 second user time and 10.3719 second system time

The end

Launcher Data 

Begin job on node121 at 2019-09-13 09:19:37
IDJOB=4389926
IDBENCH=139585
IDSOLVER=2829
FILE ID=node121/4389926-1568359219
RUNJOBID= node121-1568352647-26640
PBS_JOBID= 21701172
Free space on /tmp= 61048 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_10_9.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389926-1568359219/watcher-4389926-1568359219 -o /tmp/evaluation-result-4389926-1568359219/solver-4389926-1568359219 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node121-1568352647-26640 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389926-1568359219.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3187efa1e901acb6cc373eb045baee33
RANDOM SEED=1880449132

node121.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31546832 kB
MemAvailable:   31782616 kB
Buffers:          140360 kB
Cached:           391676 kB
SwapCached:        18904 kB
Active:           394256 kB
Inactive:         294252 kB
Active(anon):     143788 kB
Inactive(anon):    43104 kB
Active(file):     250468 kB
Inactive(file):   251148 kB
Unevictable:      109528 kB
Mlocked:          109528 kB
SwapTotal:      67108860 kB
SwapFree:       66980416 kB
Dirty:              2492 kB
Writeback:             0 kB
AnonPages:        247872 kB
Mapped:            34732 kB
Shmem:             21352 kB
Slab:             128480 kB
SReclaimable:     100008 kB
SUnreclaim:        28472 kB
KernelStack:        3568 kB
PageTables:         5952 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     662768 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    200704 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 60660 MiB
End job on node121 at 2019-09-13 09:45:04