Trace number 4389930

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1512.77 1514.8

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_9_11.xml
MD5SUMb3f80a69476de872363c069f96d9d14d
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark361
Best CPU time to get the best result obtained on this benchmark19756.9
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":15,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12948 MiB free)
  memory of node 1: 16384 MiB (15681 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389930-1568359295/watcher-4389930-1568359295 -o /tmp/evaluation-result-4389930-1568359295/solver-4389930-1568359295 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568359397-3245 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389930-1568359295.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=3261, runsolver pid=3258
Current StackSize limit: 8192 KiB


[startup+0.100162 s]*
/proc/loadavg: 1.74 1.85 1.98 2/193 3262
/proc/meminfo: memFree=29312868/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=39028 memory=15104 CPUtime=0.09 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3988 0 0 0 9 0 0 0 20 0 1 0 412197281 39964672 3776 33554432000 4194304 6210612 140724994071536 140724994068072 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 9757 3776 809 493 0 3062 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 39028 KiB
Current children cumulated memory: 15104 KiB

[startup+0.209691 s]*
/proc/loadavg: 1.74 1.85 1.98 2/193 3262
/proc/meminfo: memFree=29315076/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=40736 memory=17008 CPUtime=0.21 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 4430 0 0 0 20 1 0 0 20 0 1 0 412197281 41713664 4252 33554432000 4194304 6210612 140724994071536 140724994068072 140308831878120 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 10184 4252 819 493 0 3489 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40736 KiB
Current children cumulated memory: 17008 KiB

[startup+0.309454 s]*
/proc/loadavg: 1.74 1.85 1.98 3/196 3269
/proc/meminfo: memFree=29313224/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=41720 memory=18064 CPUtime=0.31 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 4683 0 0 0 30 1 0 0 20 0 1 0 412197281 42721280 4516 33554432000 4194304 6210612 140724994071536 140724994045096 5452001 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 10430 4516 819 493 0 3735 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41720 KiB
Current children cumulated memory: 18064 KiB

[startup+0.700335 s]
/proc/loadavg: 1.74 1.85 1.98 3/199 3275
/proc/meminfo: memFree=29305952/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=45716 memory=21996 CPUtime=0.69 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 5674 0 0 0 68 1 0 0 20 0 1 0 412197281 46813184 5499 33554432000 4194304 6210612 140724994071536 140724994045096 5451412 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 11429 5499 819 493 0 4734 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45716 KiB
Current children cumulated memory: 21996 KiB

[startup+1.50029 s]
/proc/loadavg: 1.74 1.85 1.98 3/199 3275
/proc/meminfo: memFree=29319480/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=54084 memory=30320 CPUtime=1.49 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 7745 0 0 0 148 1 0 0 20 0 1 0 412197281 55382016 7580 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 13521 7580 819 493 0 6826 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54084 KiB
Current children cumulated memory: 30320 KiB

[startup+3.10915 s]
/proc/loadavg: 1.60 1.82 1.97 3/198 3278
/proc/meminfo: memFree=29888748/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=71032 memory=46808 CPUtime=3.1 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 12088 0 0 0 309 1 0 0 20 0 1 0 412197281 72736768 11702 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 17758 11702 819 493 0 11063 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 71032 KiB
Current children cumulated memory: 46808 KiB

[startup+6.30027 s]
/proc/loadavg: 1.60 1.82 1.97 3/198 3278
/proc/meminfo: memFree=29827112/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=104708 memory=80000 CPUtime=6.28 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 20535 0 0 0 626 2 0 0 20 0 1 0 412197281 107220992 20000 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 26177 20000 819 493 0 19482 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 104708 KiB
Current children cumulated memory: 80000 KiB

[startup+12.7003 s]
/proc/loadavg: 1.66 1.83 1.97 3/198 3278
/proc/meminfo: memFree=29703872/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=170432 memory=146260 CPUtime=12.69 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 37300 0 0 0 1265 4 0 0 20 0 1 0 412197281 174522368 36565 33554432000 4194304 6210612 140724994071536 140724994045096 5012846 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 42608 36565 819 493 0 35913 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 170432 KiB
Current children cumulated memory: 146260 KiB

[startup+25.5003 s]
/proc/loadavg: 1.71 1.83 1.97 3/199 3280
/proc/meminfo: memFree=29435312/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=304400 memory=279464 CPUtime=25.49 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 70410 0 0 0 2541 8 0 0 20 0 1 0 412197281 311705600 69866 33554432000 4194304 6210612 140724994071536 140724994045096 140308832732162 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 76100 69866 819 493 0 69405 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 304400 KiB
Current children cumulated memory: 279464 KiB

[startup+51.1094 s]
/proc/loadavg: 1.81 1.85 1.97 3/198 3281
/proc/meminfo: memFree=28892912/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=573952 memory=546500 CPUtime=51.1 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 136280 0 0 0 5094 16 0 0 20 0 1 0 412197281 587726848 136625 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 143488 136625 819 493 0 136793 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 573952 KiB
Current children cumulated memory: 546500 KiB

[startup+102.3 s]
/proc/loadavg: 1.92 1.87 1.97 3/199 3286
/proc/meminfo: memFree=27838624/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=1116356 memory=1076524 CPUtime=102.28 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 265791 0 0 0 10197 31 0 0 20 0 1 0 412197281 1143148544 269131 33554432000 4194304 6210612 140724994071536 140724994045096 140308832732397 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 279089 269131 819 493 0 272394 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1116356 KiB
Current children cumulated memory: 1076524 KiB

[startup+162.3 s]
/proc/loadavg: 1.97 1.90 1.97 3/198 3293
/proc/meminfo: memFree=26589968/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=1748160 memory=1703508 CPUtime=162.26 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 418471 0 0 0 16175 51 0 0 20 0 1 0 412197281 1790115840 425877 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 437040 425877 819 493 0 430345 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 1748160 KiB
Current children cumulated memory: 1703508 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.91 1.97 3/198 3296
/proc/meminfo: memFree=25342144/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=2355360 memory=2331412 CPUtime=222.25 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 570293 0 0 0 22156 69 0 0 20 0 1 0 412197281 2411888640 582853 33554432000 4194304 6210612 140724994071536 140724994045096 4982272 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 588840 582853 819 493 0 582145 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 2355360 KiB
Current children cumulated memory: 2331412 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.93 1.97 3/198 3300
/proc/meminfo: memFree=24094092/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=2999340 memory=2956928 CPUtime=282.24 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 722629 0 0 0 28133 91 0 0 20 0 1 0 412197281 3071324160 739232 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 749835 739232 819 493 0 743140 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 2999340 KiB
Current children cumulated memory: 2956928 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.94 1.97 3/198 3307
/proc/meminfo: memFree=22849192/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=3661772 memory=3583484 CPUtime=342.22 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 874718 0 0 0 34110 112 0 0 20 0 1 0 412197281 3749654528 895871 33554432000 4194304 6210612 140724994071536 140724994045096 5442936 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 915443 895871 819 493 0 908748 0
Current children cumulated CPU time: 342.22 s
Current children cumulated vsize: 3661772 KiB
Current children cumulated memory: 3583484 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.95 1.97 3/198 3311
/proc/meminfo: memFree=21599456/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=4268708 memory=4212000 CPUtime=402.2 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 1026852 0 0 0 40086 134 0 0 20 0 1 0 412197281 4371156992 1053000 33554432000 4194304 6210612 140724994071536 140724994045096 140308832732408 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 1067177 1053000 819 493 0 1060482 0
Current children cumulated CPU time: 402.2 s
Current children cumulated vsize: 4268708 KiB
Current children cumulated memory: 4212000 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.96 1.97 3/197 3322
/proc/meminfo: memFree=20352804/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=4875512 memory=4837040 CPUtime=462.19 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 1178711 0 0 0 46064 155 0 0 20 0 1 0 412197281 4992524288 1209260 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 1218878 1209260 819 493 0 1212183 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 4875512 KiB
Current children cumulated memory: 4837040 KiB


################
# More data... #
################

Current children cumulated vsize: 9329432 KiB
Current children cumulated memory: 9219984 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/197 3360
/proc/meminfo: memFree=10382780/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=9935840 memory=9846888 CPUtime=942.07 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 2394315 0 0 0 93859 348 0 0 20 0 1 0 412197281 10174300160 2461722 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 2483960 2461722 819 493 0 2477265 0
Current children cumulated CPU time: 942.07 s
Current children cumulated vsize: 9935840 KiB
Current children cumulated memory: 9846888 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/197 3364
/proc/meminfo: memFree=9138656/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=10542116 memory=10471484 CPUtime=1002.06 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 2546138 0 0 0 99830 376 0 0 20 0 1 0 412197281 10795126784 2617871 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 2635529 2617871 819 493 0 2628834 0
Current children cumulated CPU time: 1002.06 s
Current children cumulated vsize: 10542116 KiB
Current children cumulated memory: 10471484 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/198 3378
/proc/meminfo: memFree=7890744/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=11148260 memory=11098316 CPUtime=1062.04 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 2697890 0 0 0 105802 402 0 0 20 0 1 0 412197281 11415818240 2774579 33554432000 4194304 6210612 140724994071536 140724994045096 5440952 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 2787065 2774579 819 493 0 2780370 0
Current children cumulated CPU time: 1062.04 s
Current children cumulated vsize: 11148260 KiB
Current children cumulated memory: 11098316 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/198 3382
/proc/meminfo: memFree=6647220/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=11754536 memory=11724952 CPUtime=1122.02 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 2849695 0 0 0 111769 433 0 0 20 0 1 0 412197281 12036644864 2931238 33554432000 4194304 6210612 140724994071536 140724994045096 5442920 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 2938634 2931238 819 493 0 2931939 0
Current children cumulated CPU time: 1122.02 s
Current children cumulated vsize: 11754536 KiB
Current children cumulated memory: 11724952 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/198 3386
/proc/meminfo: memFree=5401308/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=12547404 memory=12348688 CPUtime=1182.01 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3002353 0 0 0 117738 463 0 0 20 0 1 0 412197281 12848541696 3087172 33554432000 4194304 6210612 140724994071536 140724994045096 5478249 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3136851 3087172 819 493 0 3130156 0
Current children cumulated CPU time: 1182.01 s
Current children cumulated vsize: 12547404 KiB
Current children cumulated memory: 12348688 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/198 3392
/proc/meminfo: memFree=4156396/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=13153548 memory=12975328 CPUtime=1241.99 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3154129 0 0 0 123707 492 0 0 20 0 1 0 412197281 13469233152 3243832 33554432000 4194304 6210612 140724994071536 140724994045096 5451322 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3288387 3243832 819 493 0 3281692 0
Current children cumulated CPU time: 1241.99 s
Current children cumulated vsize: 13153548 KiB
Current children cumulated memory: 12975328 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/198 3396
/proc/meminfo: memFree=2911852/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=13759428 memory=13599660 CPUtime=1301.97 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3305883 0 0 0 129673 524 0 0 20 0 1 0 412197281 14089654272 3399915 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3439857 3399915 819 493 0 3433162 0
Current children cumulated CPU time: 1301.97 s
Current children cumulated vsize: 13759428 KiB
Current children cumulated memory: 13599660 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/197 3400
/proc/meminfo: memFree=1666896/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=14365308 memory=14226036 CPUtime=1361.96 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3457605 0 0 0 135641 555 0 0 20 0 1 0 412197281 14710075392 3556509 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3591327 3556509 819 493 0 3584632 0
Current children cumulated CPU time: 1361.96 s
Current children cumulated vsize: 14365308 KiB
Current children cumulated memory: 14226036 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/197 3406
/proc/meminfo: memFree=426516/32770624 swapFree=66932328/67108860
[pid=3261] ppid=3258 vsize=14971056 memory=14852404 CPUtime=1421.95 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3609300 0 0 0 141606 589 0 0 20 0 1 0 412197281 15330361344 3713101 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3742764 3713101 819 493 0 3736069 0
Current children cumulated CPU time: 1421.95 s
Current children cumulated vsize: 14971056 KiB
Current children cumulated memory: 14852404 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 1.99 1.97 3/197 3410
/proc/meminfo: memFree=190540/32770624 swapFree=66390520/67108860
[pid=3261] ppid=3258 vsize=15574428 memory=15472940 CPUtime=1481.94 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3760453 0 0 0 147573 621 0 0 20 0 1 0 412197281 15948214272 3732840 33554432000 4194304 6210612 140724994071536 140724994045096 5451401 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3893607 3732840 512 493 0 3886912 0
Current children cumulated CPU time: 1481.94 s
Current children cumulated vsize: 15574428 KiB
Current children cumulated memory: 15472940 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1512 s]*
/proc/loadavg: 2.00 1.99 1.97 3/197 3414
/proc/meminfo: memFree=198992/32770624 swapFree=65808908/67108860
[pid=3261] ppid=3258 vsize=15872352 memory=15781036 CPUtime=1511.64 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 4202496 3835060 0 0 0 150527 637 0 0 20 0 1 0 412197281 16253288448 3665742 33554432000 4194304 6210612 140724994071536 140724994045096 140308831808485 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3968088 3665742 512 493 0 3961393 0
Current children cumulated CPU time: 1511.64 s
Current children cumulated vsize: 15872352 KiB
Current children cumulated memory: 15781036 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1514.8 s]
# the end of solver process 3261 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1505.33 s, system=7.43632 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1512.8 s]
/proc/loadavg: 2.00 1.99 1.97 3/197 3414
/proc/meminfo: memFree=198992/32770624 swapFree=65808908/67108860
[pid=3261] ppid=3258 vsize=15873012 memory=15781824 CPUtime=1511.79 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) R 3258 3261 3213 0 -1 512 3841097 0 849 0 150533 646 0 0 20 0 1 0 412197281 16253964288 3672668 33554432000 4194304 6210612 140724994071536 140724994045096 5188952 0 16384 4096 8405026 0 0 0 17 3 0 0 57 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3968253 3672668 518 493 0 3961558 0
Current children cumulated CPU time: 1511.79 s
Current children cumulated vsize: 15873012 KiB
Current children cumulated memory: 15781824 KiB

[startup+1513.6 s]
/proc/loadavg: 2.00 1.99 1.97 4/198 3415
/proc/meminfo: memFree=189312/32770624 swapFree=65808964/67108860
[pid=3261] ppid=3258 vsize=15873012 memory=15781824 CPUtime=1512 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) D 3258 3261 3213 0 -1 512 3855257 0 2884 0 150533 667 0 0 20 0 1 0 412197281 16253964288 3688838 33554432000 4194304 6210612 140724994071536 140724994045096 5188952 0 16384 4096 8405026 18446744071580419444 0 0 17 3 0 0 119 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3968253 3688838 518 493 0 3961558 0
Current children cumulated CPU time: 1512 s
Current children cumulated vsize: 15873012 KiB
Current children cumulated memory: 15781824 KiB

[startup+1514 s]*
/proc/loadavg: 2.00 1.99 1.97 2/198 3415
/proc/meminfo: memFree=230096/32770624 swapFree=65808960/67108860
[pid=3261] ppid=3258 vsize=15873012 memory=15781824 CPUtime=1512 cores=1,3,5,7
/proc/3261/stat : 3261 (cosoco) D 3258 3261 3213 0 -1 512 3858126 0 3295 0 150533 667 0 0 20 0 1 0 412197281 16253964288 3692137 33554432000 4194304 6210612 140724994071536 140724994045096 5188952 0 16384 4096 8405026 18446744071580419444 0 0 17 3 0 0 152 0 0 8308220 8313664 35131392 140724994073611 140724994073713 140724994073713 140724994076622 0
/proc/3261/statm: 3968253 3692137 518 493 0 3961558 0
Current children cumulated CPU time: 1512 s
Current children cumulated vsize: 15873012 KiB
Current children cumulated memory: 15781824 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1514.8
CPU time (s): 1512.77
CPU user time (s): 1505.33
CPU system time (s): 7.43632
CPU usage (%): 99.8663
Max. virtual memory (cumulated for all children) (KiB): 15873012
Max. memory (cumulated for all children) (KiB): 15781824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1505.34
system time used= 7.43632
maximum resident set size= 14990096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3858126
page faults= 3296
swaps= 0
block input operations= 215576
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5464
involuntary context switches= 1903


# summary of solver processes directly reported to runsolver:
#   pid: 3261
#   total CPU time (s): 1512.77
#   total CPU user time (s): 1505.33
#   total CPU system time (s): 7.43632

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.46185 second user time and 10.072 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-13 09:23:18
IDJOB=4389930
IDBENCH=139658
IDSOLVER=2829
FILE ID=node139/4389930-1568359295
RUNJOBID= node139-1568359397-3245
PBS_JOBID= 21701203
Free space on /tmp= 55340 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_9_11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389930-1568359295/watcher-4389930-1568359295 -o /tmp/evaluation-result-4389930-1568359295/solver-4389930-1568359295 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568359397-3245 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389930-1568359295.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b3f80a69476de872363c069f96d9d14d
RANDOM SEED=531013002

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29317676 kB
MemAvailable:   31748124 kB
Buffers:           97764 kB
Cached:          2581124 kB
SwapCached:        73296 kB
Active:           355748 kB
Inactive:        2398172 kB
Active(anon):       8748 kB
Inactive(anon):   107228 kB
Active(file):     347000 kB
Inactive(file):  2290944 kB
Unevictable:      110720 kB
Mlocked:          110720 kB
SwapTotal:      67108860 kB
SwapFree:       66932328 kB
Dirty:              6484 kB
Writeback:         78440 kB
AnonPages:        114088 kB
Mapped:            42872 kB
Shmem:             32196 kB
Slab:             289948 kB
SReclaimable:     216680 kB
SUnreclaim:        73268 kB
KernelStack:        3360 kB
PageTables:         4912 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     494408 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 55224 MiB
End job on node139 at 2019-09-13 09:48:33