Trace number 4389938

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 2350.13 2352.58

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-09-350-100.xml
MD5SUM9444e44f99a0ffd374c39bd698e45a3a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark48
Best CPU time to get the best result obtained on this benchmark2520.13
Satisfiable
(Un)Satisfiability was proved
Number of variables3151
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size330
Distribution of domain sizes[{"size":2,"count":3150},{"size":330,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":3150},{"degree":37,"count":1}]
Minimum constraint arity350
Maximum constraint arity3150
Distribution of constraint arities[{"arity":350,"count":9},{"arity":701,"count":36},{"arity":3150,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13053 MiB free)
  memory of node 1: 16384 MiB (15717 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389938-1568321926/watcher-4389938-1568321926 -o /tmp/evaluation-result-4389938-1568321926/solver-4389938-1568321926 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node116-1568311136-6439 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389938-1568321926.xml 

running on 4 cores: 4-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=8646, runsolver pid=8643
Current StackSize limit: 8192 KiB


[startup+0.100163 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 8647
/proc/meminfo: memFree=29458684/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=30404 memory=6816 CPUtime=0.1 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 1912 0 0 0 10 0 0 0 20 0 1 0 408134301 31133696 1704 33554432000 4194304 6210612 140730691566352 140730691562888 140095538111384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 7601 1704 845 493 0 906 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30404 KiB
Current children cumulated memory: 6816 KiB

[startup+0.210834 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 8647
/proc/meminfo: memFree=29457940/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=31196 memory=7608 CPUtime=0.21 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 2099 0 0 0 21 0 0 0 20 0 1 0 408134301 31944704 1902 33554432000 4194304 6210612 140730691566352 140730691562888 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 7799 1902 845 493 0 1104 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31196 KiB
Current children cumulated memory: 7608 KiB

[startup+0.310201 s]*
/proc/loadavg: 2.00 2.01 2.05 4/199 8647
/proc/meminfo: memFree=29457568/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=31856 memory=8400 CPUtime=0.31 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 2268 0 0 0 31 0 0 0 20 0 1 0 408134301 32620544 2100 33554432000 4194304 6210612 140730691566352 140730691562888 5012647 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 7964 2100 845 493 0 1269 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31856 KiB
Current children cumulated memory: 8400 KiB

[startup+0.700275 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8647
/proc/meminfo: memFree=29455708/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=34364 memory=10776 CPUtime=0.69 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 2912 0 0 0 69 0 0 0 20 0 1 0 408134301 35188736 2694 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 8591 2694 845 493 0 1896 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 34364 KiB
Current children cumulated memory: 10776 KiB

[startup+1.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8647
/proc/meminfo: memFree=29452172/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=39776 memory=16320 CPUtime=1.49 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 4262 0 0 0 149 0 0 0 20 0 1 0 408134301 40730624 4080 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 9944 4080 845 493 0 3249 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 39776 KiB
Current children cumulated memory: 16320 KiB

[startup+3.11069 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8648
/proc/meminfo: memFree=29438880/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=50620 memory=27184 CPUtime=3.1 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 7165 0 0 0 310 0 0 0 20 0 1 0 408134301 51834880 6796 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 12655 6796 845 493 0 5960 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 50620 KiB
Current children cumulated memory: 27184 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8648
/proc/meminfo: memFree=29418804/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=72260 memory=48544 CPUtime=6.29 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 12740 0 0 0 628 1 0 0 20 0 1 0 408134301 73994240 12136 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 18065 12136 845 493 0 11370 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 72260 KiB
Current children cumulated memory: 48544 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8649
/proc/meminfo: memFree=29378084/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=115284 memory=91664 CPUtime=12.69 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 23698 0 0 0 1266 3 0 0 20 0 1 0 408134301 118050816 22916 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 28821 22916 845 493 0 22126 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 115284 KiB
Current children cumulated memory: 91664 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8649
/proc/meminfo: memFree=29290784/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=201692 memory=177984 CPUtime=25.49 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 45612 0 0 0 2542 7 0 0 20 0 1 0 408134301 206532608 44496 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 50423 44496 845 493 0 43728 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 201692 KiB
Current children cumulated memory: 177984 KiB

[startup+51.1108 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8651
/proc/meminfo: memFree=29114424/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=374624 memory=350584 CPUtime=51.1 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 88923 0 0 0 5096 14 0 0 20 0 1 0 408134301 383614976 87646 33554432000 4194304 6210612 140730691566352 140730691425640 5446058 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 93656 87646 845 493 0 86961 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 374624 KiB
Current children cumulated memory: 350584 KiB

[startup+102.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/200 8655
/proc/meminfo: memFree=28770132/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=720488 memory=695516 CPUtime=102.28 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 175346 0 0 0 10200 28 0 0 20 0 1 0 408134301 737779712 173879 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 180122 173879 845 493 0 173427 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 720488 KiB
Current children cumulated memory: 695516 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/202 8669
/proc/meminfo: memFree=28365000/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=1125512 memory=1100228 CPUtime=162.28 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 276480 0 0 0 16183 45 0 0 20 0 1 0 408134301 1152524288 275057 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 281378 275057 845 493 0 274683 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1125512 KiB
Current children cumulated memory: 1100228 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/202 8696
/proc/meminfo: memFree=27958652/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=1528640 memory=1504924 CPUtime=222.26 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 377676 0 0 0 22165 61 0 0 20 0 1 0 408134301 1565327360 376231 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 382160 376231 845 493 0 375465 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 1528640 KiB
Current children cumulated memory: 1504924 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/202 8700
/proc/meminfo: memFree=27551780/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=1934744 memory=1910820 CPUtime=282.23 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 478682 0 0 0 28145 78 0 0 20 0 1 0 408134301 1981177856 477705 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 483686 477705 845 493 0 476991 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 1934744 KiB
Current children cumulated memory: 1910820 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/202 8706
/proc/meminfo: memFree=27147760/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=2337740 memory=2314272 CPUtime=342.21 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 579561 0 0 0 34128 93 0 0 20 0 1 0 408134301 2393845760 578568 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 584435 578568 845 493 0 577740 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 2337740 KiB
Current children cumulated memory: 2314272 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 8710
/proc/meminfo: memFree=26740708/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=2745596 memory=2720860 CPUtime=402.19 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 680756 0 0 0 40107 112 0 0 20 0 1 0 408134301 2811490304 680215 33554432000 4194304 6210612 140730691566352 140730691425640 140095538101054 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 686399 680215 845 493 0 679704 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 2745596 KiB
Current children cumulated memory: 2720860 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8714
/proc/meminfo: memFree=26336328/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=3148460 memory=3123792 CPUtime=462.17 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 781540 0 0 0 46087 130 0 0 20 0 1 0 408134301 3224023040 780948 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 787115 780948 845 493 0 780420 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 3148460 KiB
Current children cumulated memory: 3123792 KiB


################
# More data... #
################

Current children cumulated vsize: 12069516 KiB
Current children cumulated memory: 12023848 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 8901
/proc/meminfo: memFree=2699660/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=12471852 memory=12428356 CPUtime=1841.68 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3101540 0 0 0 183522 646 0 0 20 0 1 0 408134301 12771176448 3107089 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3117963 3107089 845 493 0 3111268 0
Current children cumulated CPU time: 1841.68 s
Current children cumulated vsize: 12471852 KiB
Current children cumulated memory: 12428356 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8905
/proc/meminfo: memFree=1615892/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=12874188 memory=12832780 CPUtime=1901.66 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3202228 0 0 0 189493 673 0 0 20 0 1 0 408134301 13183168512 3208195 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3218547 3208195 845 493 0 3211852 0
Current children cumulated CPU time: 1901.66 s
Current children cumulated vsize: 12874188 KiB
Current children cumulated memory: 12832780 KiB

[startup+1962.3 s]
/proc/loadavg: 2.33 2.13 2.08 3/202 9049
/proc/meminfo: memFree=16574152/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=13276260 memory=13234716 CPUtime=1961.64 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3302834 0 0 0 195465 699 0 0 20 0 1 0 408134301 13594890240 3308679 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3319065 3308679 845 493 0 3312370 0
Current children cumulated CPU time: 1961.64 s
Current children cumulated vsize: 13276260 KiB
Current children cumulated memory: 13234716 KiB

[startup+2022.3 s]
/proc/loadavg: 2.12 2.10 2.08 3/200 9053
/proc/meminfo: memFree=16168440/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=13678200 memory=13638692 CPUtime=2021.62 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3403437 0 0 0 201433 729 0 0 20 0 1 0 408134301 14006476800 3409673 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3419550 3409673 845 493 0 3412855 0
Current children cumulated CPU time: 2021.62 s
Current children cumulated vsize: 13678200 KiB
Current children cumulated memory: 13638692 KiB

[startup+2082.3 s]
/proc/loadavg: 2.05 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15815320/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=14080272 memory=14042932 CPUtime=2081.6 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3504053 0 0 0 207401 759 0 0 20 0 1 0 408134301 14418198528 3510733 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3520068 3510733 845 493 0 3513373 0
Current children cumulated CPU time: 2081.6 s
Current children cumulated vsize: 14080272 KiB
Current children cumulated memory: 14042932 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/203 9125
/proc/meminfo: memFree=15410004/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=14482344 memory=14446868 CPUtime=2141.59 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3604671 0 0 0 213370 789 0 0 20 0 1 0 408134301 14829920256 3611717 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3620586 3611717 845 493 0 3613891 0
Current children cumulated CPU time: 2141.59 s
Current children cumulated vsize: 14482344 KiB
Current children cumulated memory: 14446868 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/202 9129
/proc/meminfo: memFree=15005408/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=14884416 memory=14851076 CPUtime=2201.58 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3705306 0 0 0 219341 817 0 0 20 0 1 0 408134301 15241641984 3712769 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3721104 3712769 845 493 0 3714409 0
Current children cumulated CPU time: 2201.58 s
Current children cumulated vsize: 14884416 KiB
Current children cumulated memory: 14851076 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/200 9133
/proc/meminfo: memFree=14600344/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15286224 memory=15254972 CPUtime=2261.57 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3805897 0 0 0 225308 849 0 0 20 0 1 0 408134301 15653093376 3813743 33554432000 4194304 6210612 140730691566352 140730691425640 140095538105317 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3821556 3813743 845 493 0 3814861 0
Current children cumulated CPU time: 2261.57 s
Current children cumulated vsize: 15286224 KiB
Current children cumulated memory: 15254972 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 9139
/proc/meminfo: memFree=14197096/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15688164 memory=15656908 CPUtime=2321.55 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3906487 0 0 0 231277 878 0 0 20 0 1 0 408134301 16064679936 3914227 33554432000 4194304 6210612 140730691566352 140730691425640 5478512 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3922041 3914227 845 493 0 3915346 0
Current children cumulated CPU time: 2321.55 s
Current children cumulated vsize: 15688164 KiB
Current children cumulated memory: 15656908 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2349.8 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 9140
/proc/meminfo: memFree=14014432/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15872436 memory=15843248 CPUtime=2349.05 cores=4-7
/proc/8646/stat : 8646 (cosoco) R 8643 8646 6407 0 -1 4202496 3952600 0 0 0 234012 893 0 0 20 0 1 0 408134301 16253374464 3960812 33554432000 4194304 6210612 140730691566352 140730691425640 140095548050319 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3968109 3960812 845 493 0 3961414 0
Current children cumulated CPU time: 2349.05 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15843248 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2352.58 s]
# the end of solver process 8646 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2340.37 s, system=9.76568 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2350.4 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 9141
/proc/meminfo: memFree=13911868/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15872436 memory=15843248 CPUtime=2349.14 cores=4-7
/proc/8646/stat : 8646 (cosoco) S 8643 8646 6407 0 -1 512 3952604 0 0 0 234020 894 0 0 20 0 1 0 408134301 16253374464 3960812 33554432000 4194304 6210612 140730691566352 140730691425640 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3968109 3960812 845 493 0 3961414 0
Current children cumulated CPU time: 2349.14 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15843248 KiB

[startup+2351.2 s]
/proc/loadavg: 2.00 2.04 2.05 2/200 9141
/proc/meminfo: memFree=13445380/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15872436 memory=15843248 CPUtime=2349.25 cores=4-7
/proc/8646/stat : 8646 (cosoco) S 8643 8646 6407 0 -1 512 3952604 0 0 0 234028 897 0 0 20 0 1 0 408134301 16253374464 3960812 33554432000 4194304 6210612 140730691566352 140730691425640 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3968109 3960812 845 493 0 3961414 0
Current children cumulated CPU time: 2349.25 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15843248 KiB

[startup+2351.6 s]
/proc/loadavg: 2.00 2.04 2.05 2/200 9141
/proc/meminfo: memFree=13445380/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15872436 memory=15843248 CPUtime=2349.31 cores=4-7
/proc/8646/stat : 8646 (cosoco) S 8643 8646 6407 0 -1 512 3952604 0 0 0 234033 898 0 0 20 0 1 0 408134301 16253374464 3960812 33554432000 4194304 6210612 140730691566352 140730691425640 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3968109 3960812 845 493 0 3961414 0
Current children cumulated CPU time: 2349.31 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15843248 KiB

[startup+2351.8 s]
/proc/loadavg: 2.00 2.04 2.05 2/200 9141
/proc/meminfo: memFree=13445380/32770688 swapFree=66960952/67108860
[pid=8646] ppid=8643 vsize=15872436 memory=15843248 CPUtime=2349.34 cores=4-7
/proc/8646/stat : 8646 (cosoco) S 8643 8646 6407 0 -1 512 3952604 0 0 0 234036 898 0 0 20 0 1 0 408134301 16253374464 3960812 33554432000 4194304 6210612 140730691566352 140730691425640 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8308220 8313664 26710016 140730691572747 140730691572849 140730691572849 140730691575758 0
/proc/8646/statm: 3968109 3960812 845 493 0 3961414 0
Current children cumulated CPU time: 2349.34 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15843248 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2352.58
CPU time (s): 2350.13
CPU user time (s): 2340.37
CPU system time (s): 9.76568
CPU usage (%): 99.896
Max. virtual memory (cumulated for all children) (KiB): 15872436
Max. memory (cumulated for all children) (KiB): 15843248

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2340.37
system time used= 9.76568
maximum resident set size= 15843332
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3952604
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 117827
involuntary context switches= 2991


# summary of solver processes directly reported to runsolver:
#   pid: 8646
#   total CPU time (s): 2350.13
#   total CPU user time (s): 2340.37
#   total CPU system time (s): 9.76568

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.1746 second user time and 17.3421 second system time

The end

Launcher Data 

Begin job on node116 at 2019-09-12 22:58:05
IDJOB=4389938
IDBENCH=122967
IDSOLVER=2829
FILE ID=node116/4389938-1568321926
RUNJOBID= node116-1568311136-6439
PBS_JOBID= 21701125
Free space on /tmp= 56884 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-09-350-100.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389938-1568321926/watcher-4389938-1568321926 -o /tmp/evaluation-result-4389938-1568321926/solver-4389938-1568321926 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node116-1568311136-6439 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389938-1568321926.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9444e44f99a0ffd374c39bd698e45a3a
RANDOM SEED=1449898279

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        29462328 kB
MemAvailable:   31694060 kB
Buffers:           76224 kB
Cached:          2430292 kB
SwapCached:        46464 kB
Active:           963176 kB
Inactive:        1746320 kB
Active(anon):     155268 kB
Inactive(anon):    88236 kB
Active(file):     807908 kB
Inactive(file):  1658084 kB
Unevictable:      110244 kB
Mlocked:          110244 kB
SwapTotal:      67108860 kB
SwapFree:       66960952 kB
Dirty:              2824 kB
Writeback:             0 kB
AnonPages:        277952 kB
Mapped:            44544 kB
Shmem:             31868 kB
Slab:             191568 kB
SReclaimable:     163152 kB
SUnreclaim:        28416 kB
KernelStack:        3760 kB
PageTables:         5916 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     679768 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    225280 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 56428 MiB
End job on node116 at 2019-09-12 23:37:18