Trace number 4397076

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1375.43 1377.63

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-09-024-008.xml
MD5SUM0092e4980ed4af349e39cdcd3a0de294
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark2.49365
Satisfiable
(Un)Satisfiability was proved
Number of variables217
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size23
Distribution of domain sizes[{"size":2,"count":216},{"size":23,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":216},{"degree":37,"count":1}]
Minimum constraint arity24
Maximum constraint arity216
Distribution of constraint arities[{"arity":24,"count":9},{"arity":49,"count":36},{"arity":216,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8835 MiB free)
  memory of node 1: 16384 MiB (15149 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397076-1568577078/watcher-4397076-1568577078 -o /tmp/evaluation-result-4397076-1568577078/solver-4397076-1568577078 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568572746-32297 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4397076-1568577078.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=621, runsolver pid=617

[startup+0.100615 s]*
/proc/loadavg: 2.48 2.15 2.04 3/200 622
/proc/meminfo: memFree=24550132/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=28564 memory=5008 CPUtime=0.09 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 1414 0 0 0 9 0 0 0 20 0 1 0 433947521 29249536 1252 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 7141 1252 845 493 0 446 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 28564 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209681 s]*
/proc/loadavg: 2.48 2.15 2.04 3/200 622
/proc/meminfo: memFree=24550740/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=29676 memory=6064 CPUtime=0.2 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 1719 0 0 0 20 0 0 0 20 0 1 0 433947521 30388224 1516 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 7419 1516 846 493 0 724 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 29676 KiB
Current children cumulated memory: 6064 KiB

[startup+0.309611 s]*
/proc/loadavg: 2.48 2.15 2.04 3/200 622
/proc/meminfo: memFree=24553708/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=30816 memory=7244 CPUtime=0.31 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 1990 0 0 0 30 1 0 0 20 0 1 0 433947521 31555584 1811 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 7704 1811 846 493 0 1009 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30816 KiB
Current children cumulated memory: 7244 KiB

[startup+0.700389 s]
/proc/loadavg: 2.48 2.15 2.04 3/200 622
/proc/meminfo: memFree=24544880/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=35224 memory=11484 CPUtime=0.69 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 3065 0 0 0 68 1 0 0 20 0 1 0 433947521 36069376 2871 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 8806 2871 846 493 0 2111 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35224 KiB
Current children cumulated memory: 11484 KiB

[startup+1.50037 s]
/proc/loadavg: 2.48 2.15 2.04 3/200 622
/proc/meminfo: memFree=24532380/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=44252 memory=20480 CPUtime=1.49 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 5324 0 0 0 147 2 0 0 20 0 1 0 433947521 45314048 5120 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 11063 5120 846 493 0 4368 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 44252 KiB
Current children cumulated memory: 20480 KiB

[startup+3.11 s]
/proc/loadavg: 2.68 2.19 2.06 3/200 622
/proc/meminfo: memFree=25035132/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=63012 memory=38644 CPUtime=3.1 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 9933 0 0 0 308 2 0 0 20 0 1 0 433947521 64524288 9661 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 15753 9661 846 493 0 9058 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 63012 KiB
Current children cumulated memory: 38644 KiB

[startup+6.30027 s]
/proc/loadavg: 2.68 2.19 2.06 3/199 625
/proc/meminfo: memFree=25610580/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=100404 memory=75024 CPUtime=6.29 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 19023 0 0 0 626 3 0 0 20 0 1 0 433947521 102813696 18756 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 25101 18756 846 493 0 18406 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 100404 KiB
Current children cumulated memory: 75024 KiB

[startup+12.7003 s]
/proc/loadavg: 2.63 2.19 2.06 3/200 628
/proc/meminfo: memFree=25543252/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=171308 memory=147320 CPUtime=12.69 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 37208 0 0 0 1264 5 0 0 20 0 1 0 433947521 175419392 36830 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 42827 36830 846 493 0 36132 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 171308 KiB
Current children cumulated memory: 147320 KiB

[startup+25.5003 s]
/proc/loadavg: 2.49 2.18 2.05 3/200 653
/proc/meminfo: memFree=25395396/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=319232 memory=293416 CPUtime=25.48 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 71769 0 0 0 2540 8 0 0 20 0 1 0 433947521 326893568 73354 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 79808 73354 846 493 0 73113 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 319232 KiB
Current children cumulated memory: 293416 KiB

[startup+51.1093 s]
/proc/loadavg: 2.38 2.18 2.06 3/199 654
/proc/meminfo: memFree=25100128/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=618440 memory=583636 CPUtime=51.09 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 140781 0 0 0 5090 19 0 0 20 0 1 0 433947521 633282560 145909 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 154610 145909 846 493 0 147915 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 618440 KiB
Current children cumulated memory: 583636 KiB

[startup+102.3 s]
/proc/loadavg: 2.16 2.15 2.05 3/200 659
/proc/meminfo: memFree=24518504/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=1222620 memory=1165480 CPUtime=102.27 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 277537 0 0 0 10191 36 0 0 20 0 1 0 433947521 1251962880 291370 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 305655 291370 846 493 0 298960 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1222620 KiB
Current children cumulated memory: 1165480 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.13 2.05 3/199 663
/proc/meminfo: memFree=23838060/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=1915832 memory=1845312 CPUtime=162.25 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 437320 0 0 0 16167 58 0 0 20 0 1 0 433947521 1961811968 461328 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 478958 461328 846 493 0 472263 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1915832 KiB
Current children cumulated memory: 1845312 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.10 2.05 3/199 667
/proc/meminfo: memFree=23154968/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=2550620 memory=2526076 CPUtime=222.21 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 596332 0 0 0 22147 74 0 0 20 0 1 0 433947521 2611834880 631519 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 637655 631519 846 493 0 630960 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 2550620 KiB
Current children cumulated memory: 2526076 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.08 2.05 3/200 674
/proc/meminfo: memFree=22475764/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=3270480 memory=3206544 CPUtime=282.18 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 755786 0 0 0 28124 94 0 0 20 0 1 0 433947521 3348971520 801636 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 817620 801636 846 493 0 810925 0
Current children cumulated CPU time: 282.18 s
Current children cumulated vsize: 3270480 KiB
Current children cumulated memory: 3206544 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.07 2.05 3/199 678
/proc/meminfo: memFree=21793840/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=4033076 memory=3885356 CPUtime=342.15 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 915350 0 0 0 34103 112 0 0 20 0 1 0 433947521 4129869824 971339 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 1008269 971339 846 493 0 1001574 0
Current children cumulated CPU time: 342.15 s
Current children cumulated vsize: 4033076 KiB
Current children cumulated memory: 3885356 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/199 682
/proc/meminfo: memFree=21113448/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=4667600 memory=4564960 CPUtime=402.13 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 1074630 0 0 0 40080 133 0 0 20 0 1 0 433947521 4779622400 1141240 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 1166900 1141240 846 493 0 1160205 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 4667600 KiB
Current children cumulated memory: 4564960 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/200 689
/proc/meminfo: memFree=20430684/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=5307380 memory=5246428 CPUtime=462.1 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 1233912 0 0 0 46057 153 0 0 20 0 1 0 433947521 5434757120 1311607 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 1326845 1311607 846 493 0 1320150 0
Current children cumulated CPU time: 462.1 s
Current children cumulated vsize: 5307380 KiB
Current children cumulated memory: 5246428 KiB


################
# More data... #
################

Current children cumulated vsize: 9588688 KiB
Current children cumulated memory: 9324744 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 812
/proc/meminfo: memFree=15696592/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=10222156 memory=10004192 CPUtime=881.93 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 2346779 0 0 0 87877 316 0 0 20 0 1 0 433947521 10467487744 2501048 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 2555539 2501048 846 493 0 2548844 0
Current children cumulated CPU time: 881.93 s
Current children cumulated vsize: 10222156 KiB
Current children cumulated memory: 10004192 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 816
/proc/meminfo: memFree=14997288/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=10867088 memory=10684256 CPUtime=941.9 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 2505736 0 0 0 93849 341 0 0 20 0 1 0 433947521 11127898112 2671064 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 2716772 2671064 846 493 0 2710077 0
Current children cumulated CPU time: 941.9 s
Current children cumulated vsize: 10867088 KiB
Current children cumulated memory: 10684256 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 822
/proc/meminfo: memFree=14312248/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=11501480 memory=11363700 CPUtime=1001.88 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 2664553 0 0 0 99821 367 0 0 20 0 1 0 433947521 11777515520 2840925 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 2875370 2840925 846 493 0 2868675 0
Current children cumulated CPU time: 1001.88 s
Current children cumulated vsize: 11501480 KiB
Current children cumulated memory: 11363700 KiB

[startup+1062.3 s]
/proc/loadavg: 1.96 2.00 2.04 3/199 826
/proc/meminfo: memFree=13631088/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=12135212 memory=12042444 CPUtime=1061.85 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 2823201 0 0 0 105790 395 0 0 20 0 1 0 433947521 12426457088 3010611 33554432000 4194304 6211092 140733681061568 140733681046040 140566746204990 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3033803 3010611 846 493 0 3027108 0
Current children cumulated CPU time: 1061.85 s
Current children cumulated vsize: 12135212 KiB
Current children cumulated memory: 12042444 KiB

[startup+1122.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/199 830
/proc/meminfo: memFree=12950060/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=12768944 memory=12721192 CPUtime=1121.84 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 2981904 0 0 0 111760 424 0 0 20 0 1 0 433947521 13075398656 3180298 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3192236 3180298 846 493 0 3185541 0
Current children cumulated CPU time: 1121.84 s
Current children cumulated vsize: 12768944 KiB
Current children cumulated memory: 12721192 KiB

[startup+1182.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/201 844
/proc/meminfo: memFree=12269832/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=13823496 memory=13400052 CPUtime=1181.82 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 3141101 0 0 0 117726 456 0 0 20 0 1 0 433947521 14155259904 3350013 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3455874 3350013 846 493 0 3449179 0
Current children cumulated CPU time: 1181.82 s
Current children cumulated vsize: 13823496 KiB
Current children cumulated memory: 13400052 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 848
/proc/meminfo: memFree=11589800/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=14457228 memory=14078796 CPUtime=1241.81 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 3299769 0 0 0 123696 485 0 0 20 0 1 0 433947521 14804201472 3519699 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3614307 3519699 846 493 0 3607612 0
Current children cumulated CPU time: 1241.81 s
Current children cumulated vsize: 14457228 KiB
Current children cumulated memory: 14078796 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 852
/proc/meminfo: memFree=10910384/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15090564 memory=14757272 CPUtime=1301.8 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 3458350 0 0 0 129664 516 0 0 20 0 1 0 433947521 15452737536 3689318 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3772641 3689318 846 493 0 3765946 0
Current children cumulated CPU time: 1301.8 s
Current children cumulated vsize: 15090564 KiB
Current children cumulated memory: 14757272 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/201 858
/proc/meminfo: memFree=10231844/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15739776 memory=15436328 CPUtime=1361.78 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 3617097 0 0 0 135630 548 0 0 20 0 1 0 433947521 16117530624 3859082 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3934944 3859082 846 493 0 3928249 0
Current children cumulated CPU time: 1361.78 s
Current children cumulated vsize: 15739776 KiB
Current children cumulated memory: 15436328 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1374.9 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 858
/proc/meminfo: memFree=10093668/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15872436 memory=15577904 CPUtime=1374.37 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 4202496 3650471 0 0 0 136880 557 0 0 20 0 1 0 433947521 16253374464 3894476 33554432000 4194304 6211092 140733681061568 140733681046040 140566746209253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3968109 3894476 846 493 0 3961414 0
Current children cumulated CPU time: 1374.37 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15577904 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1377.63 s]
# the end of solver process 621 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1369.1 s, system=6.33725 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1376 s]*
/proc/loadavg: 2.00 2.00 2.04 3/201 859
/proc/meminfo: memFree=9467784/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15872436 memory=15577904 CPUtime=1374.55 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) S 617 621 32265 0 -1 512 3650477 0 0 0 136896 559 0 0 20 0 1 0 433947521 16253374464 3894476 33554432000 4194304 6211092 140733681061568 140733681046040 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3968109 3894476 846 493 0 3961414 0
Current children cumulated CPU time: 1374.55 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15577904 KiB

[startup+1376.4 s]
/proc/loadavg: 2.00 2.00 2.04 3/201 859
/proc/meminfo: memFree=9467784/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15872436 memory=15577904 CPUtime=1374.62 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) S 617 621 32265 0 -1 512 3650477 0 0 0 136902 560 0 0 20 0 1 0 433947521 16253374464 3894476 33554432000 4194304 6211092 140733681061568 140733681046040 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3968109 3894476 846 493 0 3961414 0
Current children cumulated CPU time: 1374.62 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15577904 KiB

[startup+1376.8 s]
/proc/loadavg: 2.00 2.00 2.04 3/201 859
/proc/meminfo: memFree=9467784/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15872436 memory=15577904 CPUtime=1374.68 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) R 617 621 32265 0 -1 512 3650477 0 0 0 136907 561 0 0 20 0 1 0 433947521 16253374464 3894476 33554432000 4194304 6211092 140733681061568 140733681046040 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3968109 3894476 846 493 0 3961414 0
Current children cumulated CPU time: 1374.68 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15577904 KiB

[startup+1376.9 s]
/proc/loadavg: 2.00 2.00 2.04 3/201 859
/proc/meminfo: memFree=9467784/32770624 swapFree=66941236/67108860
[pid=621] ppid=617 vsize=15872436 memory=15577904 CPUtime=1374.7 cores=1,3,5,7
/proc/621/stat : 621 (cosoco) S 617 621 32265 0 -1 512 3650477 0 0 0 136909 561 0 0 20 0 1 0 433947521 16253374464 3894476 33554432000 4194304 6211092 140733681061568 140733681046040 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 10559488 140733681067019 140733681067121 140733681067121 140733681070030 0
/proc/621/statm: 3968109 3894476 846 493 0 3961414 0
Current children cumulated CPU time: 1374.7 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15577904 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1377.63
CPU time (s): 1375.43
CPU user time (s): 1369.1
CPU system time (s): 6.33725
CPU usage (%): 99.8408
Max. virtual memory (cumulated for all children) (KiB): 15872436
Max. memory (cumulated for all children) (KiB): 15577904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1369.1
system time used= 6.33725
maximum resident set size= 15578016
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3650477
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 135985
involuntary context switches= 1538


# summary of solver processes directly reported to runsolver:
#   pid: 621
#   total CPU time (s): 1375.43
#   total CPU user time (s): 1369.1
#   total CPU system time (s): 6.33725

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.72927 second user time and 9.34301 second system time

The end

Launcher Data 

Begin job on node149 at 2019-09-15 21:50:42
IDJOB=4397076
IDBENCH=122987
IDSOLVER=2848
FILE ID=node149/4397076-1568577078
RUNJOBID= node149-1568572746-32297
PBS_JOBID= 21703308
Free space on /tmp= 60884 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-09-024-008.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397076-1568577078/watcher-4397076-1568577078 -o /tmp/evaluation-result-4397076-1568577078/solver-4397076-1568577078 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568572746-32297 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4397076-1568577078.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0092e4980ed4af349e39cdcd3a0de294
RANDOM SEED=823908379

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24559440 kB
MemAvailable:   31741120 kB
Buffers:          208164 kB
Cached:          7264552 kB
SwapCached:        61260 kB
Active:          2591868 kB
Inactive:        5030956 kB
Active(anon):     117740 kB
Inactive(anon):    80936 kB
Active(file):    2474128 kB
Inactive(file):  4950020 kB
Unevictable:      111216 kB
Mlocked:          111216 kB
SwapTotal:      67108860 kB
SwapFree:       66941236 kB
Dirty:            306232 kB
Writeback:         71704 kB
AnonPages:        201748 kB
Mapped:            49892 kB
Shmem:             39836 kB
Slab:             179292 kB
SReclaimable:     146736 kB
SUnreclaim:        32556 kB
KernelStack:        3488 kB
PageTables:         5984 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     624796 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    147456 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      144768 kB
DirectMap2M:    33400832 kB

Free space on /tmp at the end= 60888 MiB
End job on node149 at 2019-09-15 22:13:48