Trace number 4408968

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1173.98 1176.04

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-15-015-004.xml
MD5SUM1a7c138b4bdf03d361f31c5b4036df8a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark2.19765
Satisfiable
(Un)Satisfiability was proved
Number of variables226
Number of constraints121
Number of domains2
Minimum domain size2
Maximum domain size15
Distribution of domain sizes[{"size":2,"count":225},{"size":15,"count":1}]
Minimum variable degree16
Maximum variable degree106
Distribution of variable degrees[{"degree":16,"count":225},{"degree":106,"count":1}]
Minimum constraint arity15
Maximum constraint arity225
Distribution of constraint arities[{"arity":15,"count":15},{"arity":31,"count":105},{"arity":225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":120}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15423 MiB free)
  memory of node 1: 16384 MiB (15031 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408968-1569794235/watcher-4408968-1569794235 -o /tmp/evaluation-result-4408968-1569794235/solver-4408968-1569794235 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node149-1569787356-4538 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408968-1569794235.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=5793, runsolver pid=5790
Current StackSize limit: 8192 KiB


[startup+0.100147 s]*
/proc/loadavg: 2.17 2.06 2.06 3/200 5794
/proc/meminfo: memFree=31184580/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=28796 memory=5008 CPUtime=0.1 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 1471 0 0 0 10 0 0 0 20 0 1 0 555662125 29487104 1252 33554432000 4194304 6211132 140732785582448 140732785578984 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 7199 1252 846 493 0 504 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28796 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209733 s]*
/proc/loadavg: 2.17 2.06 2.06 3/200 5794
/proc/meminfo: memFree=31183092/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=30324 memory=6440 CPUtime=0.21 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 1827 0 0 0 21 0 0 0 20 0 1 0 555662125 31051776 1610 33554432000 4194304 6211132 140732785582448 140732785578984 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 7581 1610 846 493 0 886 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30324 KiB
Current children cumulated memory: 6440 KiB

[startup+0.309688 s]*
/proc/loadavg: 2.17 2.06 2.06 3/200 5794
/proc/meminfo: memFree=31181976/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=31572 memory=7832 CPUtime=0.31 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2150 0 0 0 31 0 0 0 20 0 1 0 555662125 32329728 1958 33554432000 4194304 6211132 140732785582448 140732785578984 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 7893 1958 846 493 0 1198 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31572 KiB
Current children cumulated memory: 7832 KiB

[startup+0.70034 s]
/proc/loadavg: 2.17 2.06 2.06 3/200 5794
/proc/meminfo: memFree=31179312/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=36800 memory=12808 CPUtime=0.69 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 3396 0 0 0 69 0 0 0 20 0 1 0 555662125 37683200 3202 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 9200 3202 846 493 0 2505 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36800 KiB
Current children cumulated memory: 12808 KiB

[startup+1.50032 s]
/proc/loadavg: 2.17 2.06 2.06 3/200 5794
/proc/meminfo: memFree=31172644/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=46884 memory=23080 CPUtime=1.49 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 5997 0 0 0 149 0 0 0 20 0 1 0 555662125 48009216 5770 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 11721 5770 846 493 0 5026 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 46884 KiB
Current children cumulated memory: 23080 KiB

[startup+4.35846 s]
/proc/loadavg: 2.17 2.06 2.06 3/200 5794
/proc/meminfo: memFree=31172644/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=85220 memory=60308 CPUtime=4.34 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 15374 0 0 0 433 1 0 0 20 0 1 0 555662125 87265280 15077 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 21305 15077 846 493 0 14610 0
Current children cumulated CPU time: 4.34 s
Current children cumulated vsize: 85220 KiB
Current children cumulated memory: 60308 KiB

[startup+6.30029 s]
/proc/loadavg: 2.24 2.07 2.06 3/200 5794
/proc/meminfo: memFree=31085436/32770624 swapFree=66942732/67108860
[pid=5793] ppid=5790 vsize=111356 memory=86652 CPUtime=6.29 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 21432 0 0 0 627 2 0 0 20 0 1 0 555662125 114028544 21663 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 27839 21663 846 493 0 21144 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 111356 KiB
Current children cumulated memory: 86652 KiB

[startup+12.7002 s]*
/proc/loadavg: 2.30 2.09 2.07 3/199 5797
/proc/meminfo: memFree=31739720/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=199064 memory=168768 CPUtime=12.7 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 41488 0 0 0 1265 5 0 0 20 0 1 0 555662125 203841536 42192 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 49766 42192 846 493 0 43071 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 199064 KiB
Current children cumulated memory: 168768 KiB

[startup+25.5002 s]
/proc/loadavg: 2.33 2.10 2.07 3/199 5797
/proc/meminfo: memFree=31582864/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=361156 memory=336968 CPUtime=25.48 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 79989 0 0 0 2539 9 0 0 20 0 1 0 555662125 369823744 84242 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 90289 84242 846 493 0 83594 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 361156 KiB
Current children cumulated memory: 336968 KiB

[startup+51.1002 s]
/proc/loadavg: 2.20 2.09 2.07 3/199 5800
/proc/meminfo: memFree=31245060/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=705140 memory=668268 CPUtime=51.08 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 156743 0 0 0 5089 19 0 0 20 0 1 0 555662125 722063360 167067 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 176285 167067 846 493 0 169590 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 705140 KiB
Current children cumulated memory: 668268 KiB

[startup+102.3 s]
/proc/loadavg: 2.09 2.08 2.06 3/199 5805
/proc/meminfo: memFree=30580760/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=1404400 memory=1334260 CPUtime=102.28 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 308397 0 0 0 10187 41 0 0 20 0 1 0 555662125 1438105600 333565 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 351100 333565 846 493 0 344405 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1404400 KiB
Current children cumulated memory: 1334260 KiB

[startup+162.3 s]
/proc/loadavg: 2.11 2.08 2.06 3/199 5809
/proc/meminfo: memFree=29800548/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=2196184 memory=2113724 CPUtime=162.26 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 484908 0 0 0 16164 62 0 0 20 0 1 0 555662125 2248892416 528431 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 549046 528431 846 493 0 542351 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 2196184 KiB
Current children cumulated memory: 2113724 KiB

[startup+222.3 s]
/proc/loadavg: 2.04 2.07 2.06 3/200 5823
/proc/meminfo: memFree=29018040/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=3032872 memory=2893792 CPUtime=222.24 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 661541 0 0 0 22141 83 0 0 20 0 1 0 555662125 3105660928 723448 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 758218 723448 846 493 0 751523 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 3032872 KiB
Current children cumulated memory: 2893792 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.06 2.05 3/200 5852
/proc/meminfo: memFree=28238732/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=3750724 memory=3673128 CPUtime=282.23 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 837478 0 0 0 28116 107 0 0 20 0 1 0 555662125 3840741376 918282 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 937681 918282 846 493 0 930986 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 3750724 KiB
Current children cumulated memory: 3673128 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/200 5856
/proc/meminfo: memFree=27456736/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=4638764 memory=4452152 CPUtime=342.21 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 1013340 0 0 0 34089 132 0 0 20 0 1 0 555662125 4750094336 1113038 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 1159691 1113038 846 493 0 1152996 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 4638764 KiB
Current children cumulated memory: 4452152 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 5923
/proc/meminfo: memFree=26695260/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=5364552 memory=5231128 CPUtime=402.19 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 1189237 0 0 0 40062 157 0 0 20 0 1 0 555662125 5493301248 1307782 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 1341138 1307782 846 493 0 1334443 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 5364552 KiB
Current children cumulated memory: 5231128 KiB

[startup+462.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/200 5992
/proc/meminfo: memFree=25915636/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=6065340 memory=6009528 CPUtime=462.17 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 1364521 0 0 0 46035 182 0 0 20 0 1 0 555662125 6210908160 1502382 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 1516335 1502382 846 493 0 1509640 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 6065340 KiB
Current children cumulated memory: 6009528 KiB


################
# More data... #
################

Current children cumulated vsize: 7784372 KiB
Current children cumulated memory: 7566556 KiB

[startup+642.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 6069
/proc/meminfo: memFree=23575292/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=8485160 memory=8346952 CPUtime=642.11 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 1891331 0 0 0 63948 263 0 0 20 0 1 0 555662125 8688803840 2086738 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 2121290 2086738 846 493 0 2114595 0
Current children cumulated CPU time: 642.11 s
Current children cumulated vsize: 8485160 KiB
Current children cumulated memory: 8346952 KiB

[startup+702.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 6074
/proc/meminfo: memFree=22795364/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=9185684 memory=9125488 CPUtime=702.08 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2066586 0 0 0 69917 291 0 0 20 0 1 0 555662125 9406140416 2281372 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 2296421 2281372 846 493 0 2289726 0
Current children cumulated CPU time: 702.08 s
Current children cumulated vsize: 9185684 KiB
Current children cumulated memory: 9125488 KiB

[startup+762.3 s]
/proc/loadavg: 1.96 2.00 2.04 3/199 6080
/proc/meminfo: memFree=22015476/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=10361996 memory=9901844 CPUtime=762.06 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2242867 0 0 0 75889 317 0 0 20 0 1 0 555662125 10610683904 2475461 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 2590499 2475461 846 493 0 2583804 0
Current children cumulated CPU time: 762.06 s
Current children cumulated vsize: 10361996 KiB
Current children cumulated memory: 9901844 KiB

[startup+822.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/199 6156
/proc/meminfo: memFree=21236624/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=11062256 memory=10679848 CPUtime=822.05 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2418062 0 0 0 81857 348 0 0 20 0 1 0 555662125 11327750144 2669962 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 2765564 2669962 846 493 0 2758869 0
Current children cumulated CPU time: 822.05 s
Current children cumulated vsize: 11062256 KiB
Current children cumulated memory: 10679848 KiB

[startup+882.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/199 6160
/proc/meminfo: memFree=20456256/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=11762912 memory=11460352 CPUtime=882.03 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2593362 0 0 0 87828 375 0 0 20 0 1 0 555662125 12045221888 2865088 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 2940728 2865088 846 493 0 2934033 0
Current children cumulated CPU time: 882.03 s
Current children cumulated vsize: 11762912 KiB
Current children cumulated memory: 11460352 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 6166
/proc/meminfo: memFree=19676976/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=12463436 memory=12238624 CPUtime=942 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2768589 0 0 0 93797 403 0 0 20 0 1 0 555662125 12762558464 3059656 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3115859 3059656 846 493 0 3109164 0
Current children cumulated CPU time: 942 s
Current children cumulated vsize: 12463436 KiB
Current children cumulated memory: 12238624 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 6170
/proc/meminfo: memFree=18896428/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=13163828 memory=13014772 CPUtime=1001.99 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 2943833 0 0 0 99767 432 0 0 20 0 1 0 555662125 13479759872 3253693 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3290957 3253693 846 493 0 3284262 0
Current children cumulated CPU time: 1001.99 s
Current children cumulated vsize: 13163828 KiB
Current children cumulated memory: 13014772 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 6174
/proc/meminfo: memFree=18118144/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=13863692 memory=13794480 CPUtime=1061.97 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 3118930 0 0 0 105730 467 0 0 20 0 1 0 555662125 14196420608 3448620 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3465923 3448620 846 493 0 3459228 0
Current children cumulated CPU time: 1061.97 s
Current children cumulated vsize: 13863692 KiB
Current children cumulated memory: 13794480 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 6241
/proc/meminfo: memFree=17338888/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=15194188 memory=14569768 CPUtime=1121.95 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 3294942 0 0 0 111697 498 0 0 20 0 1 0 555662125 15558848512 3642442 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3798547 3642442 846 493 0 3791852 0
Current children cumulated CPU time: 1121.95 s
Current children cumulated vsize: 15194188 KiB
Current children cumulated memory: 14569768 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1173.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 6244
/proc/meminfo: memFree=16675580/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=15872024 memory=15231492 CPUtime=1172.94 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 4202496 3444093 0 0 0 116764 530 0 0 20 0 1 0 555662125 16252952576 3807873 33554432000 4194304 6211132 140732785582448 140732785570376 139713070558181 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3968006 3807873 846 493 0 3961311 0
Current children cumulated CPU time: 1172.94 s
Current children cumulated vsize: 15872024 KiB
Current children cumulated memory: 15231492 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1176.04 s]
# the end of solver process 5793 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1167.92 s, system=6.06098 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1173.9 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 6245
/proc/meminfo: memFree=16441940/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=15872024 memory=15231492 CPUtime=1173.02 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) S 5790 5793 4507 0 -1 512 3444098 0 0 0 116772 530 0 0 20 0 1 0 555662125 16252952576 3807873 33554432000 4194304 6211132 140732785582448 140732785570376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3968006 3807873 846 493 0 3961311 0
Current children cumulated CPU time: 1173.02 s
Current children cumulated vsize: 15872024 KiB
Current children cumulated memory: 15231492 KiB

[startup+1174.7 s]*
/proc/loadavg: 2.00 2.00 2.04 3/200 6245
/proc/meminfo: memFree=15910228/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=15872024 memory=15231492 CPUtime=1173.14 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 512 3444098 0 0 0 116783 531 0 0 20 0 1 0 555662125 16252952576 3807873 33554432000 4194304 6211132 140732785582448 140732785570376 5189800 0 16384 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3968006 3807873 846 493 0 3961311 0
Current children cumulated CPU time: 1173.14 s
Current children cumulated vsize: 15872024 KiB
Current children cumulated memory: 15231492 KiB

[startup+1175.1 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 6245
/proc/meminfo: memFree=15910228/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=15872024 memory=15231492 CPUtime=1173.21 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) S 5790 5793 4507 0 -1 512 3444098 0 0 0 116789 532 0 0 20 0 1 0 555662125 16252952576 3807873 33554432000 4194304 6211132 140732785582448 140732785570376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3968006 3807873 846 493 0 3961311 0
Current children cumulated CPU time: 1173.21 s
Current children cumulated vsize: 15872024 KiB
Current children cumulated memory: 15231492 KiB

[startup+1175.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 6245
/proc/meminfo: memFree=15910228/32770624 swapFree=66943220/67108860
[pid=5793] ppid=5790 vsize=15872024 memory=15231492 CPUtime=1173.24 cores=0,2,4,6
/proc/5793/stat : 5793 (cosoco) R 5790 5793 4507 0 -1 512 3444098 0 0 0 116792 532 0 0 20 0 1 0 555662125 16252952576 3807873 33554432000 4194304 6211132 140732785582448 140732785570376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 41750528 140732785587211 140732785587313 140732785587313 140732785590222 0
/proc/5793/statm: 3968006 3807873 846 493 0 3961311 0
Current children cumulated CPU time: 1173.24 s
Current children cumulated vsize: 15872024 KiB
Current children cumulated memory: 15231492 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1176.04
CPU time (s): 1173.98
CPU user time (s): 1167.92
CPU system time (s): 6.06098
CPU usage (%): 99.8253
Max. virtual memory (cumulated for all children) (KiB): 15872024
Max. memory (cumulated for all children) (KiB): 15231492

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1167.92
system time used= 6.06098
maximum resident set size= 15231592
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3444098
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 132792
involuntary context switches= 1377


# summary of solver processes directly reported to runsolver:
#   pid: 5793
#   total CPU time (s): 1173.98
#   total CPU user time (s): 1167.92
#   total CPU system time (s): 6.06098

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.2617 second user time and 7.91689 second system time

The end

Launcher Data 

Begin job on node149 at 2019-09-29 23:56:37
IDJOB=4408968
IDBENCH=122978
IDSOLVER=2876
FILE ID=node149/4408968-1569794235
RUNJOBID= node149-1569787356-4538
PBS_JOBID= 21705816
Free space on /tmp= 61680 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-15-015-004.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408968-1569794235/watcher-4408968-1569794235 -o /tmp/evaluation-result-4408968-1569794235/solver-4408968-1569794235 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node149-1569787356-4538 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408968-1569794235.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1a7c138b4bdf03d361f31c5b4036df8a
RANDOM SEED=1325208734

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31186084 kB
MemAvailable:   31905696 kB
Buffers:          102356 kB
Cached:           901548 kB
SwapCached:         4688 kB
Active:           161660 kB
Inactive:         870560 kB
Active(anon):      35452 kB
Inactive(anon):    19448 kB
Active(file):     126208 kB
Inactive(file):   851112 kB
Unevictable:      109488 kB
Mlocked:          109488 kB
SwapTotal:      67108860 kB
SwapFree:       66942732 kB
Dirty:            551568 kB
Writeback:         78964 kB
AnonPages:        135124 kB
Mapped:            29156 kB
Shmem:             17836 kB
Slab:             145460 kB
SReclaimable:     116252 kB
SUnreclaim:        29208 kB
KernelStack:        3472 kB
PageTables:         5588 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     591828 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      144768 kB
DirectMap2M:    33400832 kB

Free space on /tmp at the end= 61508 MiB
End job on node149 at 2019-09-30 00:16:13