Trace number 4398337

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (TO) 2520.75 2523.05

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-038-010.xml
MD5SUM8e449228b7b3cf049a5fccac2aa13fe6
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark4.37968
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size37
Distribution of domain sizes[{"size":2,"count":380},{"size":37,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":380},{"degree":46,"count":1}]
Minimum constraint arity38
Maximum constraint arity380
Distribution of constraint arities[{"arity":38,"count":10},{"arity":77,"count":45},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13785 MiB free)
  memory of node 1: 16384 MiB (14179 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398337-1568600454/watcher-4398337-1568600454 -o /tmp/evaluation-result-4398337-1568600454/solver-4398337-1568600454 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node124-1568597886-8567 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398337-1568600454.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=8964, runsolver pid=8961


[startup+0.100154 s]*
/proc/loadavg: 8.68 8.78 8.02 2/193 8967
/proc/meminfo: memFree=28633528/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=30032 memory=6528 CPUtime=0.1 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 1807 0 0 0 10 0 0 0 20 0 1 0 435985505 30752768 1632 33554432000 4194304 6211092 140736315393168 140736315389704 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 7508 1632 846 493 0 813 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30032 KiB
Current children cumulated memory: 6528 KiB

[startup+0.209177 s]*
/proc/loadavg: 8.68 8.78 8.02 2/193 8967
/proc/meminfo: memFree=28632412/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=31140 memory=7320 CPUtime=0.21 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 2056 0 0 0 21 0 0 0 20 0 1 0 435985505 31887360 1830 33554432000 4194304 6211092 140736315393168 140736315372264 5012856 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 7785 1830 846 493 0 1090 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31140 KiB
Current children cumulated memory: 7320 KiB

[startup+0.308792 s]*
/proc/loadavg: 8.68 8.78 8.02 2/193 8967
/proc/meminfo: memFree=28631668/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=31972 memory=8376 CPUtime=0.31 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 2282 0 0 0 31 0 0 0 20 0 1 0 435985505 32739328 2094 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 7993 2094 846 493 0 1298 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31972 KiB
Current children cumulated memory: 8376 KiB

[startup+0.700329 s]
/proc/loadavg: 8.68 8.78 8.02 2/193 8967
/proc/meminfo: memFree=28629808/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=35612 memory=11788 CPUtime=0.69 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 3158 0 0 0 69 0 0 0 20 0 1 0 435985505 36466688 2947 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 8903 2947 846 493 0 2208 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35612 KiB
Current children cumulated memory: 11788 KiB

[startup+1.50033 s]
/proc/loadavg: 8.68 8.78 8.02 2/193 8967
/proc/meminfo: memFree=28626084/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=42952 memory=19068 CPUtime=1.49 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4983 0 0 0 149 0 0 0 20 0 1 0 435985505 43982848 4767 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 10738 4767 846 493 0 4043 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 42952 KiB
Current children cumulated memory: 19068 KiB

[startup+3.10871 s]
/proc/loadavg: 8.06 8.65 7.98 2/193 8967
/proc/meminfo: memFree=28608096/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=58144 memory=33956 CPUtime=3.1 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 8771 0 0 0 309 1 0 0 20 0 1 0 435985505 59539456 8489 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 14536 8489 846 493 0 7841 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 58144 KiB
Current children cumulated memory: 33956 KiB

[startup+6.30032 s]
/proc/loadavg: 8.06 8.65 7.98 2/192 8967
/proc/meminfo: memFree=28580672/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=86824 memory=63040 CPUtime=6.29 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 16177 0 0 0 627 2 0 0 20 0 1 0 435985505 88907776 15760 33554432000 4194304 6211092 140736315393168 140736315372264 5012966 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 21706 15760 846 493 0 15011 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 86824 KiB
Current children cumulated memory: 63040 KiB

[startup+12.7003 s]
/proc/loadavg: 6.98 8.40 7.90 2/192 8967
/proc/meminfo: memFree=28526036/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=146268 memory=121412 CPUtime=12.68 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 30912 0 0 0 1265 3 0 0 20 0 1 0 435985505 149778432 30353 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 36567 30353 846 493 0 29872 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 146268 KiB
Current children cumulated memory: 121412 KiB

[startup+25.5003 s]
/proc/loadavg: 6.06 8.16 7.83 2/192 8967
/proc/meminfo: memFree=28406000/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=266016 memory=239584 CPUtime=25.47 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 60146 0 0 0 2540 7 0 0 20 0 1 0 435985505 272400384 59896 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 66504 59896 846 493 0 59809 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 266016 KiB
Current children cumulated memory: 239584 KiB

[startup+51.1087 s]
/proc/loadavg: 4.33 7.58 7.65 2/193 8970
/proc/meminfo: memFree=28169168/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=496644 memory=472448 CPUtime=51.07 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 116431 0 0 0 5092 15 0 0 20 0 1 0 435985505 508563456 118112 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 124161 118112 846 493 0 117466 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 496644 KiB
Current children cumulated memory: 472448 KiB

[startup+102.3 s]
/proc/loadavg: 2.33 6.48 7.27 2/192 8973
/proc/meminfo: memFree=27703452/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=970460 memory=941508 CPUtime=102.24 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 229199 0 0 0 10194 30 0 0 20 0 1 0 435985505 993751040 235377 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 242615 235377 846 493 0 235920 0
Current children cumulated CPU time: 102.24 s
Current children cumulated vsize: 970460 KiB
Current children cumulated memory: 941508 KiB

[startup+162.3 s]
/proc/loadavg: 1.49 5.48 6.87 2/192 8976
/proc/meminfo: memFree=27155172/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=1518464 memory=1489344 CPUtime=162.2 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 360562 0 0 0 16173 47 0 0 20 0 1 0 435985505 1554907136 372336 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 379616 372336 846 493 0 372921 0
Current children cumulated CPU time: 162.2 s
Current children cumulated vsize: 1518464 KiB
Current children cumulated memory: 1489344 KiB

[startup+222.3 s]
/proc/loadavg: 1.18 4.66 6.51 2/192 8979
/proc/meminfo: memFree=26605984/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=2078788 memory=2035552 CPUtime=222.18 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 491968 0 0 0 22156 62 0 0 20 0 1 0 435985505 2128678912 508888 33554432000 4194304 6211092 140736315393168 140736315372264 5446279 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 519697 508888 846 493 0 513002 0
Current children cumulated CPU time: 222.18 s
Current children cumulated vsize: 2078788 KiB
Current children cumulated memory: 2035552 KiB

[startup+282.3 s]
/proc/loadavg: 1.07 4.00 6.16 2/192 8984
/proc/meminfo: memFree=26057588/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=2657908 memory=2583544 CPUtime=282.15 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 623477 0 0 0 28137 78 0 0 20 0 1 0 435985505 2721697792 645886 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 664477 645886 846 493 0 657782 0
Current children cumulated CPU time: 282.15 s
Current children cumulated vsize: 2657908 KiB
Current children cumulated memory: 2583544 KiB

[startup+342.3 s]
/proc/loadavg: 0.99 3.44 5.83 2/191 8988
/proc/meminfo: memFree=25510024/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=3181720 memory=3131660 CPUtime=342.13 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 754463 0 0 0 34120 93 0 0 20 0 1 0 435985505 3258081280 782915 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 795430 782915 846 493 0 788735 0
Current children cumulated CPU time: 342.13 s
Current children cumulated vsize: 3181720 KiB
Current children cumulated memory: 3131660 KiB

[startup+402.3 s]
/proc/loadavg: 1.00 2.99 5.53 2/191 8991
/proc/meminfo: memFree=24959552/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=3704440 memory=3679428 CPUtime=402.12 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 885501 0 0 0 40099 113 0 0 20 0 1 0 435985505 3793346560 919857 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 926110 919857 846 493 0 919415 0
Current children cumulated CPU time: 402.12 s
Current children cumulated vsize: 3704440 KiB
Current children cumulated memory: 3679428 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.63 5.25 2/191 8996
/proc/meminfo: memFree=24411456/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=4311776 memory=4226604 CPUtime=462.1 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 1016949 0 0 0 46080 130 0 0 20 0 1 0 435985505 4415258624 1056651 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 1077944 1056651 846 493 0 1071249 0
Current children cumulated CPU time: 462.1 s
Current children cumulated vsize: 4311776 KiB
Current children cumulated memory: 4226604 KiB


################
# More data... #
################

Current children cumulated vsize: 17454696 KiB
Current children cumulated memory: 17359468 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.03 1.87 2/192 9112
/proc/meminfo: memFree=10704504/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=17975964 memory=17905516 CPUtime=1961.8 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4295488 0 0 0 195397 783 0 0 20 0 1 0 435985505 18407387136 4476379 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 4493991 4476379 846 493 0 4487296 0
Current children cumulated CPU time: 1961.8 s
Current children cumulated vsize: 17975964 KiB
Current children cumulated memory: 17905516 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.02 1.82 2/192 9115
/proc/meminfo: memFree=10158388/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=18497232 memory=18451420 CPUtime=2021.8 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4426418 0 0 0 201359 821 0 0 20 0 1 0 435985505 18941165568 4612855 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 4624308 4612855 846 493 0 4617613 0
Current children cumulated CPU time: 2021.8 s
Current children cumulated vsize: 18497232 KiB
Current children cumulated memory: 18451420 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.02 1.77 2/192 9120
/proc/meminfo: memFree=9611104/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=19438396 memory=18996272 CPUtime=2081.78 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4557550 0 0 0 207316 862 0 0 20 0 1 0 435985505 19904917504 4749068 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 4859599 4749068 846 493 0 4852904 0
Current children cumulated CPU time: 2081.78 s
Current children cumulated vsize: 19438396 KiB
Current children cumulated memory: 18996272 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.72 2/191 9124
/proc/meminfo: memFree=9062668/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=19959532 memory=19544236 CPUtime=2141.76 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4688451 0 0 0 213276 900 0 0 20 0 1 0 435985505 20438560768 4886059 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 4989883 4886059 846 493 0 4983188 0
Current children cumulated CPU time: 2141.76 s
Current children cumulated vsize: 19959532 KiB
Current children cumulated memory: 19544236 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.67 2/191 9127
/proc/meminfo: memFree=8517872/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=20480668 memory=20089748 CPUtime=2201.76 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4819229 0 0 0 219238 938 0 0 20 0 1 0 435985505 20972204032 5022437 33554432000 4194304 6211092 140736315393168 140736315372264 139758090664782 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5120167 5022437 846 493 0 5113472 0
Current children cumulated CPU time: 2201.76 s
Current children cumulated vsize: 20480668 KiB
Current children cumulated memory: 20089748 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.63 2/191 9132
/proc/meminfo: memFree=7971936/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=21001540 memory=20635260 CPUtime=2261.73 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 4949963 0 0 0 225196 977 0 0 20 0 1 0 435985505 21505576960 5158815 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5250385 5158815 846 493 0 5243690 0
Current children cumulated CPU time: 2261.73 s
Current children cumulated vsize: 21001540 KiB
Current children cumulated memory: 20635260 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.59 2/191 9136
/proc/meminfo: memFree=7425244/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=21522676 memory=21178856 CPUtime=2321.73 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 5080863 0 0 0 231157 1016 0 0 20 0 1 0 435985505 22039220224 5294714 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5380669 5294714 846 493 0 5373974 0
Current children cumulated CPU time: 2321.73 s
Current children cumulated vsize: 21522676 KiB
Current children cumulated memory: 21178856 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.56 2/191 9139
/proc/meminfo: memFree=6878828/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=22043680 memory=21724368 CPUtime=2381.71 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 5211620 0 0 0 237114 1057 0 0 20 0 1 0 435985505 22572728320 5431092 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5510920 5431092 846 493 0 5504225 0
Current children cumulated CPU time: 2381.71 s
Current children cumulated vsize: 22043680 KiB
Current children cumulated memory: 21724368 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.52 2/192 9152
/proc/meminfo: memFree=6329696/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=22564552 memory=22271924 CPUtime=2441.7 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 5342345 0 0 0 243071 1099 0 0 20 0 1 0 435985505 23106101248 5567981 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5641138 5567981 846 493 0 5634443 0
Current children cumulated CPU time: 2441.7 s
Current children cumulated vsize: 22564552 KiB
Current children cumulated memory: 22271924 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.49 2/192 9177
/proc/meminfo: memFree=5783224/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=23085424 memory=22817308 CPUtime=2501.69 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 5473185 0 0 0 249026 1143 0 0 20 0 1 0 435985505 23639474176 5704327 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5771356 5704327 846 493 0 5764661 0
Current children cumulated CPU time: 2501.69 s
Current children cumulated vsize: 23085424 KiB
Current children cumulated memory: 22817308 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.48 2/192 9177
/proc/meminfo: memFree=5618960/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=23239072 memory=22979204 CPUtime=2519.4 cores=0-7
/proc/8964/stat : 8964 (cosoco) R 8961 8964 8540 0 -1 4202496 5511703 0 0 0 250783 1157 0 0 20 0 1 0 435985505 23796809728 5744801 33554432000 4194304 6211092 140736315393168 140736315372264 139758080719845 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5809768 5744801 846 493 0 5803073 0
Current children cumulated CPU time: 2519.4 s
Current children cumulated vsize: 23239072 KiB
Current children cumulated memory: 22979204 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.05 s]
# the end of solver process 8964 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2508.1 s, system=12.6423 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.48 2/192 9177
/proc/meminfo: memFree=5618960/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=23239072 memory=22979204 CPUtime=2519.52 cores=0-7
/proc/8964/stat : 8964 (cosoco) S 8961 8964 8540 0 -1 512 5511711 0 0 0 250793 1159 0 0 20 0 1 0 435985505 23796809728 5744801 33554432000 4194304 6211092 140736315393168 140736315372264 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5809768 5744801 846 493 0 5803073 0
Current children cumulated CPU time: 2519.52 s
Current children cumulated vsize: 23239072 KiB
Current children cumulated memory: 22979204 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.48 2/193 9178
/proc/meminfo: memFree=5087356/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=23239072 memory=22979204 CPUtime=2519.65 cores=0-7
/proc/8964/stat : 8964 (cosoco) S 8961 8964 8540 0 -1 512 5511711 0 0 0 250805 1160 0 0 20 0 1 0 435985505 23796809728 5744801 33554432000 4194304 6211092 140736315393168 140736315372264 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5809768 5744801 846 493 0 5803073 0
Current children cumulated CPU time: 2519.65 s
Current children cumulated vsize: 23239072 KiB
Current children cumulated memory: 22979204 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.01 1.48 2/194 9180
/proc/meminfo: memFree=4565968/32770624 swapFree=66959728/67108860
[pid=8964] ppid=8961 vsize=23239072 memory=22979204 CPUtime=2519.7 cores=0-7
/proc/8964/stat : 8964 (cosoco) S 8961 8964 8540 0 -1 512 5511711 0 0 0 250810 1160 0 0 20 0 1 0 435985505 23796809728 5744801 33554432000 4194304 6211092 140736315393168 140736315372264 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 40206336 140736315401233 140736315401325 140736315401325 140736315404238 0
/proc/8964/statm: 5809768 5744801 846 493 0 5803073 0
Current children cumulated CPU time: 2519.7 s
Current children cumulated vsize: 23239072 KiB
Current children cumulated memory: 22979204 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.05
CPU time (s): 2520.75
CPU user time (s): 2508.1
CPU system time (s): 12.6423
CPU usage (%): 99.9087
Max. virtual memory (cumulated for all children) (KiB): 23239072
Max. memory (cumulated for all children) (KiB): 22979204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2508.1
system time used= 12.6423
maximum resident set size= 22979368
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5511711
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 130549
involuntary context switches= 3697


# summary of solver processes directly reported to runsolver:
#   pid: 8964
#   total CPU time (s): 2520.75
#   total CPU user time (s): 2508.1
#   total CPU system time (s): 12.6423

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.10195 second user time and 17.3086 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-16 04:20:13
IDJOB=4398337
IDBENCH=122994
IDSOLVER=2851
FILE ID=node124/4398337-1568600454
RUNJOBID= node124-1568597886-8567
PBS_JOBID= 21703411
Free space on /tmp= 61812 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-038-010.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398337-1568600454/watcher-4398337-1568600454 -o /tmp/evaluation-result-4398337-1568600454/solver-4398337-1568600454 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node124-1568597886-8567 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398337-1568600454.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 8e449228b7b3cf049a5fccac2aa13fe6
RANDOM SEED=965557107

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28636164 kB
MemAvailable:   31839708 kB
Buffers:          213784 kB
Cached:          3278052 kB
SwapCached:        46376 kB
Active:          1003100 kB
Inactive:        2542556 kB
Active(anon):       5060 kB
Inactive(anon):    98256 kB
Active(file):     998040 kB
Inactive(file):  2444300 kB
Unevictable:      107488 kB
Mlocked:          107488 kB
SwapTotal:      67108860 kB
SwapFree:       66959728 kB
Dirty:              2668 kB
Writeback:             0 kB
AnonPages:        139948 kB
Mapped:            47300 kB
Shmem:             40944 kB
Slab:             183328 kB
SReclaimable:     154080 kB
SUnreclaim:        29248 kB
KernelStack:        3792 kB
PageTables:         5752 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506212 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     94208 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61304 MiB
End job on node124 at 2019-09-16 05:02:16