Trace number 4398484

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (MO) 2205.07 2207.35

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-19-020-009.xml
MD5SUM62ee24bcba75d1d33fbbd4bb45a854a0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4
Best CPU time to get the best result obtained on this benchmark1412.74
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints191
Number of domains2
Minimum domain size2
Maximum domain size17
Distribution of domain sizes[{"size":2,"count":380},{"size":17,"count":1}]
Minimum variable degree20
Maximum variable degree172
Distribution of variable degrees[{"degree":20,"count":380},{"degree":172,"count":1}]
Minimum constraint arity20
Maximum constraint arity380
Distribution of constraint arities[{"arity":20,"count":19},{"arity":41,"count":171},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":190}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11898 MiB free)
  memory of node 1: 16384 MiB (13977 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398484-1568600064/watcher-4398484-1568600064 -o /tmp/evaluation-result-4398484-1568600064/solver-4398484-1568600064 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node127-1568598290-13264 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398484-1568600064.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=14032, runsolver pid=14029
Current StackSize limit: 8192 KiB


[startup+0.100152 s]*
/proc/loadavg: 5.83 8.04 7.16 2/193 14033
/proc/meminfo: memFree=26493804/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=30736 memory=7060 CPUtime=0.1 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 1954 0 0 0 10 0 0 0 20 0 1 0 436275219 31473664 1765 33554432000 4194304 6211092 140732125465328 140732125461864 5453926 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7684 1765 846 493 0 989 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30736 KiB
Current children cumulated memory: 7060 KiB

[startup+0.209289 s]*
/proc/loadavg: 5.45 7.92 7.13 2/193 14033
/proc/meminfo: memFree=26492316/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=32180 memory=8604 CPUtime=0.2 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 2331 0 0 0 20 0 0 0 20 0 1 0 436275219 32952320 2151 33554432000 4194304 6211092 140732125465328 140732125461864 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 8045 2151 846 493 0 1350 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32180 KiB
Current children cumulated memory: 8604 KiB

[startup+0.308818 s]*
/proc/loadavg: 5.45 7.92 7.13 2/193 14033
/proc/meminfo: memFree=26490828/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=33624 memory=9924 CPUtime=0.3 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 2682 0 0 0 30 0 0 0 20 0 1 0 436275219 34430976 2481 33554432000 4194304 6211092 140732125465328 140732125461864 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 8406 2481 846 493 0 1711 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33624 KiB
Current children cumulated memory: 9924 KiB

[startup+0.70027 s]
/proc/loadavg: 5.45 7.92 7.13 2/193 14033
/proc/meminfo: memFree=26487912/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=39116 memory=15196 CPUtime=0.69 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 4025 0 0 0 69 0 0 0 20 0 1 0 436275219 40054784 3799 33554432000 4194304 6211092 140732125465328 140732125461864 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 9779 3799 846 493 0 3084 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 39116 KiB
Current children cumulated memory: 15196 KiB

[startup+1.50027 s]
/proc/loadavg: 5.45 7.92 7.13 2/193 14033
/proc/meminfo: memFree=26480844/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=50612 memory=26340 CPUtime=1.49 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 6810 0 0 0 148 1 0 0 20 0 1 0 436275219 51826688 6585 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 12653 6585 846 493 0 5958 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 50612 KiB
Current children cumulated memory: 26340 KiB

[startup+3.10935 s]
/proc/loadavg: 5.45 7.92 7.13 2/193 14033
/proc/meminfo: memFree=26454240/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=72428 memory=48704 CPUtime=3.1 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 12481 0 0 0 308 2 0 0 20 0 1 0 436275219 74166272 12176 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 18107 12176 846 493 0 11412 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 72428 KiB
Current children cumulated memory: 48704 KiB

[startup+6.30026 s]
/proc/loadavg: 5.09 7.81 7.10 2/193 14033
/proc/meminfo: memFree=26411864/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=117740 memory=93560 CPUtime=6.29 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 23729 0 0 0 626 3 0 0 20 0 1 0 436275219 120565760 23390 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 29435 23390 846 493 0 22740 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 117740 KiB
Current children cumulated memory: 93560 KiB

[startup+12.7003 s]
/proc/loadavg: 4.76 7.69 7.06 2/194 14035
/proc/meminfo: memFree=26326044/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=209396 memory=183448 CPUtime=12.69 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 45808 0 0 0 1262 7 0 0 20 0 1 0 436275219 214421504 45862 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 52349 45862 846 493 0 45654 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 209396 KiB
Current children cumulated memory: 183448 KiB

[startup+25.5003 s]
/proc/loadavg: 4.18 7.47 7.00 2/193 14036
/proc/meminfo: memFree=26145548/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=395304 memory=362588 CPUtime=25.49 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 88709 0 0 0 2535 14 0 0 20 0 1 0 436275219 404791296 90647 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 98826 90647 846 493 0 92131 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 395304 KiB
Current children cumulated memory: 362588 KiB

[startup+51.1094 s]
/proc/loadavg: 2.93 6.85 6.81 2/193 14036
/proc/meminfo: memFree=25778408/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=747284 memory=723064 CPUtime=51.1 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 173286 0 0 0 5087 23 0 0 20 0 1 0 436275219 765218816 180766 33554432000 4194304 6211092 140732125465328 140732125451336 5452161 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 186821 180766 846 493 0 180126 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 747284 KiB
Current children cumulated memory: 723064 KiB

[startup+102.3 s]
/proc/loadavg: 1.84 5.95 6.50 2/192 14041
/proc/meminfo: memFree=25061200/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=1481064 memory=1442220 CPUtime=102.27 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 342397 0 0 0 10184 43 0 0 20 0 1 0 436275219 1516609536 360555 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 370266 360555 846 493 0 363571 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1481064 KiB
Current children cumulated memory: 1442220 KiB

[startup+162.3 s]
/proc/loadavg: 1.31 5.05 6.16 2/191 14044
/proc/meminfo: memFree=24214460/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=2324528 memory=2287720 CPUtime=162.25 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 539965 0 0 0 16158 67 0 0 20 0 1 0 436275219 2380316672 571930 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 581132 571930 846 493 0 574437 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 2324528 KiB
Current children cumulated memory: 2287720 KiB

[startup+222.3 s]
/proc/loadavg: 1.11 4.31 5.83 2/191 14047
/proc/meminfo: memFree=23369064/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=3196424 memory=3131136 CPUtime=222.22 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 737533 0 0 0 22132 90 0 0 20 0 1 0 436275219 3273138176 782784 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 799106 782784 846 493 0 792411 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 3196424 KiB
Current children cumulated memory: 3131136 KiB

[startup+282.3 s]
/proc/loadavg: 1.04 3.71 5.53 2/192 14052
/proc/meminfo: memFree=22520772/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=4110120 memory=3977840 CPUtime=282.2 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 935387 0 0 0 28103 117 0 0 20 0 1 0 436275219 4208762880 994460 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 1027530 994460 846 493 0 1020835 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 4110120 KiB
Current children cumulated memory: 3977840 KiB

[startup+342.3 s]
/proc/loadavg: 1.02 3.22 5.25 2/191 14055
/proc/meminfo: memFree=21675116/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=4899856 memory=4822644 CPUtime=342.17 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 1132854 0 0 0 34074 143 0 0 20 0 1 0 436275219 5017452544 1205661 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 1224964 1205661 846 493 0 1218269 0
Current children cumulated CPU time: 342.17 s
Current children cumulated vsize: 4899856 KiB
Current children cumulated memory: 4822644 KiB

[startup+402.3 s]
/proc/loadavg: 1.01 2.81 4.98 2/192 14066
/proc/meminfo: memFree=20826428/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=5876372 memory=5668428 CPUtime=402.15 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 1330549 0 0 0 40044 171 0 0 20 0 1 0 436275219 6017404928 1417107 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 1469093 1417107 846 493 0 1462398 0
Current children cumulated CPU time: 402.15 s
Current children cumulated vsize: 5876372 KiB
Current children cumulated memory: 5668428 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.48 4.73 2/193 14071
/proc/meminfo: memFree=19980668/32770624 swapFree=66998528/67108860
[pid=14032] ppid=14029 vsize=6665732 memory=6513316 CPUtime=462.12 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 1528007 0 0 0 46016 196 0 0 20 0 1 0 436275219 6825709568 1628329 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 1666433 1628329 846 493 0 1659738 0
Current children cumulated CPU time: 462.12 s
Current children cumulated vsize: 6665732 KiB
Current children cumulated memory: 6513316 KiB


################
# More data... #
################

Current children cumulated vsize: 23742112 KiB
Current children cumulated memory: 23372376 KiB

[startup+1722.3 s]
/proc/loadavg: 1.01 1.04 1.97 2/192 14164
/proc/meminfo: memFree=2245136/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=24527248 memory=24212828 CPUtime=1721.74 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 5663375 0 0 0 171114 1060 0 0 20 0 1 0 436275219 25115901952 6053207 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 6131812 6053207 846 493 0 6125117 0
Current children cumulated CPU time: 1721.74 s
Current children cumulated vsize: 24527248 KiB
Current children cumulated memory: 24212828 KiB

[startup+1782.3 s]
/proc/loadavg: 1.00 1.03 1.91 2/192 14169
/proc/meminfo: memFree=1405040/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=25311196 memory=25052224 CPUtime=1781.72 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 5859489 0 0 0 177056 1116 0 0 20 0 1 0 436275219 25918664704 6263056 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 6327799 6263056 846 493 0 6321104 0
Current children cumulated CPU time: 1781.72 s
Current children cumulated vsize: 25311196 KiB
Current children cumulated memory: 25052224 KiB

[startup+1842.3 s]
/proc/loadavg: 1.00 1.02 1.85 2/192 14172
/proc/meminfo: memFree=564620/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=26094352 memory=25890564 CPUtime=1841.7 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 6055420 0 0 0 183000 1170 0 0 20 0 1 0 436275219 26720616448 6472641 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 6523588 6472641 846 493 0 6516893 0
Current children cumulated CPU time: 1841.7 s
Current children cumulated vsize: 26094352 KiB
Current children cumulated memory: 25890564 KiB

[startup+1902.3 s]
/proc/loadavg: 1.00 1.02 1.80 2/191 14175
/proc/meminfo: memFree=202176/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=26878168 memory=26731624 CPUtime=1901.69 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 6251962 0 0 0 188943 1226 0 0 20 0 1 0 436275219 27523244032 6682906 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 6719542 6682906 846 493 0 6712847 0
Current children cumulated CPU time: 1901.69 s
Current children cumulated vsize: 26878168 KiB
Current children cumulated memory: 26731624 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.75 2/191 14180
/proc/meminfo: memFree=182164/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=27658288 memory=27565632 CPUtime=1961.69 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 6449278 0 0 0 194875 1294 0 0 20 0 1 0 436275219 28322086912 6891408 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 6914572 6891408 846 493 0 6907877 0
Current children cumulated CPU time: 1961.69 s
Current children cumulated vsize: 27658288 KiB
Current children cumulated memory: 27565632 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.70 2/191 14183
/proc/meminfo: memFree=191748/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=28437352 memory=28400160 CPUtime=2021.68 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 6644718 0 0 0 200794 1374 0 0 20 0 1 0 436275219 29119848448 7100040 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7109338 7100040 846 493 0 7102643 0
Current children cumulated CPU time: 2021.68 s
Current children cumulated vsize: 28437352 KiB
Current children cumulated memory: 28400160 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.66 2/191 14186
/proc/meminfo: memFree=181760/32770624 swapFree=66998532/67108860
[pid=14032] ppid=14029 vsize=30169524 memory=29236028 CPUtime=2081.68 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 6841493 0 0 0 206714 1454 0 0 20 0 1 0 436275219 30893592576 7309007 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7542381 7309007 846 493 0 7535686 0
Current children cumulated CPU time: 2081.68 s
Current children cumulated vsize: 30169524 KiB
Current children cumulated memory: 29236028 KiB

[startup+2142.3 s]
/proc/loadavg: 1.06 1.03 1.62 2/191 14191
/proc/meminfo: memFree=670228/32770624 swapFree=66896180/67108860
[pid=14032] ppid=14029 vsize=30947796 memory=30072140 CPUtime=2141.68 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 7037298 0 0 0 212641 1527 0 0 20 0 1 0 436275219 31690543104 7493044 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7736949 7493044 846 493 0 7730254 0
Current children cumulated CPU time: 2141.68 s
Current children cumulated vsize: 30947796 KiB
Current children cumulated memory: 30072140 KiB

[startup+2202.3 s]
/proc/loadavg: 1.02 1.02 1.58 2/192 14201
/proc/meminfo: memFree=195228/32770624 swapFree=66717064/67108860
[pid=14032] ppid=14029 vsize=31726860 memory=30905068 CPUtime=2201.68 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 7232195 0 0 0 218570 1598 0 0 20 0 1 0 436275219 32488304640 7656475 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7931715 7656475 481 493 0 7925020 0
Current children cumulated CPU time: 2201.68 s
Current children cumulated vsize: 31726860 KiB
Current children cumulated memory: 30905068 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2203.7 s]
/proc/loadavg: 1.02 1.02 1.58 2/192 14201
/proc/meminfo: memFree=180344/32770624 swapFree=66717064/67108860
[pid=14032] ppid=14029 vsize=31745208 memory=30923276 CPUtime=2203.08 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 4202496 7236791 0 0 0 218709 1599 0 0 20 0 1 0 436275219 32507092992 7660437 33554432000 4194304 6211092 140732125465328 140732125451336 140233160702949 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7936302 7660437 481 493 0 7929607 0
Current children cumulated CPU time: 2203.08 s
Current children cumulated vsize: 31745208 KiB
Current children cumulated memory: 30923276 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2207.35 s]
# the end of solver process 14032 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2187.11 s, system=17.9537 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2204.8 s]
/proc/loadavg: 1.02 1.02 1.58 1/193 14202
/proc/meminfo: memFree=198168/32770624 swapFree=66714712/67108860
[pid=14032] ppid=14029 vsize=31745472 memory=30923744 CPUtime=2203.21 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 512 7244376 0 1082 0 218711 1610 0 0 20 0 1 0 436275219 32507363328 7648881 33554432000 4194304 6211092 140732125465328 140732125451336 5189550 0 16384 4096 8405026 0 0 0 17 3 0 0 43 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7936368 7648881 486 493 0 7929673 0
Current children cumulated CPU time: 2203.21 s
Current children cumulated vsize: 31745472 KiB
Current children cumulated memory: 30923744 KiB

[startup+2205.2 s]
/proc/loadavg: 1.02 1.02 1.58 3/193 14202
/proc/meminfo: memFree=183668/32770624 swapFree=66633652/67108860
[pid=14032] ppid=14029 vsize=31745472 memory=30923744 CPUtime=2203.3 cores=0-7
/proc/14032/stat : 14032 (cosoco) R 14029 14032 13237 0 -1 512 7251415 0 2078 0 218711 1619 0 0 20 0 1 0 436275219 32507363328 7656867 33554432000 4194304 6211092 140732125465328 140732125451336 5189550 0 16384 4096 8405026 0 0 0 17 3 0 0 74 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7936368 7656867 486 493 0 7929673 0
Current children cumulated CPU time: 2203.3 s
Current children cumulated vsize: 31745472 KiB
Current children cumulated memory: 30923744 KiB

[startup+2205.6 s]
/proc/loadavg: 1.02 1.02 1.58 3/193 14202
/proc/meminfo: memFree=183668/32770624 swapFree=66633652/67108860
[pid=14032] ppid=14029 vsize=31745472 memory=30923744 CPUtime=2203.43 cores=0-7
/proc/14032/stat : 14032 (cosoco) D 14029 14032 13237 0 -1 512 7258250 0 3057 0 218711 1632 0 0 20 0 1 0 436275219 32507363328 7664721 33554432000 4194304 6211092 140732125465328 140732125451336 5189550 0 16384 4096 8405026 18446744071580419444 0 0 17 1 0 0 105 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7936368 7664721 486 493 0 7929673 0
Current children cumulated CPU time: 2203.43 s
Current children cumulated vsize: 31745472 KiB
Current children cumulated memory: 30923744 KiB

[startup+2205.7 s]
/proc/loadavg: 1.02 1.02 1.58 3/193 14202
/proc/meminfo: memFree=183668/32770624 swapFree=66633652/67108860
[pid=14032] ppid=14029 vsize=31745472 memory=30923744 CPUtime=2203.43 cores=0-7
/proc/14032/stat : 14032 (cosoco) D 14029 14032 13237 0 -1 512 7258668 0 3119 0 218711 1632 0 0 20 0 1 0 436275219 32507363328 7661087 33554432000 4194304 6211092 140732125465328 140732125451336 5189550 0 16384 4096 8405026 18446744071580419444 0 0 17 1 0 0 108 0 0 8312316 8317760 33492992 140732125471761 140732125471853 140732125471853 140732125474766 0
/proc/14032/statm: 7936368 7661087 486 493 0 7929673 0
Current children cumulated CPU time: 2203.43 s
Current children cumulated vsize: 31745472 KiB
Current children cumulated memory: 30923744 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2207.35
CPU time (s): 2205.07
CPU user time (s): 2187.11
CPU system time (s): 17.9537
CPU usage (%): 99.8964
Max. virtual memory (cumulated for all children) (KiB): 31745472
Max. memory (cumulated for all children) (KiB): 30923744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2187.11
system time used= 17.9537
maximum resident set size= 30660732
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7258668
page faults= 3120
swaps= 0
block input operations= 205192
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6702
involuntary context switches= 1344


# summary of solver processes directly reported to runsolver:
#   pid: 14032
#   total CPU time (s): 2205.07
#   total CPU user time (s): 2187.11
#   total CPU system time (s): 17.9537

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.66019 second user time and 14.883 second system time

The end

Launcher Data 

Begin job on node127 at 2019-09-16 04:13:44
IDJOB=4398484
IDBENCH=122984
IDSOLVER=2851
FILE ID=node127/4398484-1568600064
RUNJOBID= node127-1568598290-13264
PBS_JOBID= 21703425
Free space on /tmp= 61312 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-19-020-009.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398484-1568600064/watcher-4398484-1568600064 -o /tmp/evaluation-result-4398484-1568600064/solver-4398484-1568600064 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node127-1568598290-13264 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398484-1568600064.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 62ee24bcba75d1d33fbbd4bb45a854a0
RANDOM SEED=775643129

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26497376 kB
MemAvailable:   31865956 kB
Buffers:          139784 kB
Cached:          5502612 kB
SwapCached:         6772 kB
Active:          2816924 kB
Inactive:        2835896 kB
Active(anon):       3920 kB
Inactive(anon):    55608 kB
Active(file):    2813004 kB
Inactive(file):  2780288 kB
Unevictable:      110552 kB
Mlocked:          110552 kB
SwapTotal:      67108860 kB
SwapFree:       66998528 kB
Dirty:              2720 kB
Writeback:             0 kB
AnonPages:        114632 kB
Mapped:            47256 kB
Shmem:             40892 kB
Slab:             212468 kB
SReclaimable:     182244 kB
SUnreclaim:        30224 kB
KernelStack:        3440 kB
PageTables:         5236 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506280 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 61204 MiB
End job on node127 at 2019-09-16 04:50:33