Trace number 4409686

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallel? (TO) 2520.69 2524.3

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-030-009.xml
MD5SUM902db1136df2968cd1e3d1d445559775
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark7.55584
Satisfiable
(Un)Satisfiability was proved
Number of variables301
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size29
Distribution of domain sizes[{"size":2,"count":300},{"size":29,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":300},{"degree":46,"count":1}]
Minimum constraint arity30
Maximum constraint arity300
Distribution of constraint arities[{"arity":30,"count":10},{"arity":61,"count":45},{"arity":300,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15115 MiB free)
  memory of node 1: 16384 MiB (15644 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409686-1569821358/watcher-4409686-1569821358 -o /tmp/evaluation-result-4409686-1569821358/solver-4409686-1569821358 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node126-1569816268-30830 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409686-1569821358.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=31562, runsolver pid=31559

[startup+0.100155 s]*
/proc/loadavg: 8.00 8.11 8.17 2/191 31563
/proc/meminfo: memFree=31495928/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=30028 memory=6264 CPUtime=0.1 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 1788 0 0 0 10 0 0 0 20 0 1 0 558403498 30748672 1566 33554432000 4194304 6211132 140726402411024 140726402407560 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7507 1566 846 493 0 812 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30028 KiB
Current children cumulated memory: 6264 KiB

[startup+0.209504 s]*
/proc/loadavg: 8.00 8.11 8.17 2/191 31563
/proc/meminfo: memFree=31494688/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=31440 memory=7848 CPUtime=0.21 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 2132 0 0 0 21 0 0 0 20 0 1 0 558403498 32194560 1962 33554432000 4194304 6211132 140726402411024 140726402407560 5454208 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7860 1962 846 493 0 1165 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31440 KiB
Current children cumulated memory: 7848 KiB

[startup+0.308859 s]*
/proc/loadavg: 8.00 8.11 8.17 2/191 31563
/proc/meminfo: memFree=31493324/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=32712 memory=9012 CPUtime=0.31 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 2432 0 0 0 31 0 0 0 20 0 1 0 558403498 33497088 2253 33554432000 4194304 6211132 140726402411024 140726402407560 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 8178 2253 846 493 0 1483 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32712 KiB
Current children cumulated memory: 9012 KiB

[startup+0.700326 s]
/proc/loadavg: 8.00 8.11 8.17 2/191 31563
/proc/meminfo: memFree=31490720/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=37516 memory=13656 CPUtime=0.69 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 3620 0 0 0 69 0 0 0 20 0 1 0 558403498 38416384 3414 33554432000 4194304 6211132 140726402411024 140726402407560 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 9379 3414 846 493 0 2684 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 37516 KiB
Current children cumulated memory: 13656 KiB

[startup+1.50033 s]
/proc/loadavg: 8.00 8.11 8.17 2/191 31563
/proc/meminfo: memFree=31485240/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=47304 memory=23684 CPUtime=1.48 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 6099 0 0 0 148 0 0 0 20 0 1 0 558403498 48439296 5921 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 11826 5921 846 493 0 5131 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 47304 KiB
Current children cumulated memory: 23684 KiB

[startup+3.10947 s]
/proc/loadavg: 7.44 7.99 8.13 2/191 31563
/proc/meminfo: memFree=31460348/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=67248 memory=43580 CPUtime=3.09 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 11171 0 0 0 308 1 0 0 20 0 1 0 558403498 68861952 10895 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 16812 10895 846 493 0 10117 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 67248 KiB
Current children cumulated memory: 43580 KiB

[startup+6.30033 s]
/proc/loadavg: 7.44 7.99 8.13 2/191 31563
/proc/meminfo: memFree=31422736/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=107532 memory=83044 CPUtime=6.28 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 21158 0 0 0 626 2 0 0 20 0 1 0 558403498 110112768 20761 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 26883 20761 846 493 0 20188 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 107532 KiB
Current children cumulated memory: 83044 KiB

[startup+12.7004 s]
/proc/loadavg: 6.45 7.76 8.05 2/192 31565
/proc/meminfo: memFree=31348724/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=188732 memory=162320 CPUtime=12.67 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 41088 0 0 0 1264 3 0 0 20 0 1 0 558403498 193261568 40580 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 47183 40580 846 493 0 40488 0
Current children cumulated CPU time: 12.67 s
Current children cumulated vsize: 188732 KiB
Current children cumulated memory: 162320 KiB

[startup+25.5003 s]
/proc/loadavg: 5.61 7.54 7.97 2/191 31565
/proc/meminfo: memFree=31187308/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=345256 memory=321212 CPUtime=25.47 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 79924 0 0 0 2539 8 0 0 20 0 1 0 558403498 353542144 80303 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 86314 80303 846 493 0 79619 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 345256 KiB
Current children cumulated memory: 321212 KiB

[startup+51.1088 s]
/proc/loadavg: 4.04 7.01 7.79 2/191 31566
/proc/meminfo: memFree=30864128/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=667088 memory=639504 CPUtime=51.06 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 156530 0 0 0 5088 18 0 0 20 0 1 0 558403498 683098112 159876 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 166772 159876 846 493 0 160077 0
Current children cumulated CPU time: 51.06 s
Current children cumulated vsize: 667088 KiB
Current children cumulated memory: 639504 KiB

[startup+102.3 s]
/proc/loadavg: 2.21 6.00 7.40 2/192 31577
/proc/meminfo: memFree=30229144/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=1314424 memory=1274228 CPUtime=102.22 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 309090 0 0 0 10183 39 0 0 20 0 1 0 558403498 1345970176 318557 33554432000 4194304 6211132 140726402411024 140726402393192 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 328606 318557 846 493 0 321911 0
Current children cumulated CPU time: 102.22 s
Current children cumulated vsize: 1314424 KiB
Current children cumulated memory: 1274228 KiB

[startup+162.3 s]
/proc/loadavg: 1.45 5.09 7.00 2/191 31580
/proc/meminfo: memFree=29484292/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=2062004 memory=2017860 CPUtime=162.19 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 487346 0 0 0 16153 66 0 0 20 0 1 0 558403498 2111492096 504465 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 515534 504465 846 493 0 508839 0
Current children cumulated CPU time: 162.19 s
Current children cumulated vsize: 2062004 KiB
Current children cumulated memory: 2017860 KiB

[startup+222.3 s]
/proc/loadavg: 1.16 4.35 6.62 2/191 31583
/proc/meminfo: memFree=28740004/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=2828224 memory=2761776 CPUtime=222.15 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 665709 0 0 0 22125 90 0 0 20 0 1 0 558403498 2896101376 690444 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 707056 690444 846 493 0 700361 0
Current children cumulated CPU time: 222.15 s
Current children cumulated vsize: 2828224 KiB
Current children cumulated memory: 2761776 KiB

[startup+282.3 s]
/proc/loadavg: 1.02 3.72 6.27 2/192 31588
/proc/meminfo: memFree=27997192/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=3539428 memory=3504788 CPUtime=282.13 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 843386 0 0 0 28098 115 0 0 20 0 1 0 558403498 3624374272 876197 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 884857 876197 846 493 0 878162 0
Current children cumulated CPU time: 282.13 s
Current children cumulated vsize: 3539428 KiB
Current children cumulated memory: 3504788 KiB

[startup+342.3 s]
/proc/loadavg: 1.01 3.23 5.94 2/191 31591
/proc/meminfo: memFree=27251036/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=4331972 memory=4248852 CPUtime=342.1 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 1021915 0 0 0 34071 139 0 0 20 0 1 0 558403498 4435939328 1062213 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 1082993 1062213 846 493 0 1076298 0
Current children cumulated CPU time: 342.1 s
Current children cumulated vsize: 4331972 KiB
Current children cumulated memory: 4248852 KiB

[startup+402.3 s]
/proc/loadavg: 1.00 2.82 5.63 2/190 31594
/proc/meminfo: memFree=26507484/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=5043632 memory=4992040 CPUtime=402.07 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 1199759 0 0 0 40044 163 0 0 20 0 1 0 558403498 5164679168 1248010 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 1260908 1248010 846 493 0 1254213 0
Current children cumulated CPU time: 402.07 s
Current children cumulated vsize: 5043632 KiB
Current children cumulated memory: 4992040 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.49 5.34 2/192 31600
/proc/meminfo: memFree=25762460/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=5877568 memory=5735080 CPUtime=462.05 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 1378089 0 0 0 46014 191 0 0 20 0 1 0 558403498 6018629632 1433770 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 1469392 1433770 846 493 0 1462697 0
Current children cumulated CPU time: 462.05 s
Current children cumulated vsize: 5877568 KiB
Current children cumulated memory: 5735080 KiB


################
# More data... #
################

Current children cumulated vsize: 23785928 KiB
Current children cumulated memory: 23538660 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.86 2/192 31737
/proc/meminfo: memFree=7179276/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=24492524 memory=24280072 CPUtime=1961.5 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 5817239 0 0 0 194916 1234 0 0 20 0 1 0 558403498 25080344576 6070018 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 6123131 6070018 846 493 0 6116436 0
Current children cumulated CPU time: 1961.5 s
Current children cumulated vsize: 24492524 KiB
Current children cumulated memory: 24280072 KiB

[startup+2022.3 s]
/proc/loadavg: 1.08 1.03 1.82 2/192 31740
/proc/meminfo: memFree=6437076/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=25198856 memory=25021156 CPUtime=2021.47 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 5994325 0 0 0 200854 1293 0 0 20 0 1 0 558403498 25803628544 6255289 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 6299714 6255289 846 493 0 6293019 0
Current children cumulated CPU time: 2021.47 s
Current children cumulated vsize: 25198856 KiB
Current children cumulated memory: 25021156 KiB

[startup+2082.3 s]
/proc/loadavg: 1.44 1.16 1.82 2/193 31745
/proc/meminfo: memFree=5697604/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=25904660 memory=25759996 CPUtime=2081.45 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 6171219 0 0 0 206791 1354 0 0 20 0 1 0 558403498 26526371840 6439999 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 6476165 6439999 846 493 0 6469470 0
Current children cumulated CPU time: 2081.45 s
Current children cumulated vsize: 25904660 KiB
Current children cumulated memory: 25759996 KiB

[startup+2142.3 s]
/proc/loadavg: 1.16 1.13 1.76 2/192 31748
/proc/meminfo: memFree=4959200/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=26609936 memory=26498304 CPUtime=2141.43 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 6348061 0 0 0 212728 1415 0 0 20 0 1 0 558403498 27248574464 6624576 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 6652484 6624576 846 493 0 6645789 0
Current children cumulated CPU time: 2141.43 s
Current children cumulated vsize: 26609936 KiB
Current children cumulated memory: 26498304 KiB

[startup+2202.3 s]
/proc/loadavg: 1.06 1.11 1.72 2/191 31751
/proc/meminfo: memFree=4217276/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=27315080 memory=27236552 CPUtime=2201.41 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 6524975 0 0 0 218662 1479 0 0 20 0 1 0 558403498 27970641920 6809138 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 6828770 6809138 846 493 0 6822075 0
Current children cumulated CPU time: 2201.41 s
Current children cumulated vsize: 27315080 KiB
Current children cumulated memory: 27236552 KiB

[startup+2262.3 s]
/proc/loadavg: 1.02 1.09 1.67 2/192 31756
/proc/meminfo: memFree=3478400/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=28019432 memory=27974336 CPUtime=2261.39 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 6701653 0 0 0 224594 1545 0 0 20 0 1 0 558403498 28691898368 6993584 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7004858 6993584 846 493 0 6998163 0
Current children cumulated CPU time: 2261.39 s
Current children cumulated vsize: 28019432 KiB
Current children cumulated memory: 27974336 KiB

[startup+2322.3 s]
/proc/loadavg: 1.01 1.07 1.63 2/191 31759
/proc/meminfo: memFree=2735672/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=29371084 memory=28714376 CPUtime=2321.37 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 6878971 0 0 0 230533 1604 0 0 20 0 1 0 558403498 30075990016 7178594 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7342771 7178594 846 493 0 7336076 0
Current children cumulated CPU time: 2321.37 s
Current children cumulated vsize: 29371084 KiB
Current children cumulated memory: 28714376 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.06 1.59 2/191 31762
/proc/meminfo: memFree=1998696/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=30075436 memory=29449584 CPUtime=2381.35 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 7055498 0 0 0 236466 1669 0 0 20 0 1 0 558403498 30797246464 7362396 33554432000 4194304 6211132 140726402411024 140726402393192 5013078 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7518859 7362396 846 493 0 7512164 0
Current children cumulated CPU time: 2381.35 s
Current children cumulated vsize: 30075436 KiB
Current children cumulated memory: 29449584 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.05 1.55 2/192 31767
/proc/meminfo: memFree=1258284/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=30779920 memory=30188884 CPUtime=2441.34 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 7232035 0 0 0 242400 1734 0 0 20 0 1 0 558403498 31518638080 7547221 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7694980 7547221 846 493 0 7688285 0
Current children cumulated CPU time: 2441.34 s
Current children cumulated vsize: 30779920 KiB
Current children cumulated memory: 30188884 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.04 1.52 2/191 31777
/proc/meminfo: memFree=516556/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=31484404 memory=30928116 CPUtime=2501.32 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 7408670 0 0 0 248336 1796 0 0 20 0 1 0 558403498 32240029696 7732029 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7871101 7732029 846 493 0 7864406 0
Current children cumulated CPU time: 2501.32 s
Current children cumulated vsize: 31484404 KiB
Current children cumulated memory: 30928116 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.04 1.51 2/191 31778
/proc/meminfo: memFree=297400/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=31692172 memory=31143992 CPUtime=2519.02 cores=0-7
/proc/31562/stat : 31562 (cosoco) R 31559 31562 30803 0 -1 4202496 7460696 0 0 0 250086 1816 0 0 20 0 1 0 558403498 32452784128 7785998 33554432000 4194304 6211132 140726402411024 140726402393192 139697507126245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7923043 7785998 846 493 0 7916348 0
Current children cumulated CPU time: 2519.02 s
Current children cumulated vsize: 31692172 KiB
Current children cumulated memory: 31143992 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2524.3 s]
# the end of solver process 31562 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2501.02 s, system=19.6644 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.04 1.51 2/191 31778
/proc/meminfo: memFree=297400/32770624 swapFree=66997716/67108860
[pid=31562] ppid=31559 vsize=31692172 memory=31143992 CPUtime=2519.06 cores=0-7
/proc/31562/stat : 31562 (cosoco) S 31559 31562 30803 0 -1 512 7460701 0 0 0 250090 1816 0 0 20 0 1 0 558403498 32452784128 7785998 33554432000 4194304 6211132 140726402411024 140726402393192 5189582 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7923043 7785998 846 493 0 7916348 0
Current children cumulated CPU time: 2519.06 s
Current children cumulated vsize: 31692172 KiB
Current children cumulated memory: 31143992 KiB

[startup+2522.5 s]
/proc/loadavg: 1.00 1.04 1.51 2/192 31779
/proc/meminfo: memFree=190172/32770624 swapFree=66997708/67108860
[pid=31562] ppid=31559 vsize=31692172 memory=31143992 CPUtime=2519.19 cores=0-7
/proc/31562/stat : 31562 (cosoco) S 31559 31562 30803 0 -1 512 7460701 0 0 0 250102 1817 0 0 20 0 1 0 558403498 32452784128 7785998 33554432000 4194304 6211132 140726402411024 140726402393192 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7923043 7785998 846 493 0 7916348 0
Current children cumulated CPU time: 2519.19 s
Current children cumulated vsize: 31692172 KiB
Current children cumulated memory: 31143992 KiB

[startup+2522.8 s]*
/proc/loadavg: 1.32 1.10 1.53 1/192 31779
/proc/meminfo: memFree=200708/32770624 swapFree=66997708/67108860
[pid=31562] ppid=31559 vsize=31692172 memory=31143992 CPUtime=2519.19 cores=0-7
/proc/31562/stat : 31562 (cosoco) S 31559 31562 30803 0 -1 512 7460701 0 0 0 250102 1817 0 0 20 0 1 0 558403498 32452784128 7785998 33554432000 4194304 6211132 140726402411024 140726402393192 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 22536192 140726402417681 140726402417773 140726402417773 140726402420686 0
/proc/31562/statm: 7923043 7785998 846 493 0 7916348 0
Current children cumulated CPU time: 2519.19 s
Current children cumulated vsize: 31692172 KiB
Current children cumulated memory: 31143992 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2524.3
CPU time (s): 2520.69
CPU user time (s): 2501.02
CPU system time (s): 19.6644
CPU usage (%): 99.8567
Max. virtual memory (cumulated for all children) (KiB): 31692172
Max. memory (cumulated for all children) (KiB): 31143992

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2501.02
system time used= 19.6644
maximum resident set size= 31144204
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7460701
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 71133
involuntary context switches= 1579


# summary of solver processes directly reported to runsolver:
#   pid: 31562
#   total CPU time (s): 2520.69
#   total CPU user time (s): 2501.02
#   total CPU system time (s): 19.6644

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.3988 second user time and 15.5383 second system time

The end

Launcher Data 

Begin job on node126 at 2019-09-30 07:28:39
IDJOB=4409686
IDBENCH=122986
IDSOLVER=2877
FILE ID=node126/4409686-1569821358
RUNJOBID= node126-1569816268-30830
PBS_JOBID= 21705904
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-030-009.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409686-1569821358/watcher-4409686-1569821358 -o /tmp/evaluation-result-4409686-1569821358/solver-4409686-1569821358 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node126-1569816268-30830 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409686-1569821358.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 902db1136df2968cd1e3d1d445559775
RANDOM SEED=1862984100

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31499516 kB
MemAvailable:   31860376 kB
Buffers:          212204 kB
Cached:           466588 kB
SwapCached:         7392 kB
Active:           342956 kB
Inactive:         346708 kB
Active(anon):      15948 kB
Inactive(anon):    70380 kB
Active(file):     327008 kB
Inactive(file):   276328 kB
Unevictable:      109408 kB
Mlocked:          109408 kB
SwapTotal:      67108860 kB
SwapFree:       66997716 kB
Dirty:              2812 kB
Writeback:             0 kB
AnonPages:        171828 kB
Mapped:            26880 kB
Shmem:             66840 kB
Slab:             175788 kB
SReclaimable:     146716 kB
SUnreclaim:        29072 kB
KernelStack:        3712 kB
PageTables:         5528 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     539944 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    124928 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 61760 MiB
End job on node126 at 2019-09-30 08:10:44