Trace number 4409616

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallel? (TO) 2521.04 2523.31

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-09-024-008.xml
MD5SUM0092e4980ed4af349e39cdcd3a0de294
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark2.49365
Satisfiable
(Un)Satisfiability was proved
Number of variables217
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size23
Distribution of domain sizes[{"size":2,"count":216},{"size":23,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":216},{"degree":37,"count":1}]
Minimum constraint arity24
Maximum constraint arity216
Distribution of constraint arities[{"arity":24,"count":9},{"arity":49,"count":36},{"arity":216,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12251 MiB free)
  memory of node 1: 16384 MiB (15648 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409616-1569821399/watcher-4409616-1569821399 -o /tmp/evaluation-result-4409616-1569821399/solver-4409616-1569821399 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node148-1569816318-31364 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409616-1569821399.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=31934, runsolver pid=31931
Current StackSize limit: 8192 KiB


[startup+0.10014 s]*
/proc/loadavg: 8.04 8.18 8.19 2/192 31935
/proc/meminfo: memFree=28567160/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=29500 memory=5740 CPUtime=0.1 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 1652 0 0 0 10 0 0 0 20 0 1 0 558301408 30208000 1435 33554432000 4194304 6211132 140728534769008 140728534765544 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7375 1435 846 493 0 680 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29500 KiB
Current children cumulated memory: 5740 KiB

[startup+0.208755 s]*
/proc/loadavg: 8.04 8.18 8.19 2/192 31935
/proc/meminfo: memFree=28566044/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=30744 memory=7060 CPUtime=0.21 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 1955 0 0 0 21 0 0 0 20 0 1 0 558301408 31481856 1765 33554432000 4194304 6211132 140728534769008 140728534765544 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7686 1765 846 493 0 991 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30744 KiB
Current children cumulated memory: 7060 KiB

[startup+0.308531 s]*
/proc/loadavg: 8.04 8.18 8.19 2/192 31935
/proc/meminfo: memFree=28564928/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=31752 memory=8180 CPUtime=0.31 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 2234 0 0 0 31 0 0 0 20 0 1 0 558301408 32514048 2045 33554432000 4194304 6211132 140728534769008 140728534765544 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7938 2045 846 493 0 1243 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31752 KiB
Current children cumulated memory: 8180 KiB

[startup+0.700265 s]
/proc/loadavg: 8.04 8.18 8.19 2/192 31935
/proc/meminfo: memFree=28562696/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=36160 memory=12420 CPUtime=0.69 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 3306 0 0 0 69 0 0 0 20 0 1 0 558301408 37027840 3105 33554432000 4194304 6211132 140728534769008 140728534753480 5446299 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 9040 3105 846 493 0 2345 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36160 KiB
Current children cumulated memory: 12420 KiB

[startup+1.50027 s]
/proc/loadavg: 8.04 8.18 8.19 2/192 31935
/proc/meminfo: memFree=28557848/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=45188 memory=21412 CPUtime=1.49 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5539 0 0 0 149 0 0 0 20 0 1 0 558301408 46272512 5353 33554432000 4194304 6211132 140728534769008 140728534753480 5440617 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 11297 5353 846 493 0 4602 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 45188 KiB
Current children cumulated memory: 21412 KiB

[startup+3.10853 s]
/proc/loadavg: 7.47 8.07 8.15 2/192 31935
/proc/meminfo: memFree=28535976/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=63552 memory=39416 CPUtime=3.1 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 10115 0 0 0 309 1 0 0 20 0 1 0 558301408 65077248 9854 33554432000 4194304 6211132 140728534769008 140728534753992 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 15888 9854 846 493 0 9193 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 63552 KiB
Current children cumulated memory: 39416 KiB

[startup+6.30032 s]
/proc/loadavg: 7.47 8.07 8.15 2/192 31935
/proc/meminfo: memFree=28502280/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=100416 memory=75000 CPUtime=6.29 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 19114 0 0 0 627 2 0 0 20 0 1 0 558301408 102825984 18750 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 25104 18750 846 493 0 18409 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 100416 KiB
Current children cumulated memory: 75000 KiB

[startup+12.7003 s]
/proc/loadavg: 6.95 7.95 8.11 2/191 31935
/proc/meminfo: memFree=28432900/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=170528 memory=146868 CPUtime=12.69 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 36652 0 0 0 1264 5 0 0 20 0 1 0 558301408 174620672 36717 33554432000 4194304 6211132 140728534769008 140728534753480 139999736554656 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 42632 36717 846 493 0 35937 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 170528 KiB
Current children cumulated memory: 146868 KiB

[startup+25.5003 s]
/proc/loadavg: 5.64 7.61 8.00 2/191 31935
/proc/meminfo: memFree=28287676/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=316472 memory=290304 CPUtime=25.49 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 71084 0 0 0 2540 9 0 0 20 0 1 0 558301408 324067328 72576 33554432000 4194304 6211132 140728534769008 140728534753480 5446292 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 79118 72576 846 493 0 72423 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 316472 KiB
Current children cumulated memory: 290304 KiB

[startup+51.1085 s]
/proc/loadavg: 4.05 7.08 7.81 2/191 31944
/proc/meminfo: memFree=27997052/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=611588 memory=576296 CPUtime=51.08 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 139096 0 0 0 5089 19 0 0 20 0 1 0 558301408 626266112 144074 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 152897 144074 846 493 0 146202 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 611588 KiB
Current children cumulated memory: 576296 KiB

[startup+102.3 s]
/proc/loadavg: 2.33 6.14 7.46 2/191 31947
/proc/meminfo: memFree=27426660/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=1208244 memory=1148268 CPUtime=102.26 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 273906 0 0 0 10188 38 0 0 20 0 1 0 558301408 1237241856 287067 33554432000 4194304 6211132 140728534769008 140728534753480 139999728145255 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 302061 287067 846 493 0 295366 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1208244 KiB
Current children cumulated memory: 1148268 KiB

[startup+162.3 s]
/proc/loadavg: 1.49 5.21 7.05 2/191 31950
/proc/meminfo: memFree=26754948/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=1892612 memory=1821552 CPUtime=162.25 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 431549 0 0 0 16164 61 0 0 20 0 1 0 558301408 1938034688 455388 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 473153 455388 846 493 0 466458 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1892612 KiB
Current children cumulated memory: 1821552 KiB

[startup+222.3 s]
/proc/loadavg: 1.18 4.44 6.67 2/191 31953
/proc/meminfo: memFree=26080936/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=2519084 memory=2491736 CPUtime=222.23 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 588419 0 0 0 22142 81 0 0 20 0 1 0 558301408 2579542016 622934 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 629771 622934 846 493 0 623076 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 2519084 KiB
Current children cumulated memory: 2491736 KiB

[startup+282.3 s]
/proc/loadavg: 1.06 3.81 6.32 2/191 31958
/proc/meminfo: memFree=25410864/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=3229968 memory=3161428 CPUtime=282.22 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 745708 0 0 0 28121 101 0 0 20 0 1 0 558301408 3307487232 790357 33554432000 4194304 6211132 140728534769008 140728534753480 5446258 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 807492 790357 846 493 0 800797 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 3229968 KiB
Current children cumulated memory: 3161428 KiB

[startup+342.3 s]
/proc/loadavg: 1.02 3.30 5.99 2/191 31961
/proc/meminfo: memFree=24739000/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=3856044 memory=3832084 CPUtime=342.21 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 902719 0 0 0 34100 121 0 0 20 0 1 0 558301408 3948589056 958021 33554432000 4194304 6211132 140728534769008 140728534753480 5443112 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 964011 958021 846 493 0 957316 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 3856044 KiB
Current children cumulated memory: 3832084 KiB

[startup+402.3 s]
/proc/loadavg: 1.01 2.88 5.67 2/191 31964
/proc/meminfo: memFree=24064172/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=4609796 memory=4505476 CPUtime=402.2 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 1060070 0 0 0 40074 146 0 0 20 0 1 0 558301408 4720431104 1126369 33554432000 4194304 6211132 140728534769008 140728534753480 5012630 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 1152449 1126369 846 493 0 1145754 0
Current children cumulated CPU time: 402.2 s
Current children cumulated vsize: 4609796 KiB
Current children cumulated memory: 4505476 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.54 5.38 2/191 31969
/proc/meminfo: memFree=23394628/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=5240864 memory=5173560 CPUtime=462.19 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 1216994 0 0 0 46050 169 0 0 20 0 1 0 558301408 5366644736 1293390 33554432000 4194304 6211132 140728534769008 140728534753480 5455690 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 1310216 1293390 846 493 0 1303521 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 5240864 KiB
Current children cumulated memory: 5173560 KiB


################
# More data... #
################

Current children cumulated vsize: 21809004 KiB
Current children cumulated memory: 21237204 KiB

[startup+1962.3 s]
/proc/loadavg: 1.01 1.04 1.89 2/192 32108
/proc/meminfo: memFree=6630480/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=22432044 memory=21903452 CPUtime=1961.83 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5132718 0 0 0 195108 1075 0 0 20 0 1 0 558301408 22970413056 5475863 33554432000 4194304 6211132 140728534769008 140728534753480 5446302 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 5608011 5475863 846 493 0 5601316 0
Current children cumulated CPU time: 1961.83 s
Current children cumulated vsize: 22432044 KiB
Current children cumulated memory: 21903452 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.04 1.84 2/192 32111
/proc/meminfo: memFree=5960968/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=23055084 memory=22571200 CPUtime=2021.81 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5288806 0 0 0 201059 1122 0 0 20 0 1 0 558301408 23608406016 5642800 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 5763771 5642800 846 493 0 5757076 0
Current children cumulated CPU time: 2021.81 s
Current children cumulated vsize: 23055084 KiB
Current children cumulated memory: 22571200 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.03 1.78 2/192 32116
/proc/meminfo: memFree=5291328/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=23678256 memory=23239476 CPUtime=2081.8 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5444960 0 0 0 207006 1174 0 0 20 0 1 0 558301408 24246534144 5809869 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 5919564 5809869 846 493 0 5912869 0
Current children cumulated CPU time: 2081.8 s
Current children cumulated vsize: 23678256 KiB
Current children cumulated memory: 23239476 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.03 1.73 2/192 32119
/proc/meminfo: memFree=4622024/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=24301032 memory=23907488 CPUtime=2141.79 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5601016 0 0 0 212952 1227 0 0 20 0 1 0 558301408 24884256768 5976872 33554432000 4194304 6211132 140728534769008 140728534753480 139999737166676 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 6075258 5976872 846 493 0 6068563 0
Current children cumulated CPU time: 2141.79 s
Current children cumulated vsize: 24301032 KiB
Current children cumulated memory: 23907488 KiB

[startup+2202.3 s]
/proc/loadavg: 1.13 1.05 1.70 2/191 32122
/proc/meminfo: memFree=3955092/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=24923940 memory=24573460 CPUtime=2201.77 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5757145 0 0 0 218899 1278 0 0 20 0 1 0 558301408 25522114560 6143365 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 6230985 6143365 846 493 0 6224290 0
Current children cumulated CPU time: 2201.77 s
Current children cumulated vsize: 24923940 KiB
Current children cumulated memory: 24573460 KiB

[startup+2262.3 s]
/proc/loadavg: 1.05 1.04 1.66 2/191 32127
/proc/meminfo: memFree=3285876/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=25546584 memory=25241208 CPUtime=2261.76 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 5913170 0 0 0 224845 1331 0 0 20 0 1 0 558301408 26159702016 6310302 33554432000 4194304 6211132 140728534769008 140728534753480 5013083 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 6386646 6310302 846 493 0 6379951 0
Current children cumulated CPU time: 2261.76 s
Current children cumulated vsize: 25546584 KiB
Current children cumulated memory: 25241208 KiB

[startup+2322.3 s]
/proc/loadavg: 1.02 1.04 1.61 2/191 32130
/proc/meminfo: memFree=2619892/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=26168700 memory=25906120 CPUtime=2321.74 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 6069043 0 0 0 230786 1388 0 0 20 0 1 0 558301408 26796748800 6476530 33554432000 4194304 6211132 140728534769008 140728534753480 139999728145255 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 6542175 6476530 846 493 0 6535480 0
Current children cumulated CPU time: 2321.74 s
Current children cumulated vsize: 26168700 KiB
Current children cumulated memory: 25906120 KiB

[startup+2382.3 s]
/proc/loadavg: 1.01 1.03 1.58 2/191 32133
/proc/meminfo: memFree=1949252/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=26791212 memory=26575916 CPUtime=2381.73 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 6225100 0 0 0 236733 1440 0 0 20 0 1 0 558301408 27434201088 6643979 33554432000 4194304 6211132 140728534769008 140728534753480 5452258 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 6697803 6643979 846 493 0 6691108 0
Current children cumulated CPU time: 2381.73 s
Current children cumulated vsize: 26791212 KiB
Current children cumulated memory: 26575916 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.02 1.54 2/192 32146
/proc/meminfo: memFree=1282856/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=27413724 memory=27240368 CPUtime=2441.71 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 6381340 0 0 0 242676 1495 0 0 20 0 1 0 558301408 28071653376 6810092 33554432000 4194304 6211132 140728534769008 140728534753480 5013236 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 6853431 6810092 846 493 0 6846736 0
Current children cumulated CPU time: 2441.71 s
Current children cumulated vsize: 27413724 KiB
Current children cumulated memory: 27240368 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.02 1.51 2/192 32149
/proc/meminfo: memFree=611844/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=28073280 memory=27909052 CPUtime=2501.7 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 6537688 0 0 0 248620 1550 0 0 20 0 1 0 558301408 28747038720 6977263 33554432000 4194304 6211132 140728534769008 140728534753480 139999728147863 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7018320 6977263 846 493 0 7011625 0
Current children cumulated CPU time: 2501.7 s
Current children cumulated vsize: 28073280 KiB
Current children cumulated memory: 27909052 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.02 1.49 2/193 32152
/proc/meminfo: memFree=410268/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=28256892 memory=28107052 CPUtime=2519.42 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 4202496 6583662 0 0 0 250375 1567 0 0 20 0 1 0 558301408 28935057408 7026763 33554432000 4194304 6211132 140728534769008 140728534753480 139999727221733 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7064223 7026763 846 493 0 7057528 0
Current children cumulated CPU time: 2519.42 s
Current children cumulated vsize: 28256892 KiB
Current children cumulated memory: 28107052 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.31 s]
# the end of solver process 31934 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2504.06 s, system=16.9865 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.02 1.49 2/193 32152
/proc/meminfo: memFree=410268/32770624 swapFree=67002732/67108860
[pid=31934] ppid=31931 vsize=28256892 memory=28107052 CPUtime=2519.55 cores=0-7
/proc/31934/stat : 31934 (cosoco) S 31931 31934 31337 0 -1 512 6583668 0 0 0 250388 1567 0 0 20 0 1 0 558301408 28935057408 7026763 33554432000 4194304 6211132 140728534769008 140728534753480 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7064223 7026763 846 493 0 7057528 0
Current children cumulated CPU time: 2519.55 s
Current children cumulated vsize: 28256892 KiB
Current children cumulated memory: 28107052 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.02 1.49 2/194 32153
/proc/meminfo: memFree=216688/32770624 swapFree=67002708/67108860
[pid=31934] ppid=31931 vsize=28256892 memory=28107052 CPUtime=2519.67 cores=0-7
/proc/31934/stat : 31934 (cosoco) S 31931 31934 31337 0 -1 512 6583668 0 0 0 250399 1568 0 0 20 0 1 0 558301408 28935057408 7026763 33554432000 4194304 6211132 140728534769008 140728534753480 5189582 0 16384 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7064223 7026763 846 493 0 7057528 0
Current children cumulated CPU time: 2519.67 s
Current children cumulated vsize: 28256892 KiB
Current children cumulated memory: 28107052 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.02 1.49 3/194 32153
/proc/meminfo: memFree=206752/32770624 swapFree=67002708/67108860
[pid=31934] ppid=31931 vsize=28256892 memory=28107052 CPUtime=2519.74 cores=0-7
/proc/31934/stat : 31934 (cosoco) R 31931 31934 31337 0 -1 512 6583668 0 0 0 250405 1569 0 0 20 0 1 0 558301408 28935057408 7026763 33554432000 4194304 6211132 140728534769008 140728534753480 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 36909056 140728534774801 140728534774893 140728534774893 140728534777806 0
/proc/31934/statm: 7064223 7026763 846 493 0 7057528 0
Current children cumulated CPU time: 2519.74 s
Current children cumulated vsize: 28256892 KiB
Current children cumulated memory: 28107052 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.31
CPU time (s): 2521.04
CPU user time (s): 2504.06
CPU system time (s): 16.9865
CPU usage (%): 99.9103
Max. virtual memory (cumulated for all children) (KiB): 28256892
Max. memory (cumulated for all children) (KiB): 28107052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2504.06
system time used= 16.9865
maximum resident set size= 28107200
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6583668
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 133923
involuntary context switches= 3151


# summary of solver processes directly reported to runsolver:
#   pid: 31934
#   total CPU time (s): 2521.04
#   total CPU user time (s): 2504.06
#   total CPU system time (s): 16.9865

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.99846 second user time and 15.9875 second system time

The end

Launcher Data 

Begin job on node148 at 2019-09-30 07:29:21
IDJOB=4409616
IDBENCH=122987
IDSOLVER=2877
FILE ID=node148/4409616-1569821399
RUNJOBID= node148-1569816318-31364
PBS_JOBID= 21705905
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-09-024-008.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409616-1569821399/watcher-4409616-1569821399 -o /tmp/evaluation-result-4409616-1569821399/solver-4409616-1569821399 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node148-1569816318-31364 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409616-1569821399.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0092e4980ed4af349e39cdcd3a0de294
RANDOM SEED=989342223

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28570128 kB
MemAvailable:   31876716 kB
Buffers:          171836 kB
Cached:          3472668 kB
SwapCached:         3492 kB
Active:          2238848 kB
Inactive:        1410828 kB
Active(anon):      18236 kB
Inactive(anon):    67024 kB
Active(file):    2220612 kB
Inactive(file):  1343804 kB
Unevictable:      110988 kB
Mlocked:          110988 kB
SwapTotal:      67108860 kB
SwapFree:       67002732 kB
Dirty:              2328 kB
Writeback:             0 kB
AnonPages:        203844 kB
Mapped:            26904 kB
Shmem:             71796 kB
Slab:             144824 kB
SReclaimable:     116012 kB
SUnreclaim:        28812 kB
KernelStack:        3728 kB
PageTables:         5392 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     538580 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    157696 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 61512 MiB
End job on node148 at 2019-09-30 08:11:25