Trace number 4397773

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1269 1271.18

General information on the benchmark

NameTemplateDesign/
TemplateDesign-m2-herbs_c18.xml
MD5SUM01ee442f0f2e93e01b5a5546098ec59b
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark15.8703
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of constraints121
Number of domains3
Minimum domain size2
Maximum domain size281
Distribution of domain sizes[{"size":2,"count":30},{"size":43,"count":900},{"size":281,"count":30}]
Minimum variable degree2
Maximum variable degree32
Distribution of variable degrees[{"degree":2,"count":870},{"degree":3,"count":60},{"degree":32,"count":30}]
Minimum constraint arity2
Maximum constraint arity60
Distribution of constraint arities[{"arity":2,"count":60},{"arity":30,"count":31},{"arity":60,"count":30}]
Number of extensional constraints0
Number of intensional constraints60
Distribution of constraint types[{"type":"intension","count":60},{"type":"ordered","count":1},{"type":"sum","count":60}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397773-1568593166.xml 
0.00/0.01	c intension  iff(le(1,npt[0]),eq(u[0],1)) -> extension (support ? 1) - 281tuples

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14384 MiB free)
  memory of node 1: 16384 MiB (15536 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397773-1568593166/watcher-4397773-1568593166 -o /tmp/evaluation-result-4397773-1568593166/solver-4397773-1568593166 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node125-1568593123-22223 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397773-1568593166.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22253, runsolver pid=22250

[startup+0.100211 s]*
/proc/loadavg: 1.00 1.05 1.40 4/199 22254
/proc/meminfo: memFree=30636172/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=29736 memory=6192 CPUtime=0.1 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 1728 0 0 0 10 0 0 0 20 0 1 0 435583406 30449664 1548 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 7434 1548 851 493 0 739 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29736 KiB
Current children cumulated memory: 6192 KiB

[startup+0.209367 s]*
/proc/loadavg: 1.00 1.05 1.40 4/199 22254
/proc/meminfo: memFree=30634792/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=31080 memory=7512 CPUtime=0.21 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2063 0 0 0 21 0 0 0 20 0 1 0 435583406 31825920 1878 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 7770 1878 851 493 0 1075 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31080 KiB
Current children cumulated memory: 7512 KiB

[startup+0.309114 s]*
/proc/loadavg: 1.00 1.05 1.40 4/199 22254
/proc/meminfo: memFree=30633676/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=32308 memory=8568 CPUtime=0.31 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2368 0 0 0 31 0 0 0 20 0 1 0 435583406 33083392 2142 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 8077 2142 851 493 0 1382 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32308 KiB
Current children cumulated memory: 8568 KiB

[startup+0.70032 s]
/proc/loadavg: 1.00 1.05 1.40 5/199 22254
/proc/meminfo: memFree=30631568/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=37008 memory=13348 CPUtime=0.69 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 3543 0 0 0 69 0 0 0 20 0 1 0 435583406 37896192 3337 33554432000 4194304 6211092 140730122751376 140730122733736 140274885108583 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 9252 3337 851 493 0 2557 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 37008 KiB
Current children cumulated memory: 13348 KiB

[startup+1.50031 s]
/proc/loadavg: 1.00 1.05 1.40 4/199 22254
/proc/meminfo: memFree=30624892/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=47028 memory=23140 CPUtime=1.48 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 6002 0 0 0 148 0 0 0 20 0 1 0 435583406 48156672 5785 33554432000 4194304 6211092 140730122751376 140730122733736 140274885111187 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 11757 5785 851 493 0 5062 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 47028 KiB
Current children cumulated memory: 23140 KiB

[startup+3.10927 s]
/proc/loadavg: 1.08 1.07 1.40 4/199 22254
/proc/meminfo: memFree=30600220/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=67096 memory=43052 CPUtime=3.1 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 11049 0 0 0 309 1 0 0 20 0 1 0 435583406 68706304 10763 33554432000 4194304 6211092 140730122751376 140730122733736 5446260 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 16774 10763 851 493 0 10079 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 67096 KiB
Current children cumulated memory: 43052 KiB

[startup+6.30031 s]
/proc/loadavg: 1.08 1.07 1.40 4/199 22254
/proc/meminfo: memFree=30563680/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=107564 memory=82492 CPUtime=6.29 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 21084 0 0 0 627 2 0 0 20 0 1 0 435583406 110145536 20623 33554432000 4194304 6211092 140730122751376 140730122733736 140274885111227 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 26891 20623 851 493 0 20196 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 107564 KiB
Current children cumulated memory: 82492 KiB

[startup+12.7003 s]
/proc/loadavg: 1.15 1.08 1.40 4/199 22254
/proc/meminfo: memFree=30490272/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=186072 memory=161700 CPUtime=12.68 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 41020 0 0 0 1262 6 0 0 20 0 1 0 435583406 190537728 40425 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 46518 40425 851 493 0 39823 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 186072 KiB
Current children cumulated memory: 161700 KiB

[startup+25.5003 s]
/proc/loadavg: 1.28 1.11 1.41 4/200 22257
/proc/meminfo: memFree=30328804/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=346084 memory=320632 CPUtime=25.49 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 79974 0 0 0 2538 11 0 0 20 0 1 0 435583406 354390016 80158 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 86521 80158 851 493 0 79826 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 346084 KiB
Current children cumulated memory: 320632 KiB

[startup+51.1095 s]
/proc/loadavg: 1.53 1.18 1.42 4/199 22257
/proc/meminfo: memFree=30006476/32770624 swapFree=66967308/67108860
[pid=22253] ppid=22250 vsize=669256 memory=639244 CPUtime=51.08 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 157171 0 0 0 5087 21 0 0 20 0 1 0 435583406 685318144 159811 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 167314 159811 851 493 0 160619 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 669256 KiB
Current children cumulated memory: 639244 KiB

[startup+102.3 s]
/proc/loadavg: 1.81 1.32 1.46 4/201 22270
/proc/meminfo: memFree=29372768/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=1317512 memory=1271496 CPUtime=102.25 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 310108 0 0 0 10184 41 0 0 20 0 1 0 435583406 1349132288 317874 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 329378 317874 851 493 0 322683 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 1317512 KiB
Current children cumulated memory: 1271496 KiB

[startup+162.3 s]
/proc/loadavg: 1.93 1.44 1.49 4/201 22276
/proc/meminfo: memFree=28624664/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=2067032 memory=2016868 CPUtime=162.22 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 488265 0 0 0 16158 64 0 0 20 0 1 0 435583406 2116640768 504217 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 516758 504217 851 493 0 510063 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 2067032 KiB
Current children cumulated memory: 2016868 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.55 1.52 4/201 22280
/proc/meminfo: memFree=27880256/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=2832292 memory=2759516 CPUtime=222.2 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 666411 0 0 0 22130 90 0 0 20 0 1 0 435583406 2900267008 689879 33554432000 4194304 6211092 140730122751376 140730122733736 5478648 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 708073 689879 851 493 0 701378 0
Current children cumulated CPU time: 222.2 s
Current children cumulated vsize: 2832292 KiB
Current children cumulated memory: 2759516 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.63 1.55 4/201 22284
/proc/meminfo: memFree=27135788/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=3541264 memory=3502232 CPUtime=282.18 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 844131 0 0 0 28102 116 0 0 20 0 1 0 435583406 3626254336 875558 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 885316 875558 851 493 0 878621 0
Current children cumulated CPU time: 282.18 s
Current children cumulated vsize: 3541264 KiB
Current children cumulated memory: 3502232 KiB

[startup+342.3 s]
/proc/loadavg: 2.22 1.74 1.59 4/201 22290
/proc/meminfo: memFree=26392388/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=4338272 memory=4244740 CPUtime=342.15 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 1022367 0 0 0 34077 138 0 0 20 0 1 0 435583406 4442390528 1061185 33554432000 4194304 6211092 140730122751376 140730122733736 5441086 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 1084568 1061185 851 493 0 1077873 0
Current children cumulated CPU time: 342.15 s
Current children cumulated vsize: 4338272 KiB
Current children cumulated memory: 4244740 KiB

[startup+402.3 s]
/proc/loadavg: 2.80 2.01 1.70 4/199 22295
/proc/meminfo: memFree=25646544/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=5047508 memory=4989228 CPUtime=402.13 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 1200028 0 0 0 40046 167 0 0 20 0 1 0 435583406 5168648192 1247307 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 1261877 1247307 851 493 0 1255182 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 5047508 KiB
Current children cumulated memory: 4989228 KiB

[startup+462.3 s]
/proc/loadavg: 2.30 2.01 1.71 4/199 22299
/proc/meminfo: memFree=24902564/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=5756612 memory=5731200 CPUtime=462.11 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 1377663 0 0 0 46018 193 0 0 20 0 1 0 435583406 5894770688 1432800 33554432000 4194304 6211092 140730122751376 140730122733736 5446260 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 1439153 1432800 851 493 0 1432458 0
Current children cumulated CPU time: 462.11 s
Current children cumulated vsize: 5756612 KiB
Current children cumulated memory: 5731200 KiB


################
# More data... #
################

Current children cumulated vsize: 8902868 KiB
Current children cumulated memory: 8700500 KiB

[startup+762.3 s]
/proc/loadavg: 2.00 2.01 1.80 4/200 22331
/proc/meminfo: memFree=21184140/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=9611840 memory=9442692 CPUtime=761.98 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2266670 0 0 0 75860 338 0 0 20 0 1 0 435583406 9842524160 2360673 33554432000 4194304 6211092 140730122751376 140730122733736 5451621 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 2402960 2360673 851 493 0 2396265 0
Current children cumulated CPU time: 761.98 s
Current children cumulated vsize: 9611840 KiB
Current children cumulated memory: 9442692 KiB

[startup+822.3 s]
/proc/loadavg: 2.00 2.01 1.81 4/200 22335
/proc/meminfo: memFree=20442164/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=10320284 memory=10186080 CPUtime=821.96 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2444456 0 0 0 81829 367 0 0 20 0 1 0 435583406 10567970816 2546520 33554432000 4194304 6211092 140730122751376 140730122733736 140274885111204 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 2580071 2546520 851 493 0 2573376 0
Current children cumulated CPU time: 821.96 s
Current children cumulated vsize: 10320284 KiB
Current children cumulated memory: 10186080 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.01 1.82 4/200 22341
/proc/meminfo: memFree=19696628/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=11028860 memory=10927844 CPUtime=881.95 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2622195 0 0 0 87797 398 0 0 20 0 1 0 435583406 11293552640 2731961 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 2757215 2731961 851 493 0 2750520 0
Current children cumulated CPU time: 881.95 s
Current children cumulated vsize: 11028860 KiB
Current children cumulated memory: 10927844 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.01 1.83 4/200 22345
/proc/meminfo: memFree=18953252/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=11744728 memory=11669452 CPUtime=941.93 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2799996 0 0 0 93763 430 0 0 20 0 1 0 435583406 12026601472 2917363 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 2936182 2917363 851 493 0 2929487 0
Current children cumulated CPU time: 941.93 s
Current children cumulated vsize: 11744728 KiB
Current children cumulated memory: 11669452 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 1.84 4/199 22349
/proc/meminfo: memFree=18210640/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=12452908 memory=12412796 CPUtime=1001.91 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 2977737 0 0 0 99725 466 0 0 20 0 1 0 435583406 12751777792 3103199 33554432000 4194304 6211092 140730122751376 140730122733736 5451482 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3113227 3103199 851 493 0 3106532 0
Current children cumulated CPU time: 1001.91 s
Current children cumulated vsize: 12452908 KiB
Current children cumulated memory: 12412796 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 1.85 4/199 22355
/proc/meminfo: memFree=17466984/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=13441632 memory=13153268 CPUtime=1061.9 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 3156299 0 0 0 105690 500 0 0 20 0 1 0 435583406 13764231168 3288317 33554432000 4194304 6211092 140730122751376 140730122733736 5452153 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3360408 3288317 851 493 0 3353713 0
Current children cumulated CPU time: 1061.9 s
Current children cumulated vsize: 13441632 KiB
Current children cumulated memory: 13153268 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 1.87 4/199 22359
/proc/meminfo: memFree=16722112/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=14149548 memory=13896344 CPUtime=1121.88 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 3333962 0 0 0 111654 534 0 0 20 0 1 0 435583406 14489137152 3474086 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3537387 3474086 851 493 0 3530692 0
Current children cumulated CPU time: 1121.88 s
Current children cumulated vsize: 14149548 KiB
Current children cumulated memory: 13896344 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 1.87 4/199 22363
/proc/meminfo: memFree=15979628/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=14857728 memory=14637644 CPUtime=1181.86 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 3511660 0 0 0 117616 570 0 0 20 0 1 0 435583406 15214313472 3659411 33554432000 4194304 6211092 140730122751376 140730122733736 5478689 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3714432 3659411 851 493 0 3707737 0
Current children cumulated CPU time: 1181.86 s
Current children cumulated vsize: 14857728 KiB
Current children cumulated memory: 14637644 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 1.88 4/199 22369
/proc/meminfo: memFree=15236968/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=15565248 memory=15378144 CPUtime=1241.84 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 3689210 0 0 0 123571 613 0 0 20 0 1 0 435583406 15938813952 3844536 33554432000 4194304 6211092 140730122751376 140730122733736 5456310 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3891312 3844536 851 493 0 3884617 0
Current children cumulated CPU time: 1241.84 s
Current children cumulated vsize: 15565248 KiB
Current children cumulated memory: 15378144 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1268.4 s]
/proc/loadavg: 2.00 2.01 1.88 4/199 22370
/proc/meminfo: memFree=14915416/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=15872808 memory=15700128 CPUtime=1267.93 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 4202496 3766367 0 0 0 126162 631 0 0 20 0 1 0 435583406 16253755392 3925032 33554432000 4194304 6211092 140730122751376 140730122733736 140274884185061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3968202 3925032 851 493 0 3961507 0
Current children cumulated CPU time: 1267.93 s
Current children cumulated vsize: 15872808 KiB
Current children cumulated memory: 15700128 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1271.18 s]
# the end of solver process 22253 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1261.87 s, system=7.13699 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1268.8 s]
/proc/loadavg: 2.00 2.01 1.88 4/199 22370
/proc/meminfo: memFree=14915416/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=15872808 memory=15700128 CPUtime=1267.99 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) S 22250 22253 22192 0 -1 512 3766370 0 0 0 126167 632 0 0 20 0 1 0 435583406 16253755392 3925032 33554432000 4194304 6211092 140730122751376 140730122733736 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3968202 3925032 851 493 0 3961507 0
Current children cumulated CPU time: 1267.99 s
Current children cumulated vsize: 15872808 KiB
Current children cumulated memory: 15700128 KiB

[startup+1269.6 s]
/proc/loadavg: 2.00 2.01 1.88 4/200 22371
/proc/meminfo: memFree=14606800/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=15872808 memory=15700128 CPUtime=1268.11 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) S 22250 22253 22192 0 -1 512 3766370 0 0 0 126178 633 0 0 20 0 1 0 435583406 16253755392 3925032 33554432000 4194304 6211092 140730122751376 140730122733736 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3968202 3925032 851 493 0 3961507 0
Current children cumulated CPU time: 1268.11 s
Current children cumulated vsize: 15872808 KiB
Current children cumulated memory: 15700128 KiB

[startup+1270 s]*
/proc/loadavg: 2.00 2.01 1.88 5/200 22371
/proc/meminfo: memFree=14124596/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=15872808 memory=15700128 CPUtime=1268.16 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) S 22250 22253 22192 0 -1 512 3766370 0 0 0 126182 634 0 0 20 0 1 0 435583406 16253755392 3925032 33554432000 4194304 6211092 140730122751376 140730122733736 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3968202 3925032 851 493 0 3961507 0
Current children cumulated CPU time: 1268.16 s
Current children cumulated vsize: 15872808 KiB
Current children cumulated memory: 15700128 KiB

[startup+1270.4 s]
/proc/loadavg: 2.00 2.01 1.88 5/200 22371
/proc/meminfo: memFree=14124596/32770624 swapFree=66967312/67108860
[pid=22253] ppid=22250 vsize=15872808 memory=15700128 CPUtime=1268.21 cores=0,2,4,6
/proc/22253/stat : 22253 (cosoco) R 22250 22253 22192 0 -1 512 3766370 0 0 0 126186 635 0 0 20 0 1 0 435583406 16253755392 3925032 33554432000 4194304 6211092 140730122751376 140730122733736 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 12877824 140730122757131 140730122757233 140730122757233 140730122760142 0
/proc/22253/statm: 3968202 3925032 851 493 0 3961507 0
Current children cumulated CPU time: 1268.21 s
Current children cumulated vsize: 15872808 KiB
Current children cumulated memory: 15700128 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1271.18
CPU time (s): 1269
CPU user time (s): 1261.87
CPU system time (s): 7.13699
CPU usage (%): 99.8284
Max. virtual memory (cumulated for all children) (KiB): 15872808
Max. memory (cumulated for all children) (KiB): 15700128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1261.87
system time used= 7.13699
maximum resident set size= 15700200
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3766370
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 120396
involuntary context switches= 1603


# summary of solver processes directly reported to runsolver:
#   pid: 22253
#   total CPU time (s): 1269
#   total CPU user time (s): 1261.87
#   total CPU system time (s): 7.13699

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.02492 second user time and 8.46407 second system time

The end

Launcher Data 

Begin job on node125 at 2019-09-16 02:18:43
IDJOB=4397773
IDBENCH=141359
IDSOLVER=2850
FILE ID=node125/4397773-1568593166
RUNJOBID= node125-1568593123-22223
PBS_JOBID= 21703340
Free space on /tmp= 59756 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP18/TemplateDesign/TemplateDesign-m2-herbs_c18.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397773-1568593166/watcher-4397773-1568593166 -o /tmp/evaluation-result-4397773-1568593166/solver-4397773-1568593166 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node125-1568593123-22223 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397773-1568593166.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 01ee442f0f2e93e01b5a5546098ec59b
RANDOM SEED=792487091

node125.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30639560 kB
MemAvailable:   31863868 kB
Buffers:          174024 kB
Cached:          1349724 kB
SwapCached:        38372 kB
Active:           681068 kB
Inactive:         885072 kB
Active(anon):      21456 kB
Inactive(anon):    69504 kB
Active(file):     659612 kB
Inactive(file):   815568 kB
Unevictable:      107976 kB
Mlocked:          107976 kB
SwapTotal:      67108860 kB
SwapFree:       66967308 kB
Dirty:              5444 kB
Writeback:             0 kB
AnonPages:        112972 kB
Mapped:            46532 kB
Shmem:             39720 kB
Slab:             158796 kB
SReclaimable:     129924 kB
SUnreclaim:        28872 kB
KernelStack:        3280 kB
PageTables:         6288 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     511112 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 59284 MiB
End job on node125 at 2019-09-16 02:39:55