Trace number 4296129

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD_12 2018-06-11_12? (TO) 2519.94 2520.01

General information on the benchmark

NameEternity/
Eternity-13-13_c18.xml
MD5SUMe6142002f41530755715c5642d221a51
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables533
Number of constraints222
Number of domains2
Minimum domain size19
Maximum domain size169
Distribution of domain sizes[{"size":19,"count":364},{"size":169,"count":169}]
Minimum variable degree1
Maximum variable degree14
Distribution of variable degrees[{"degree":1,"count":12},{"degree":2,"count":520},{"degree":14,"count":1}]
Minimum constraint arity1
Maximum constraint arity169
Distribution of constraint arities[{"arity":1,"count":52},{"arity":5,"count":169},{"arity":169,"count":1}]
Number of extensional constraints169
Number of intensional constraints52
Distribution of constraint types[{"type":"extension","count":169},{"type":"intension","count":52},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.06.11_12

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9628 MiB free)
  memory of node 1: 16384 MiB (10146 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4296129-1532612522/watcher-4296129-1532612522 -o /tmp/evaluation-result-4296129-1532612522/solver-4296129-1532612522 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532594862-3690 --watchdog 2580 BTD 12 2520 HOME/instance-4296129-1532612522.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=6253, runsolver pid=6250

[startup+0.100117 s]*
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20241536/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=40388 memory=10008 CPUtime=0.1 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 2685 0 0 0 10 0 0 0 20 0 1 0 78815375 41357312 2502 33554432000 4194304 36388972 140736041245968 140736041245968 7657238 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 10097 2502 438 7861 0 2201 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 40388 KiB
Current children cumulated memory: 10008 KiB

[startup+0.209585 s]*
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20235196/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=46480 memory=16080 CPUtime=0.21 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 4187 0 0 0 21 0 0 0 20 0 1 0 78815375 47595520 4020 33554432000 4194304 36388972 140736041245968 140736041245968 4356399 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11620 4020 503 7861 0 3724 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 46480 KiB
Current children cumulated memory: 16080 KiB

[startup+0.309718 s]*
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20235196/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=46480 memory=16080 CPUtime=0.31 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 4199 0 0 0 31 0 0 0 20 0 1 0 78815375 47595520 4020 33554432000 4194304 36388972 140736041245968 140736041245968 6663764 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11620 4020 503 7861 0 3724 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 46480 KiB
Current children cumulated memory: 16080 KiB

[startup+0.700258 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20235196/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=46616 memory=16344 CPUtime=0.69 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 4219 0 0 0 69 0 0 0 20 0 1 0 78815375 47734784 4086 33554432000 4194304 36388972 140736041245968 140736041245968 4356619 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11654 4086 509 7861 0 3758 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 46616 KiB
Current children cumulated memory: 16344 KiB

[startup+1.50024 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20234784/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=46616 memory=16344 CPUtime=1.49 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 4239 0 0 0 149 0 0 0 20 0 1 0 78815375 47734784 4086 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11654 4086 509 7861 0 3758 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 46616 KiB
Current children cumulated memory: 16344 KiB

[startup+3.10918 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20234660/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=46748 memory=16460 CPUtime=3.1 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 6057 0 0 0 310 0 0 0 20 0 1 0 78815375 47869952 4115 33554432000 4194304 36388972 140736041245968 140736041244808 6663856 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11687 4115 509 7861 0 3791 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 46748 KiB
Current children cumulated memory: 16460 KiB

[startup+6.30028 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20233548/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47012 memory=16820 CPUtime=6.28 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 8907 0 0 0 625 3 0 0 20 0 1 0 78815375 48140288 4205 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11753 4205 511 7861 0 3857 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 47012 KiB
Current children cumulated memory: 16820 KiB

[startup+12.7002 s]
/proc/loadavg: 2.07 2.03 2.05 3/188 6254
/proc/meminfo: memFree=20233232/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47144 memory=16928 CPUtime=12.68 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 11618 0 0 0 1265 3 0 0 20 0 1 0 78815375 48275456 4232 33554432000 4194304 36388972 140736041245968 140736041244808 4356619 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11786 4232 521 7861 0 3890 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 47144 KiB
Current children cumulated memory: 16928 KiB

[startup+25.5003 s]
/proc/loadavg: 1.98 2.01 2.04 3/188 6254
/proc/meminfo: memFree=20233336/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47276 memory=17040 CPUtime=25.49 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 16455 0 0 0 2545 4 0 0 20 0 1 0 78815375 48410624 4260 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11819 4260 521 7861 0 3923 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 47276 KiB
Current children cumulated memory: 17040 KiB

[startup+51.1093 s]
/proc/loadavg: 1.99 2.01 2.04 3/188 6254
/proc/meminfo: memFree=20232580/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47408 memory=17228 CPUtime=51.09 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 19267 0 0 0 5105 4 0 0 20 0 1 0 78815375 48545792 4307 33554432000 4194304 36388972 140736041245968 140736041244808 4356687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11852 4307 521 7861 0 3956 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 47408 KiB
Current children cumulated memory: 17228 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/188 6316
/proc/meminfo: memFree=20229216/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47540 memory=17304 CPUtime=102.28 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 19865 0 0 0 10224 4 0 0 20 0 1 0 78815375 48680960 4326 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11885 4326 521 7861 0 3989 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 47540 KiB
Current children cumulated memory: 17304 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 6317
/proc/meminfo: memFree=20228920/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47540 memory=17396 CPUtime=162.28 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 20475 0 0 0 16224 4 0 0 20 0 1 0 78815375 48680960 4349 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11885 4349 521 7861 0 3989 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 47540 KiB
Current children cumulated memory: 17396 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 6318
/proc/meminfo: memFree=20229148/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47672 memory=17508 CPUtime=222.27 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 21107 0 0 0 22223 4 0 0 20 0 1 0 78815375 48816128 4377 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11918 4377 521 7861 0 4022 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 47672 KiB
Current children cumulated memory: 17508 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 6319
/proc/meminfo: memFree=20229160/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47672 memory=17540 CPUtime=282.27 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 21713 0 0 0 28223 4 0 0 20 0 1 0 78815375 48816128 4385 33554432000 4194304 36388972 140736041245968 140736041244808 4356623 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11918 4385 521 7861 0 4022 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 47672 KiB
Current children cumulated memory: 17540 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 6320
/proc/meminfo: memFree=20229036/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47804 memory=17592 CPUtime=342.28 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 22358 0 0 0 34223 5 0 0 20 0 1 0 78815375 48951296 4398 33554432000 4194304 36388972 140736041245968 140736041244808 4356619 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11951 4398 521 7861 0 4055 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 47804 KiB
Current children cumulated memory: 17592 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 6321
/proc/meminfo: memFree=20228928/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47804 memory=17620 CPUtime=402.28 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 22982 0 0 0 40223 5 0 0 20 0 1 0 78815375 48951296 4405 33554432000 4194304 36388972 140736041245968 140736041244808 6663863 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11951 4405 521 7861 0 4055 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 47804 KiB
Current children cumulated memory: 17620 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 6322
/proc/meminfo: memFree=20229184/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=47804 memory=17656 CPUtime=462.27 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 23625 0 0 0 46222 5 0 0 20 0 1 0 78815375 48951296 4414 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 11951 4414 521 7861 0 4055 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 47804 KiB
Current children cumulated memory: 17656 KiB


################
# More data... #
################

/proc/6253/statm: 12050 4496 521 7861 0 4154 0
Current children cumulated CPU time: 1722.24 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 17984 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6392
/proc/meminfo: memFree=20227568/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=17984 CPUtime=1782.24 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 37385 0 0 0 178215 9 0 0 20 0 1 0 78815375 49356800 4496 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4496 521 7861 0 4154 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 17984 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6393
/proc/meminfo: memFree=20227576/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=17984 CPUtime=1842.23 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 37915 0 0 0 184214 9 0 0 20 0 1 0 78815375 49356800 4496 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4496 521 7861 0 4154 0
Current children cumulated CPU time: 1842.23 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 17984 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6394
/proc/meminfo: memFree=20227452/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18004 CPUtime=1902.24 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 38612 0 0 0 190214 10 0 0 20 0 1 0 78815375 49356800 4501 33554432000 4194304 36388972 140736041245968 140736041244808 4356592 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4501 521 7861 0 4154 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18004 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6395
/proc/meminfo: memFree=20227696/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18004 CPUtime=1962.23 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 39193 0 0 0 196213 10 0 0 20 0 1 0 78815375 49356800 4501 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4501 521 7861 0 4154 0
Current children cumulated CPU time: 1962.23 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18004 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6396
/proc/meminfo: memFree=20227696/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18004 CPUtime=2022.23 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 39782 0 0 0 202213 10 0 0 20 0 1 0 78815375 49356800 4501 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4501 521 7861 0 4154 0
Current children cumulated CPU time: 2022.23 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18004 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6397
/proc/meminfo: memFree=20227548/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18016 CPUtime=2082.23 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 40505 0 0 0 208213 10 0 0 20 0 1 0 78815375 49356800 4504 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4504 521 7861 0 4154 0
Current children cumulated CPU time: 2082.23 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18016 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6398
/proc/meminfo: memFree=20227464/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18260 CPUtime=2142.22 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 40797 0 0 0 214212 10 0 0 20 0 1 0 78815375 49356800 4565 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4565 521 7861 0 4154 0
Current children cumulated CPU time: 2142.22 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18260 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6399
/proc/meminfo: memFree=20227692/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18260 CPUtime=2202.23 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 41085 0 0 0 220212 11 0 0 20 0 1 0 78815375 49356800 4565 33554432000 4194304 36388972 140736041245968 140736041244808 4356642 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4565 521 7861 0 4154 0
Current children cumulated CPU time: 2202.23 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18260 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6400
/proc/meminfo: memFree=20228048/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18260 CPUtime=2262.23 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 41371 0 0 0 226212 11 0 0 20 0 1 0 78815375 49356800 4565 33554432000 4194304 36388972 140736041245968 140736041244808 4356616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4565 521 7861 0 4154 0
Current children cumulated CPU time: 2262.23 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18260 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6408
/proc/meminfo: memFree=20227540/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18260 CPUtime=2322.22 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 41689 0 0 0 232211 11 0 0 20 0 1 0 78815375 49356800 4565 33554432000 4194304 36388972 140736041245968 140736041244808 4356633 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4565 521 7861 0 4154 0
Current children cumulated CPU time: 2322.22 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18260 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6409
/proc/meminfo: memFree=20227640/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18284 CPUtime=2382.22 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 41977 0 0 0 238211 11 0 0 20 0 1 0 78815375 49356800 4571 33554432000 4194304 36388972 140736041245968 140736041244808 4356619 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4571 521 7861 0 4154 0
Current children cumulated CPU time: 2382.22 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18284 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6410
/proc/meminfo: memFree=20227516/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18284 CPUtime=2442.21 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 42264 0 0 0 244210 11 0 0 20 0 1 0 78815375 49356800 4571 33554432000 4194304 36388972 140736041245968 140736041244808 4356552 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4571 521 7861 0 4154 0
Current children cumulated CPU time: 2442.21 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18284 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6411
/proc/meminfo: memFree=20227516/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18288 CPUtime=2502.22 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 42553 0 0 0 250210 12 0 0 20 0 1 0 78815375 49356800 4572 33554432000 4194304 36388972 140736041245968 140736041244808 4356623 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4572 521 7861 0 4154 0
Current children cumulated CPU time: 2502.22 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18288 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 6411
/proc/meminfo: memFree=20227764/32770624 swapFree=67108860/67108860
[pid=6253] ppid=6250 vsize=48200 memory=18288 CPUtime=2519.93 cores=0,2,4,6
/proc/6253/stat : 6253 (BTD) R 6250 6253 2022 0 -1 4202496 42838 0 0 0 251981 12 0 0 20 0 1 0 78815375 49356800 4572 33554432000 4194304 36388972 140736041245968 140736041244808 4356623 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 63848448 140736041247932 140736041248011 140736041248011 140736041250769 0
/proc/6253/statm: 12050 4572 521 7861 0 4154 0
Current children cumulated CPU time: 2519.93 s
Current children cumulated vsize: 48200 KiB
Current children cumulated memory: 18288 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 6253 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.81 s, system=0.121996 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.94
CPU user time (s): 2519.81
CPU system time (s): 0.121996
CPU usage (%): 99.997
Max. virtual memory (cumulated for all children) (KiB): 48200
Max. memory (cumulated for all children) (KiB): 18288

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.81
system time used= 0.121996
maximum resident set size= 18288
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 42838
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 3163


# summary of solver processes directly reported to runsolver:
#   pid: 6253
#   total CPU time (s): 2519.94
#   total CPU user time (s): 2519.81
#   total CPU system time (s): 0.121996

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.38306 second user time and 16.5131 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-26 15:42:02
IDJOB=4296129
IDBENCH=141656
IDSOLVER=2748
FILE ID=node103/4296129-1532612522
RUNJOBID= node103-1532594862-3690
PBS_JOBID= 21021969
Free space on /tmp= 56492 MiB

SOLVER NAME= BTD_12 2018-06-11_12
BENCH NAME= XCSP18/Eternity/Eternity-13-13_c18.xml
COMMAND LINE= BTD 12 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4296129-1532612522/watcher-4296129-1532612522 -o /tmp/evaluation-result-4296129-1532612522/solver-4296129-1532612522 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532594862-3690 --watchdog 2580  BTD 12 2520 HOME/instance-4296129-1532612522.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e6142002f41530755715c5642d221a51
RANDOM SEED=669494219

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20249044 kB
MemAvailable:   31929152 kB
Buffers:          286736 kB
Cached:         11579148 kB
SwapCached:            0 kB
Active:          3906632 kB
Inactive:        8016204 kB
Active(anon):      59656 kB
Inactive(anon):    25192 kB
Active(file):    3846976 kB
Inactive(file):  7991012 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             54856 kB
Writeback:             0 kB
AnonPages:         64292 kB
Mapped:            43128 kB
Shmem:             25228 kB
Slab:             298744 kB
SReclaimable:     270580 kB
SUnreclaim:        28164 kB
KernelStack:        3376 kB
PageTables:         5172 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     354604 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56440 MiB
End job on node103 at 2018-07-26 16:24:02