Trace number 4292846

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2018.06.11_3? (TO) 2519.91 2520.01

General information on the benchmark

NameColouredQueens/
ColouredQueens-11_c18.xml
MD5SUM3da25fcd556a00d93fc440927ef81e89
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables121
Number of constraints60
Number of domains1
Minimum domain size11
Maximum domain size11
Distribution of domain sizes[{"size":11,"count":121}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":4},{"degree":4,"count":117}]
Minimum constraint arity2
Maximum constraint arity11
Distribution of constraint arities[{"arity":2,"count":4},{"arity":3,"count":4},{"arity":4,"count":4},{"arity":5,"count":4},{"arity":6,"count":4},{"arity":7,"count":4},{"arity":8,"count":4},{"arity":9,"count":4},{"arity":10,"count":4},{"arity":11,"count":24}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":60}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.06.11_3

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14941 MiB free)
  memory of node 1: 16384 MiB (11888 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4292846-1532337062/watcher-4292846-1532337062 -o /tmp/evaluation-result-4292846-1532337062/solver-4292846-1532337062 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532329499-11624 --watchdog 2580 BTD 3 2520 HOME/instance-4292846-1532337062.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=12361, runsolver pid=12358

[startup+0.100863 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 12362
/proc/meminfo: memFree=27473128/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32728 memory=2620 CPUtime=0.09 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 840 0 0 0 9 0 0 0 20 0 1 0 51269440 33513472 655 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8182 655 469 7861 0 286 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 32728 KiB
Current children cumulated memory: 2620 KiB

[startup+0.209232 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 12362
/proc/meminfo: memFree=27473128/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32728 memory=2620 CPUtime=0.2 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 842 0 0 0 20 0 0 0 20 0 1 0 51269440 33513472 655 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8182 655 469 7861 0 286 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32728 KiB
Current children cumulated memory: 2620 KiB

[startup+0.308763 s]*
/proc/loadavg: 2.00 2.01 2.05 4/188 12362
/proc/meminfo: memFree=27473052/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32728 memory=2620 CPUtime=0.3 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 844 0 0 0 30 0 0 0 20 0 1 0 51269440 33513472 655 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8182 655 469 7861 0 286 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32728 KiB
Current children cumulated memory: 2620 KiB

[startup+0.700234 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12362
/proc/meminfo: memFree=27472696/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32728 memory=2884 CPUtime=0.68 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 849 0 0 0 68 0 0 0 20 0 1 0 51269440 33513472 721 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8182 721 487 7861 0 286 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 32728 KiB
Current children cumulated memory: 2884 KiB

[startup+1.50023 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12362
/proc/meminfo: memFree=27472696/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32860 memory=2884 CPUtime=1.49 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 854 0 0 0 147 2 0 0 20 0 1 0 51269440 33648640 721 33554432000 4194304 36388972 140733484628336 140733484627176 6663796 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8215 721 487 7861 0 319 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32860 KiB
Current children cumulated memory: 2884 KiB

[startup+3.10911 s]
/proc/loadavg: 2.00 2.01 2.05 3/183 12474
/proc/meminfo: memFree=27513960/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32860 memory=2916 CPUtime=3.09 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 1019 0 0 0 304 5 0 0 20 0 1 0 51269440 33648640 729 33554432000 4194304 36388972 140733484628336 140733484627176 6663888 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8215 729 487 7861 0 319 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 32860 KiB
Current children cumulated memory: 2916 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12484
/proc/meminfo: memFree=27470432/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32860 memory=2944 CPUtime=6.28 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 1189 0 0 0 617 11 0 0 20 0 1 0 51269440 33648640 736 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8215 736 487 7861 0 319 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 32860 KiB
Current children cumulated memory: 2944 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12484
/proc/meminfo: memFree=27470436/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32860 memory=2960 CPUtime=12.68 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 1362 0 0 0 1248 20 0 0 20 0 1 0 51269440 33648640 740 33554432000 4194304 36388972 140733484628336 140733484627176 6663901 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8215 740 487 7861 0 319 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 32860 KiB
Current children cumulated memory: 2960 KiB

[startup+25.5002 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12484
/proc/meminfo: memFree=27470648/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32860 memory=3008 CPUtime=25.47 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 1719 0 0 0 2513 34 0 0 20 0 1 0 51269440 33648640 752 33554432000 4194304 36388972 140733484628336 140733484627176 4356259 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8215 752 487 7861 0 319 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 32860 KiB
Current children cumulated memory: 3008 KiB

[startup+51.1089 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12484
/proc/meminfo: memFree=27470772/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3028 CPUtime=51.07 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 1907 0 0 0 5044 63 0 0 20 0 1 0 51269440 33783808 757 33554432000 4194304 36388972 140733484628336 140733484627176 6663888 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 757 487 7861 0 352 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3028 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12485
/proc/meminfo: memFree=27470216/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3060 CPUtime=102.27 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 2106 0 0 0 10102 125 0 0 20 0 1 0 51269440 33783808 765 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 765 487 7861 0 352 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3060 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12486
/proc/meminfo: memFree=27470340/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3088 CPUtime=162.26 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 2302 0 0 0 16030 196 0 0 20 0 1 0 51269440 33783808 772 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 772 487 7861 0 352 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3088 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 12487
/proc/meminfo: memFree=27469876/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3104 CPUtime=222.26 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 2502 0 0 0 21961 265 0 0 20 0 1 0 51269440 33783808 776 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 776 487 7861 0 352 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3104 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12488
/proc/meminfo: memFree=27469648/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3116 CPUtime=282.26 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 2703 0 0 0 27885 341 0 0 20 0 1 0 51269440 33783808 779 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 779 487 7861 0 352 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3116 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12489
/proc/meminfo: memFree=27469660/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3120 CPUtime=342.25 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 2901 0 0 0 33815 410 0 0 20 0 1 0 51269440 33783808 780 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 780 487 7861 0 352 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3120 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12490
/proc/meminfo: memFree=27469892/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3124 CPUtime=402.25 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 3107 0 0 0 39750 475 0 0 20 0 1 0 51269440 33783808 781 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 781 487 7861 0 352 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3124 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12491
/proc/meminfo: memFree=27469904/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=32992 memory=3132 CPUtime=462.25 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 3293 0 0 0 45684 541 0 0 20 0 1 0 51269440 33783808 783 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8248 783 487 7861 0 352 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 32992 KiB
Current children cumulated memory: 3132 KiB


################
# More data... #
################

/proc/12361/statm: 8281 800 487 7861 0 385 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3200 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 12539
/proc/meminfo: memFree=27468452/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3200 CPUtime=1782.22 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 7440 0 0 0 176106 2116 0 0 20 0 1 0 51269440 33918976 800 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 800 487 7861 0 385 0
Current children cumulated CPU time: 1782.22 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3200 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 12540
/proc/meminfo: memFree=27468432/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3204 CPUtime=1842.21 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 7664 0 0 0 182032 2189 0 0 20 0 1 0 51269440 33918976 801 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 801 487 7861 0 385 0
Current children cumulated CPU time: 1842.21 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3204 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 12541
/proc/meminfo: memFree=27468668/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3204 CPUtime=1902.21 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 7828 0 0 0 187961 2260 0 0 20 0 1 0 51269440 33918976 801 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 801 487 7861 0 385 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3204 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 12542
/proc/meminfo: memFree=27468532/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3204 CPUtime=1962.21 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 7990 0 0 0 193888 2333 0 0 20 0 1 0 51269440 33918976 801 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 801 487 7861 0 385 0
Current children cumulated CPU time: 1962.21 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3204 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 12543
/proc/meminfo: memFree=27468644/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3208 CPUtime=2022.21 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 8197 0 0 0 199822 2399 0 0 20 0 1 0 51269440 33918976 802 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 802 487 7861 0 385 0
Current children cumulated CPU time: 2022.21 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3208 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12544
/proc/meminfo: memFree=27468648/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3208 CPUtime=2082.21 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 8356 0 0 0 205753 2468 0 0 20 0 1 0 51269440 33918976 802 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 802 487 7861 0 385 0
Current children cumulated CPU time: 2082.21 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3208 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12545
/proc/meminfo: memFree=27468264/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3208 CPUtime=2142.2 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 8518 0 0 0 211679 2541 0 0 20 0 1 0 51269440 33918976 802 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 802 487 7861 0 385 0
Current children cumulated CPU time: 2142.2 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3208 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12546
/proc/meminfo: memFree=27468624/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3212 CPUtime=2202.2 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 8703 0 0 0 217613 2607 0 0 20 0 1 0 51269440 33918976 803 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 803 487 7861 0 385 0
Current children cumulated CPU time: 2202.2 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3212 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12547
/proc/meminfo: memFree=27468752/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3212 CPUtime=2262.2 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 8861 0 0 0 223544 2676 0 0 20 0 1 0 51269440 33918976 803 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 803 487 7861 0 385 0
Current children cumulated CPU time: 2262.2 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3212 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12548
/proc/meminfo: memFree=27468988/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3212 CPUtime=2322.2 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 9018 0 0 0 229474 2746 0 0 20 0 1 0 51269440 33918976 803 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 803 487 7861 0 385 0
Current children cumulated CPU time: 2322.2 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3212 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12556
/proc/meminfo: memFree=27468828/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3212 CPUtime=2382.2 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 9177 0 0 0 235406 2814 0 0 20 0 1 0 51269440 33918976 803 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 803 487 7861 0 385 0
Current children cumulated CPU time: 2382.2 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3212 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12557
/proc/meminfo: memFree=27468376/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3216 CPUtime=2442.19 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 9404 0 0 0 241335 2884 0 0 20 0 1 0 51269440 33918976 804 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 804 487 7861 0 385 0
Current children cumulated CPU time: 2442.19 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3216 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 12558
/proc/meminfo: memFree=27468796/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3216 CPUtime=2502.19 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 9567 0 0 0 247265 2954 0 0 20 0 1 0 51269440 33918976 804 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 804 487 7861 0 385 0
Current children cumulated CPU time: 2502.19 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3216 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 12558
/proc/meminfo: memFree=27468920/32770624 swapFree=67108860/67108860
[pid=12361] ppid=12358 vsize=33124 memory=3216 CPUtime=2519.9 cores=0,2,4,6
/proc/12361/stat : 12361 (BTD) R 12358 12361 11593 0 -1 4202496 9728 0 0 0 249015 2975 0 0 20 0 1 0 51269440 33918976 804 33554432000 4194304 36388972 140733484628336 140733484627176 8047815 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 67391488 140733484631229 140733484631307 140733484631307 140733484634065 0
/proc/12361/statm: 8281 804 487 7861 0 385 0
Current children cumulated CPU time: 2519.9 s
Current children cumulated vsize: 33124 KiB
Current children cumulated memory: 3216 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 12361 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2490.16 s, system=29.7509 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.91
CPU user time (s): 2490.16
CPU system time (s): 29.7509
CPU usage (%): 99.9961
Max. virtual memory (cumulated for all children) (KiB): 33124
Max. memory (cumulated for all children) (KiB): 3216

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2490.16
system time used= 29.7509
maximum resident set size= 3216
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9728
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 823


# summary of solver processes directly reported to runsolver:
#   pid: 12361
#   total CPU time (s): 2519.91
#   total CPU user time (s): 2490.16
#   total CPU system time (s): 29.7509

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.62443 second user time and 16.192 second system time

The end

Launcher Data 

Begin job on node151 at 2018-07-23 11:11:02
IDJOB=4292846
IDBENCH=141024
IDSOLVER=2749
FILE ID=node151/4292846-1532337062
RUNJOBID= node151-1532329499-11624
PBS_JOBID= 21018998
Free space on /tmp= 55020 MiB

SOLVER NAME= BTD 2018.06.11_3
BENCH NAME= XCSP18/ColouredQueens/ColouredQueens-11_c18.xml
COMMAND LINE= BTD 3 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4292846-1532337062/watcher-4292846-1532337062 -o /tmp/evaluation-result-4292846-1532337062/solver-4292846-1532337062 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532329499-11624 --watchdog 2580  BTD 3 2520 HOME/instance-4292846-1532337062.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3da25fcd556a00d93fc440927ef81e89
RANDOM SEED=1598952984

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27474548 kB
MemAvailable:   31955244 kB
Buffers:          128296 kB
Cached:          4594772 kB
SwapCached:            0 kB
Active:           975184 kB
Inactive:        3804592 kB
Active(anon):       7536 kB
Inactive(anon):    69288 kB
Active(file):     967648 kB
Inactive(file):  3735304 kB
Unevictable:        7888 kB
Mlocked:            7888 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             52748 kB
Writeback:             0 kB
AnonPages:         64488 kB
Mapped:            39056 kB
Shmem:             17032 kB
Slab:             214432 kB
SReclaimable:     187160 kB
SUnreclaim:        27272 kB
KernelStack:        3376 kB
PageTables:         5020 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     346664 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 54968 MiB
End job on node151 at 2018-07-23 11:53:03