Trace number 4306281

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2018.07.27_3? (TO) 2519.95 2520.01

General information on the benchmark

NameColouredQueens/
ColouredQueens-12_c18.xml
MD5SUM130c0e53e5c1e074e18659561dd41fce
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables144
Number of constraints66
Number of domains1
Minimum domain size12
Maximum domain size12
Distribution of domain sizes[{"size":12,"count":144}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":4},{"degree":4,"count":140}]
Minimum constraint arity2
Maximum constraint arity12
Distribution of constraint arities[{"arity":2,"count":4},{"arity":3,"count":4},{"arity":4,"count":4},{"arity":5,"count":4},{"arity":6,"count":4},{"arity":7,"count":4},{"arity":8,"count":4},{"arity":9,"count":4},{"arity":10,"count":4},{"arity":11,"count":4},{"arity":12,"count":26}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":66}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.07.27_3

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10521 MiB free)
  memory of node 1: 16384 MiB (6299 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4306281-1534065619/watcher-4306281-1534065619 -o /tmp/evaluation-result-4306281-1534065619/solver-4306281-1534065619 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1534063097-29627 --watchdog 2580 BTD 3 2520 HOME/instance-4306281-1534065619.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29949, runsolver pid=29946

[startup+0.100573 s]*
/proc/loadavg: 2.00 2.01 2.01 3/188 29950
/proc/meminfo: memFree=17224016/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=32908 memory=2884 CPUtime=0.1 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 885 0 0 0 10 0 0 0 20 0 1 0 224125096 33697792 721 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8227 721 478 7861 0 331 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32908 KiB
Current children cumulated memory: 2884 KiB

[startup+0.209232 s]*
/proc/loadavg: 2.00 2.01 2.01 3/188 29950
/proc/meminfo: memFree=17224016/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=32908 memory=2884 CPUtime=0.2 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 890 0 0 0 20 0 0 0 20 0 1 0 224125096 33697792 721 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8227 721 478 7861 0 331 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32908 KiB
Current children cumulated memory: 2884 KiB

[startup+0.308992 s]*
/proc/loadavg: 2.00 2.01 2.01 3/188 29950
/proc/meminfo: memFree=17224016/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=32908 memory=2884 CPUtime=0.3 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 892 0 0 0 30 0 0 0 20 0 1 0 224125096 33697792 721 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8227 721 478 7861 0 331 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32908 KiB
Current children cumulated memory: 2884 KiB

[startup+0.700224 s]
/proc/loadavg: 2.00 2.01 2.01 3/188 29950
/proc/meminfo: memFree=17224016/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33040 memory=2884 CPUtime=0.69 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 897 0 0 0 69 0 0 0 20 0 1 0 224125096 33832960 721 33554432000 4194304 36388936 140733194338288 140733194337128 4251315 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8260 721 478 7861 0 364 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33040 KiB
Current children cumulated memory: 2884 KiB

[startup+1.50022 s]
/proc/loadavg: 2.00 2.01 2.01 3/188 29950
/proc/meminfo: memFree=17223768/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33040 memory=2884 CPUtime=1.48 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 904 0 0 0 147 1 0 0 20 0 1 0 224125096 33832960 721 33554432000 4194304 36388936 140733194338288 140733194337128 4420624 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8260 721 478 7861 0 364 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 33040 KiB
Current children cumulated memory: 2884 KiB

[startup+3.10881 s]
/proc/loadavg: 2.08 2.03 2.01 3/188 29950
/proc/meminfo: memFree=17223712/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33040 memory=3120 CPUtime=3.1 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 1099 0 0 0 307 3 0 0 20 0 1 0 224125096 33832960 780 33554432000 4194304 36388936 140733194338288 140733194337128 4420408 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8260 780 487 7861 0 364 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33040 KiB
Current children cumulated memory: 3120 KiB

[startup+6.30033 s]
/proc/loadavg: 2.08 2.03 2.01 3/188 29950
/proc/meminfo: memFree=17223376/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33040 memory=3144 CPUtime=6.28 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 1299 0 0 0 622 6 0 0 20 0 1 0 224125096 33832960 786 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8260 786 487 7861 0 364 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 33040 KiB
Current children cumulated memory: 3144 KiB

[startup+12.7003 s]
/proc/loadavg: 2.08 2.03 2.01 3/188 29950
/proc/meminfo: memFree=17223808/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33040 memory=3192 CPUtime=12.68 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 1509 0 0 0 1256 12 0 0 20 0 1 0 224125096 33832960 798 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8260 798 487 7861 0 364 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 33040 KiB
Current children cumulated memory: 3192 KiB

[startup+25.5003 s]
/proc/loadavg: 2.28 2.08 2.03 3/188 29950
/proc/meminfo: memFree=17223816/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33172 memory=3220 CPUtime=25.48 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 1931 0 0 0 2524 24 0 0 20 0 1 0 224125096 33968128 805 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8293 805 487 7861 0 397 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 33172 KiB
Current children cumulated memory: 3220 KiB

[startup+51.109 s]
/proc/loadavg: 2.24 2.09 2.04 3/188 29950
/proc/meminfo: memFree=17223692/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33172 memory=3248 CPUtime=51.09 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 2162 0 0 0 5064 45 0 0 20 0 1 0 224125096 33968128 812 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8293 812 487 7861 0 397 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33172 KiB
Current children cumulated memory: 3248 KiB

[startup+102.3 s]
/proc/loadavg: 2.11 2.07 2.04 3/188 29951
/proc/meminfo: memFree=17224672/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33172 memory=3284 CPUtime=102.29 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 2397 0 0 0 10132 97 0 0 20 0 1 0 224125096 33968128 821 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8293 821 487 7861 0 397 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33172 KiB
Current children cumulated memory: 3284 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.06 2.04 3/188 29952
/proc/meminfo: memFree=17224280/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33172 memory=3316 CPUtime=162.28 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 2630 0 0 0 16077 151 0 0 20 0 1 0 224125096 33968128 829 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8293 829 487 7861 0 397 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 33172 KiB
Current children cumulated memory: 3316 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.05 2.04 3/188 29953
/proc/meminfo: memFree=17223776/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3332 CPUtime=222.28 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 2872 0 0 0 22016 212 0 0 20 0 1 0 224125096 34103296 833 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 833 487 7861 0 430 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3332 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.04 2.04 3/187 29955
/proc/meminfo: memFree=17223524/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3348 CPUtime=282.28 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 3121 0 0 0 27962 266 0 0 20 0 1 0 224125096 34103296 837 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 837 487 7861 0 430 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3348 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.04 3/187 29956
/proc/meminfo: memFree=17223668/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3364 CPUtime=342.27 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 3362 0 0 0 33905 322 0 0 20 0 1 0 224125096 34103296 841 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 841 487 7861 0 430 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3364 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.04 3/187 29957
/proc/meminfo: memFree=17223792/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3368 CPUtime=402.27 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 3598 0 0 0 39846 381 0 0 20 0 1 0 224125096 34103296 842 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 842 487 7861 0 430 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3368 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/187 29959
/proc/meminfo: memFree=17223564/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3380 CPUtime=462.27 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 3840 0 0 0 45789 438 0 0 20 0 1 0 224125096 34103296 845 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 845 487 7861 0 430 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3380 KiB


################
# More data... #
################

/proc/29949/statm: 8326 865 487 7861 0 430 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3460 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30004
/proc/meminfo: memFree=17221192/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3460 CPUtime=1782.24 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 8525 0 0 0 176534 1690 0 0 20 0 1 0 224125096 34103296 865 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 865 487 7861 0 430 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3460 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30005
/proc/meminfo: memFree=17222168/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33304 memory=3460 CPUtime=1842.25 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 8707 0 0 0 182477 1748 0 0 20 0 1 0 224125096 34103296 865 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8326 865 487 7861 0 430 0
Current children cumulated CPU time: 1842.25 s
Current children cumulated vsize: 33304 KiB
Current children cumulated memory: 3460 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30006
/proc/meminfo: memFree=17222416/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3468 CPUtime=1902.24 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 8934 0 0 0 188422 1802 0 0 20 0 1 0 224125096 34238464 867 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 867 487 7861 0 463 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3468 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30007
/proc/meminfo: memFree=17222308/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3468 CPUtime=1962.24 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 9113 0 0 0 194364 1860 0 0 20 0 1 0 224125096 34238464 867 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 867 487 7861 0 463 0
Current children cumulated CPU time: 1962.24 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3468 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30008
/proc/meminfo: memFree=17222432/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3468 CPUtime=2022.23 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 9292 0 0 0 200300 1923 0 0 20 0 1 0 224125096 34238464 867 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 867 487 7861 0 463 0
Current children cumulated CPU time: 2022.23 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3468 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30010
/proc/meminfo: memFree=17221732/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3476 CPUtime=2082.24 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 9505 0 0 0 206242 1982 0 0 20 0 1 0 224125096 34238464 869 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 869 487 7861 0 463 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3476 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 30011
/proc/meminfo: memFree=17222124/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3476 CPUtime=2142.24 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 9686 0 0 0 212185 2039 0 0 20 0 1 0 224125096 34238464 869 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 869 487 7861 0 463 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3476 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 30012
/proc/meminfo: memFree=17222124/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3476 CPUtime=2202.23 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 9874 0 0 0 218127 2096 0 0 20 0 1 0 224125096 34238464 869 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 869 487 7861 0 463 0
Current children cumulated CPU time: 2202.23 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3476 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 30014
/proc/meminfo: memFree=17222000/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3480 CPUtime=2262.23 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 10128 0 0 0 224075 2148 0 0 20 0 1 0 224125096 34238464 870 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 870 487 7861 0 463 0
Current children cumulated CPU time: 2262.23 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3480 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 30015
/proc/meminfo: memFree=17221880/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3480 CPUtime=2322.23 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 10319 0 0 0 230017 2206 0 0 20 0 1 0 224125096 34238464 870 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 870 487 7861 0 463 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3480 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 30024
/proc/meminfo: memFree=17221352/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3480 CPUtime=2382.23 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 10502 0 0 0 235963 2260 0 0 20 0 1 0 224125096 34238464 870 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 870 487 7861 0 463 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3480 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/189 30048
/proc/meminfo: memFree=17220484/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3480 CPUtime=2442.22 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 10686 0 0 0 241904 2318 0 0 20 0 1 0 224125096 34238464 870 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 870 487 7861 0 463 0
Current children cumulated CPU time: 2442.22 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3480 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/189 30049
/proc/meminfo: memFree=17221700/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3484 CPUtime=2502.22 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 10932 0 0 0 247850 2372 0 0 20 0 1 0 224125096 34238464 871 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 871 487 7861 0 463 0
Current children cumulated CPU time: 2502.22 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3484 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.04 3/189 30110
/proc/meminfo: memFree=17221968/32770624 swapFree=67108796/67108860
[pid=29949] ppid=29946 vsize=33436 memory=3484 CPUtime=2519.93 cores=0,2,4,6
/proc/29949/stat : 29949 (BTD) R 29946 29949 29596 0 -1 4202496 11112 0 0 0 249606 2387 0 0 20 0 1 0 224125096 34238464 871 33554432000 4194304 36388936 140733194338288 140733194337128 8047831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38489992 38625312 55885824 140733194343613 140733194343691 140733194343691 140733194346449 0
/proc/29949/statm: 8359 871 487 7861 0 463 0
Current children cumulated CPU time: 2519.93 s
Current children cumulated vsize: 33436 KiB
Current children cumulated memory: 3484 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 29949 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2496.07 s, system=23.8764 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.95
CPU user time (s): 2496.07
CPU system time (s): 23.8764
CPU usage (%): 99.9975
Max. virtual memory (cumulated for all children) (KiB): 33436
Max. memory (cumulated for all children) (KiB): 3484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2496.07
system time used= 23.8764
maximum resident set size= 3484
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11112
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 770


# summary of solver processes directly reported to runsolver:
#   pid: 29949
#   total CPU time (s): 2519.95
#   total CPU user time (s): 2496.07
#   total CPU system time (s): 23.8764

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.036 second user time and 16.9382 second system time

The end

Launcher Data 

Begin job on node138 at 2018-08-12 11:20:19
IDJOB=4306281
IDBENCH=141026
IDSOLVER=2786
FILE ID=node138/4306281-1534065619
RUNJOBID= node138-1534063097-29627
PBS_JOBID= 21036986
Free space on /tmp= 24160 MiB

SOLVER NAME= BTD 2018.07.27_3
BENCH NAME= XCSP18/ColouredQueens/ColouredQueens-12_c18.xml
COMMAND LINE= BTD 3 TIMELIMIT BENCHNAME 
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4306281-1534065619/watcher-4306281-1534065619 -o /tmp/evaluation-result-4306281-1534065619/solver-4306281-1534065619 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1534063097-29627 --watchdog 2580  BTD 3 2520 HOME/instance-4306281-1534065619.xml 

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 130c0e53e5c1e074e18659561dd41fce
RANDOM SEED=1542075479

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        17225132 kB
MemAvailable:   31897824 kB
Buffers:          154788 kB
Cached:         14583164 kB
SwapCached:           12 kB
Active:          7391856 kB
Inactive:        7407108 kB
Active(anon):       5040 kB
Inactive(anon):   108412 kB
Active(file):    7386816 kB
Inactive(file):  7298696 kB
Unevictable:        7276 kB
Mlocked:            7276 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:            105484 kB
Writeback:             0 kB
AnonPages:         61984 kB
Mapped:            51860 kB
Shmem:             49740 kB
Slab:             443576 kB
SReclaimable:     415640 kB
SUnreclaim:        27936 kB
KernelStack:        3440 kB
PageTables:         5616 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     377736 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 24108 MiB
End job on node138 at 2018-08-12 12:02:19