Trace number 4265089

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2017-08-10? (TO) 2519.8101 2520.01

General information on the benchmark

NameBlackhole/Blackhole-xcsp2-s07/
Blackhole-4-07-6_X2.xml
MD5SUMfad96b2eb778b7f693e68e3d100e5397
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2382.8
Satisfiable
(Un)Satisfiability was proved
Number of variables112
Number of constraints1262
Number of domains4
Minimum domain size1
Maximum domain size28
Distribution of domain sizes[{"size":1,"count":2},{"size":7,"count":28},{"size":14,"count":27},{"size":28,"count":54}]
Minimum variable degree0
Maximum variable degree56
Distribution of variable degrees[{"degree":0,"count":1},{"degree":2,"count":29},{"degree":3,"count":26},{"degree":28,"count":1},{"degree":29,"count":18},{"degree":30,"count":9},{"degree":56,"count":28}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":1262}]
Number of extensional constraints1262
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":1262}]
Optimization problemNO
Type of objective

Solver Data 

0.01/0.11	c Version: 2017-08-10

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15053 MiB free)
  memory of node 1: 16384 MiB (15495 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265089-1502757867/watcher-4265089-1502757867 -o /tmp/evaluation-result-4265089-1502757867/solver-4265089-1502757867 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21654 --watchdog 2580 BTD 2520 HOME/instance-4265089-1502757867.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=20510, runsolver pid=20507

[startup+0.100203 s]*
/proc/loadavg: 2.04 2.07 2.06 3/185 20511
/proc/meminfo: memFree=31281648/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=32736 memory=3228 CPUtime=0.01 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 938 0 0 0 1 0 0 0 20 0 1 0 77979997 33521664 807 18446744073709551615 4194304 35031035 140727372353312 140727372353312 4255432 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 8184 807 255 7529 0 631 0
Current children cumulated CPU time: 0.01 s
Current children cumulated vsize: 32736 KiB
Current children cumulated memory: 3228 KiB

[startup+0.209446 s]*
/proc/loadavg: 2.04 2.07 2.06 3/185 20511
/proc/meminfo: memFree=31275324/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38352 memory=8964 CPUtime=0.12 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 2384 0 0 0 12 0 0 0 20 0 1 0 77979997 39272448 2241 18446744073709551615 4194304 35031035 140727372353312 140727372351544 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9588 2241 294 7529 0 2035 0
Current children cumulated CPU time: 0.12 s
Current children cumulated vsize: 38352 KiB
Current children cumulated memory: 8964 KiB

[startup+0.309571 s]*
/proc/loadavg: 2.04 2.07 2.06 3/185 20511
/proc/meminfo: memFree=31275324/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38352 memory=8964 CPUtime=0.22 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 2391 0 0 0 22 0 0 0 20 0 1 0 77979997 39272448 2241 18446744073709551615 4194304 35031035 140727372353312 140727372351544 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9588 2241 294 7529 0 2035 0
Current children cumulated CPU time: 0.22 s
Current children cumulated vsize: 38352 KiB
Current children cumulated memory: 8964 KiB

[startup+0.700343 s]
/proc/loadavg: 2.04 2.07 2.06 3/185 20511
/proc/meminfo: memFree=31274952/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38616 memory=9228 CPUtime=0.6 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 2450 0 0 0 60 0 0 0 20 0 1 0 77979997 39542784 2307 18446744073709551615 4194304 35031035 140727372353312 140727372351544 4213184 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9654 2307 294 7529 0 2101 0
Current children cumulated CPU time: 0.6 s
Current children cumulated vsize: 38616 KiB
Current children cumulated memory: 9228 KiB

[startup+1.50034 s]
/proc/loadavg: 1.96 2.06 2.06 3/185 20511
/proc/meminfo: memFree=31274704/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38748 memory=9228 CPUtime=1.4 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 2479 0 0 0 139 1 0 0 20 0 1 0 77979997 39677952 2307 18446744073709551615 4194304 35031035 140727372353312 140727372351544 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9687 2307 294 7529 0 2134 0
Current children cumulated CPU time: 1.4 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9228 KiB

[startup+3.10922 s]
/proc/loadavg: 1.96 2.06 2.06 3/185 20511
/proc/meminfo: memFree=31274704/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38748 memory=9424 CPUtime=3.01 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 3819 0 0 0 299 2 0 0 20 0 1 0 77979997 39677952 2356 18446744073709551615 4194304 35031035 140727372353312 140727372351544 4355276 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9687 2356 294 7529 0 2134 0
Current children cumulated CPU time: 3.01 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9424 KiB

[startup+6.30033 s]
/proc/loadavg: 1.96 2.06 2.06 3/185 20511
/proc/meminfo: memFree=31273976/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38748 memory=9456 CPUtime=6.2 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 5168 0 0 0 615 5 0 0 20 0 1 0 77979997 39677952 2364 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9687 2364 294 7529 0 2134 0
Current children cumulated CPU time: 6.2 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9456 KiB

[startup+12.7003 s]
/proc/loadavg: 1.97 2.05 2.06 3/185 20511
/proc/meminfo: memFree=31273976/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38748 memory=9480 CPUtime=12.59 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 6516 0 0 0 1249 10 0 0 20 0 1 0 77979997 39677952 2370 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9687 2370 294 7529 0 2134 0
Current children cumulated CPU time: 12.59 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9480 KiB

[startup+25.5003 s]
/proc/loadavg: 1.97 2.05 2.06 3/185 20512
/proc/meminfo: memFree=31273976/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9524 CPUtime=25.4 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 9186 0 0 0 2520 20 0 0 20 0 1 0 77979997 39813120 2381 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2381 294 7529 0 2167 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9524 KiB

[startup+51.1092 s]
/proc/loadavg: 1.98 2.05 2.05 3/185 20512
/proc/meminfo: memFree=31273976/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9544 CPUtime=51.01 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 10572 0 0 0 5059 42 0 0 20 0 1 0 77979997 39813120 2386 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2386 294 7529 0 2167 0
Current children cumulated CPU time: 51.01 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9544 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.04 2.05 3/182 20514
/proc/meminfo: memFree=31277552/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9572 CPUtime=102.19 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 11123 0 0 0 10142 77 0 0 20 0 1 0 77979997 39813120 2393 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2393 294 7529 0 2167 0
Current children cumulated CPU time: 102.19 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9572 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/182 20516
/proc/meminfo: memFree=31277724/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9600 CPUtime=162.19 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 11678 0 0 0 16097 122 0 0 20 0 1 0 77979997 39813120 2400 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2400 294 7529 0 2167 0
Current children cumulated CPU time: 162.19 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9600 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/182 20518
/proc/meminfo: memFree=31278468/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9608 CPUtime=222.18 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 12221 0 0 0 22057 161 0 0 20 0 1 0 77979997 39813120 2402 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2402 294 7529 0 2167 0
Current children cumulated CPU time: 222.18 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9608 KiB

[startup+282.3 s]
/proc/loadavg: 2.45 2.15 2.08 3/182 20520
/proc/meminfo: memFree=31278344/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9616 CPUtime=282.18 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 12785 0 0 0 28003 215 0 0 20 0 1 0 77979997 39813120 2404 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2404 294 7529 0 2167 0
Current children cumulated CPU time: 282.18 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9616 KiB

[startup+342.3 s]
/proc/loadavg: 2.20 2.13 2.08 3/181 20522
/proc/meminfo: memFree=31278212/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9628 CPUtime=342.18 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 13316 0 0 0 33967 251 0 0 20 0 1 0 77979997 39813120 2407 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2407 294 7529 0 2167 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9628 KiB

[startup+402.3 s]
/proc/loadavg: 2.08 2.11 2.08 3/181 20524
/proc/meminfo: memFree=31278556/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9636 CPUtime=402.18 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 13868 0 0 0 39926 292 0 0 20 0 1 0 77979997 39813120 2409 18446744073709551615 4194304 35031035 140727372353312 140727372352312 4213195 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2409 294 7529 0 2167 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9636 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 2.09 2.07 3/181 20526
/proc/meminfo: memFree=31278876/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=38880 memory=9644 CPUtime=462.18 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 14426 0 0 0 45884 334 0 0 20 0 1 0 77979997 39813120 2411 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9720 2411 294 7529 0 2167 0
Current children cumulated CPU time: 462.18 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9644 KiB


################
# More data... #
################

/proc/20510/statm: 9753 2425 294 7529 0 2200 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9700 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20661
/proc/meminfo: memFree=31277516/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9700 CPUtime=1782.12 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 26376 0 0 0 176882 1330 0 0 20 0 1 0 77979997 39948288 2425 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2425 294 7529 0 2200 0
Current children cumulated CPU time: 1782.12 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9700 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/185 20678
/proc/meminfo: memFree=31273764/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9708 CPUtime=1842.12 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 26928 0 0 0 182838 1374 0 0 20 0 1 0 77979997 39948288 2427 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2427 294 7529 0 2200 0
Current children cumulated CPU time: 1842.12 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9708 KiB

[startup+1902.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/186 20705
/proc/meminfo: memFree=31271388/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9708 CPUtime=1902.11 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 27452 0 0 0 188794 1417 0 0 20 0 1 0 77979997 39948288 2427 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2427 294 7529 0 2200 0
Current children cumulated CPU time: 1902.11 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9708 KiB

[startup+1962.3 s]
/proc/loadavg: 2.41 2.12 2.08 3/183 20707
/proc/meminfo: memFree=31275112/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9708 CPUtime=1962.11 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 27969 0 0 0 194744 1467 0 0 20 0 1 0 77979997 39948288 2427 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2427 294 7529 0 2200 0
Current children cumulated CPU time: 1962.11 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9708 KiB

[startup+2022.3 s]
/proc/loadavg: 2.22 2.12 2.08 3/183 20709
/proc/meminfo: memFree=31276436/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9712 CPUtime=2022.11 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 28487 0 0 0 200694 1517 0 0 20 0 1 0 77979997 39948288 2428 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2428 294 7529 0 2200 0
Current children cumulated CPU time: 2022.11 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9712 KiB

[startup+2082.3 s]
/proc/loadavg: 2.08 2.10 2.07 3/183 20711
/proc/meminfo: memFree=31276648/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9712 CPUtime=2082.1 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 29003 0 0 0 206646 1564 0 0 20 0 1 0 77979997 39948288 2428 18446744073709551615 4194304 35031035 140727372353312 140727372352312 4213195 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2428 294 7529 0 2200 0
Current children cumulated CPU time: 2082.1 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9712 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.08 2.07 3/182 20713
/proc/meminfo: memFree=31276540/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9716 CPUtime=2142.1 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 29572 0 0 0 212602 1608 0 0 20 0 1 0 77979997 39948288 2429 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2142.1 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/182 20715
/proc/meminfo: memFree=31276664/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9716 CPUtime=2202.1 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 30082 0 0 0 218569 1641 0 0 20 0 1 0 77979997 39948288 2429 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2202.1 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/182 20717
/proc/meminfo: memFree=31276772/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9716 CPUtime=2262.1 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 30594 0 0 0 224523 1687 0 0 20 0 1 0 77979997 39948288 2429 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2262.1 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/182 20719
/proc/meminfo: memFree=31277236/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9716 CPUtime=2322.1 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 31122 0 0 0 230483 1727 0 0 20 0 1 0 77979997 39948288 2429 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2322.1 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/182 20721
/proc/meminfo: memFree=31276996/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9716 CPUtime=2382.1 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 31643 0 0 0 236429 1781 0 0 20 0 1 0 77979997 39948288 2429 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2382.1 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/185 20736
/proc/meminfo: memFree=31273004/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9720 CPUtime=2442.09 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 32150 0 0 0 242392 1817 0 0 20 0 1 0 77979997 39948288 2430 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2430 294 7529 0 2200 0
Current children cumulated CPU time: 2442.09 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9720 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/182 20738
/proc/meminfo: memFree=31276904/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9720 CPUtime=2502.09 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 32664 0 0 0 248343 1866 0 0 20 0 1 0 77979997 39948288 2430 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2430 294 7529 0 2200 0
Current children cumulated CPU time: 2502.09 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9720 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.03 2.05 3/182 20738
/proc/meminfo: memFree=31276904/32770624 swapFree=67108860/67108860
[pid=20510] ppid=20507 vsize=39012 memory=9720 CPUtime=2519.79 cores=0,2,4,6
/proc/20510/stat : 20510 (BTD) R 20507 20510 17093 0 -1 4202496 33170 0 0 0 250098 1881 0 0 20 0 1 0 77979997 39948288 2430 18446744073709551615 4194304 35031035 140727372353312 140727372352312 7760122 0 0 1 0 0 0 0 17 4 0 0 9 0 0 37130264 37226188 60825600 140727372362207 140727372362283 140727372362283 140727372365777 0
/proc/20510/statm: 9753 2430 294 7529 0 2200 0
Current children cumulated CPU time: 2519.79 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9720 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 20510 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2500.99 s, system=18.8192 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.81
CPU user time (s): 2500.99
CPU system time (s): 18.8192
CPU usage (%): 99.9919
Max. virtual memory (cumulated for all children) (KiB): 39012
Max. memory (cumulated for all children) (KiB): 9720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2500.99
system time used= 18.8192
maximum resident set size= 9720
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33170
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1804


# summary of solver processes directly reported to runsolver:
#   pid: 20510
#   total CPU time (s): 2519.81
#   total CPU user time (s): 2500.99
#   total CPU system time (s): 18.8192

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.12945 second user time and 15.7309 second system time

The end

Launcher Data 

Begin job on node127 at 2017-08-15 02:30:18
IDJOB=4265089
IDBENCH=134578
IDSOLVER=2654
FILE ID=node127/4265089-1502757867
RUNJOBID= node127-1502653304-21654
PBS_JOBID= 
Free space on /tmp= 61992 MiB

SOLVER NAME= BTD 2017-08-10
BENCH NAME= XCSP17/Blackhole/Blackhole-xcsp2-s07/Blackhole-4-07-6_X2.xml
COMMAND LINE= BTD TIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265089-1502757867/watcher-4265089-1502757867 -o /tmp/evaluation-result-4265089-1502757867/solver-4265089-1502757867 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21654 --watchdog 2580  BTD 2520 HOME/instance-4265089-1502757867.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fad96b2eb778b7f693e68e3d100e5397
RANDOM SEED=227203309

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31283408 kB
MemAvailable:   31970724 kB
Buffers:          241764 kB
Cached:           733568 kB
SwapCached:            0 kB
Active:           761416 kB
Inactive:         281236 kB
Active(anon):      17204 kB
Inactive(anon):    83808 kB
Active(file):     744212 kB
Inactive(file):   197428 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             38556 kB
Writeback:             0 kB
AnonPages:         67488 kB
Mapped:            52760 kB
Shmem:             33444 kB
Slab:             149140 kB
SReclaimable:     123024 kB
SUnreclaim:        26116 kB
KernelStack:        3248 kB
PageTables:         5388 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     346312 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     14336 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 61956 MiB
End job on node127 at 2017-08-15 03:12:18