Trace number 4265090

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2017-08-10? (TO) 2519.77 2520

General information on the benchmark

NameBlackhole/Blackhole-xcsp2-s07/
Blackhole-4-07h-5_X2.xml
MD5SUM0d344e361328211ed16699cc315bd3d7
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables112
Number of constraints1262
Number of domains4
Minimum domain size1
Maximum domain size28
Distribution of domain sizes[{"size":1,"count":2},{"size":7,"count":28},{"size":14,"count":27},{"size":28,"count":54}]
Minimum variable degree0
Maximum variable degree56
Distribution of variable degrees[{"degree":0,"count":1},{"degree":2,"count":29},{"degree":3,"count":26},{"degree":28,"count":1},{"degree":29,"count":18},{"degree":30,"count":9},{"degree":56,"count":28}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":1262}]
Number of extensional constraints1262
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":1262}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.13	c Version: 2017-08-10

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15007 MiB free)
  memory of node 1: 16384 MiB (15503 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265090-1502756794/watcher-4265090-1502756794 -o /tmp/evaluation-result-4265090-1502756794/solver-4265090-1502756794 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21655 --watchdog 2580 BTD 2520 HOME/instance-4265090-1502756794.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=20380, runsolver pid=20377
Current StackSize limit: 8192 KiB


[startup+0.100153 s]*
/proc/loadavg: 1.90 2.00 2.04 2/181 20381
/proc/meminfo: memFree=31242596/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=33976 memory=452 CPUtime=0 cores=1,3,5,7
/proc/20380/stat : 20380 (runsolver) D 20377 20380 17093 0 -1 4202560 111 0 0 0 0 0 0 0 20 0 1 0 77872709 34791424 113 18446744073709551615 4194304 4346622 140734348650144 140734348646776 140116649837271 0 0 1 24578 18446744071580418449 0 0 17 5 0 0 0 0 0 6446216 6449568 9809920 140734348656815 140734348657188 140734348657188 140734348660682 0
/proc/20380/statm: 8494 113 52 38 0 4205 0
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 33976 KiB
Current children cumulated memory: 452 KiB

[startup+0.20993 s]*
/proc/loadavg: 1.90 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31234892/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38352 memory=8960 CPUtime=0.1 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 2384 0 0 0 10 0 0 0 20 0 1 0 77872709 39272448 2240 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9588 2240 294 7529 0 2035 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38352 KiB
Current children cumulated memory: 8960 KiB

[startup+0.30928 s]*
/proc/loadavg: 1.90 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31234520/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38352 memory=8960 CPUtime=0.2 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 2391 0 0 0 20 0 0 0 20 0 1 0 77872709 39272448 2240 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9588 2240 294 7529 0 2035 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 38352 KiB
Current children cumulated memory: 8960 KiB

[startup+0.700402 s]
/proc/loadavg: 1.90 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31234252/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38616 memory=9224 CPUtime=0.58 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 2450 0 0 0 58 0 0 0 20 0 1 0 77872709 39542784 2306 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9654 2306 294 7529 0 2101 0
Current children cumulated CPU time: 0.58 s
Current children cumulated vsize: 38616 KiB
Current children cumulated memory: 9224 KiB

[startup+1.50025 s]*
/proc/loadavg: 1.90 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31233608/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38748 memory=9224 CPUtime=1.39 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 2479 0 0 0 138 1 0 0 20 0 1 0 77872709 39677952 2306 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9687 2306 294 7529 0 2134 0
Current children cumulated CPU time: 1.39 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9224 KiB

[startup+3.10026 s]
/proc/loadavg: 1.90 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31234332/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38748 memory=9224 CPUtime=2.98 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 2486 0 0 0 296 2 0 0 20 0 1 0 77872709 39677952 2306 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9687 2306 294 7529 0 2134 0
Current children cumulated CPU time: 2.98 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9224 KiB

[startup+6.30025 s]
/proc/loadavg: 1.91 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31234340/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38748 memory=9468 CPUtime=6.18 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 5170 0 0 0 613 5 0 0 20 0 1 0 77872709 39677952 2367 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9687 2367 294 7529 0 2134 0
Current children cumulated CPU time: 6.18 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9468 KiB

[startup+12.7003 s]
/proc/loadavg: 1.92 2.00 2.04 3/181 20381
/proc/meminfo: memFree=31234464/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38748 memory=9480 CPUtime=12.58 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 6518 0 0 0 1248 10 0 0 20 0 1 0 77872709 39677952 2370 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9687 2370 294 7529 0 2134 0
Current children cumulated CPU time: 12.58 s
Current children cumulated vsize: 38748 KiB
Current children cumulated memory: 9480 KiB

[startup+25.5002 s]*
/proc/loadavg: 2.08 2.03 2.05 3/181 20382
/proc/meminfo: memFree=31234604/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9520 CPUtime=25.39 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 9183 0 0 0 2519 20 0 0 20 0 1 0 77872709 39813120 2380 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2380 294 7529 0 2167 0
Current children cumulated CPU time: 25.39 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9520 KiB

[startup+51.1002 s]
/proc/loadavg: 2.11 2.04 2.05 3/181 20382
/proc/meminfo: memFree=31234236/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9552 CPUtime=50.98 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 9759 0 0 0 5058 40 0 0 20 0 1 0 77872709 39813120 2388 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2388 294 7529 0 2167 0
Current children cumulated CPU time: 50.98 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9552 KiB

[startup+102.3 s]
/proc/loadavg: 2.12 2.05 2.05 3/181 20384
/proc/meminfo: memFree=31235108/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9572 CPUtime=102.17 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 10310 0 0 0 10142 75 0 0 20 0 1 0 77872709 39813120 2393 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2393 294 7529 0 2167 0
Current children cumulated CPU time: 102.17 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9572 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/181 20386
/proc/meminfo: memFree=31235284/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9588 CPUtime=162.17 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 10864 0 0 0 16096 121 0 0 20 0 1 0 77872709 39813120 2397 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2397 294 7529 0 2167 0
Current children cumulated CPU time: 162.17 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9588 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/181 20388
/proc/meminfo: memFree=31235160/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9604 CPUtime=222.16 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 11406 0 0 0 22059 157 0 0 20 0 1 0 77872709 39813120 2401 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2401 294 7529 0 2167 0
Current children cumulated CPU time: 222.16 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9604 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/181 20392
/proc/meminfo: memFree=31235440/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9616 CPUtime=282.16 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 11971 0 0 0 28009 207 0 0 20 0 1 0 77872709 39813120 2404 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2404 294 7529 0 2167 0
Current children cumulated CPU time: 282.16 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9616 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/181 20394
/proc/meminfo: memFree=31235688/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9624 CPUtime=342.16 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 12485 0 0 0 33974 242 0 0 20 0 1 0 77872709 39813120 2406 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2406 294 7529 0 2167 0
Current children cumulated CPU time: 342.16 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9624 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/181 20396
/proc/meminfo: memFree=31235612/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9628 CPUtime=402.16 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 13041 0 0 0 39932 284 0 0 20 0 1 0 77872709 39813120 2407 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2407 294 7529 0 2167 0
Current children cumulated CPU time: 402.16 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9628 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/185 20413
/proc/meminfo: memFree=31231216/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=38880 memory=9640 CPUtime=462.15 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 13597 0 0 0 45894 321 0 0 20 0 1 0 77872709 39813120 2410 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9720 2410 294 7529 0 2167 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 38880 KiB
Current children cumulated memory: 9640 KiB


################
# More data... #
################

/proc/20380/statm: 9753 2426 294 7529 0 2200 0
Current children cumulated CPU time: 1782.09 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9704 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/181 20550
/proc/meminfo: memFree=31277344/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9704 CPUtime=1842.09 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 24933 0 0 0 182888 1321 0 0 20 0 1 0 77872709 39948288 2426 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2426 294 7529 0 2200 0
Current children cumulated CPU time: 1842.09 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9704 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/181 20552
/proc/meminfo: memFree=31277592/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9704 CPUtime=1902.09 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 25349 0 0 0 188840 1369 0 0 20 0 1 0 77872709 39948288 2426 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2426 294 7529 0 2200 0
Current children cumulated CPU time: 1902.09 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9704 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/181 20554
/proc/meminfo: memFree=31277892/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9708 CPUtime=1962.08 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 25851 0 0 0 194791 1417 0 0 20 0 1 0 77872709 39948288 2427 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2427 294 7529 0 2200 0
Current children cumulated CPU time: 1962.08 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9708 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/181 20556
/proc/meminfo: memFree=31278264/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9708 CPUtime=2022.08 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 26227 0 0 0 200745 1463 0 0 20 0 1 0 77872709 39948288 2427 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2427 294 7529 0 2200 0
Current children cumulated CPU time: 2022.08 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9708 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20558
/proc/meminfo: memFree=31278140/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9708 CPUtime=2082.08 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 26630 0 0 0 206703 1505 0 0 20 0 1 0 77872709 39948288 2427 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2427 294 7529 0 2200 0
Current children cumulated CPU time: 2082.08 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9708 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20560
/proc/meminfo: memFree=31278140/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9712 CPUtime=2142.08 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 27194 0 0 0 212668 1540 0 0 20 0 1 0 77872709 39948288 2428 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2428 294 7529 0 2200 0
Current children cumulated CPU time: 2142.08 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9712 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20562
/proc/meminfo: memFree=31278388/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9712 CPUtime=2202.07 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 27579 0 0 0 218630 1577 0 0 20 0 1 0 77872709 39948288 2428 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2428 294 7529 0 2200 0
Current children cumulated CPU time: 2202.07 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9712 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/184 20578
/proc/meminfo: memFree=31274252/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9712 CPUtime=2262.07 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 28004 0 0 0 224588 1619 0 0 20 0 1 0 77872709 39948288 2428 18446744073709551615 4194304 35031035 140724868107552 140724868106552 4355339 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2428 294 7529 0 2200 0
Current children cumulated CPU time: 2262.07 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9712 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/184 20580
/proc/meminfo: memFree=31274480/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9716 CPUtime=2322.07 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 28517 0 0 0 230530 1677 0 0 20 0 1 0 77872709 39948288 2429 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2322.07 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20582
/proc/meminfo: memFree=31277452/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9716 CPUtime=2382.06 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 28910 0 0 0 236495 1711 0 0 20 0 1 0 77872709 39948288 2429 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2382.06 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20584
/proc/meminfo: memFree=31278096/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9716 CPUtime=2442.07 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 29299 0 0 0 242448 1759 0 0 20 0 1 0 77872709 39948288 2429 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2442.07 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20586
/proc/meminfo: memFree=31277844/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9716 CPUtime=2502.06 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 29709 0 0 0 248394 1812 0 0 20 0 1 0 77872709 39948288 2429 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2502.06 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20587
/proc/meminfo: memFree=31277968/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9716 CPUtime=2519.75 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 30051 0 0 0 250148 1827 0 0 20 0 1 0 77872709 39948288 2429 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2519.75 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520 s]
# the end of solver process 20380 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2501.49 s, system=18.2791 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 20587
/proc/meminfo: memFree=31277968/32770624 swapFree=67108860/67108860
[pid=20380] ppid=20377 vsize=39012 memory=9716 CPUtime=2519.75 cores=1,3,5,7
/proc/20380/stat : 20380 (BTD) R 20377 20380 17093 0 -1 4202496 30051 0 0 0 250148 1827 0 0 20 0 1 0 77872709 39948288 2429 18446744073709551615 4194304 35031035 140724868107552 140724868106552 7760122 0 0 1 0 0 0 0 17 1 0 0 11 0 0 37130264 37226188 45649920 140724868108767 140724868108843 140724868108843 140724868112337 0
/proc/20380/statm: 9753 2429 294 7529 0 2200 0
Current children cumulated CPU time: 2519.75 s
Current children cumulated vsize: 39012 KiB
Current children cumulated memory: 9716 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520
CPU time (s): 2519.77
CPU user time (s): 2501.49
CPU system time (s): 18.2791
CPU usage (%): 99.9907
Max. virtual memory (cumulated for all children) (KiB): 39012
Max. memory (cumulated for all children) (KiB): 9716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2501.49
system time used= 18.2791
maximum resident set size= 9716
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30051
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 738


# summary of solver processes directly reported to runsolver:
#   pid: 20380
#   total CPU time (s): 2519.77
#   total CPU user time (s): 2501.49
#   total CPU system time (s): 18.2791

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.66275 second user time and 15.5169 second system time

The end

Launcher Data 

Begin job on node127 at 2017-08-15 02:12:25
IDJOB=4265090
IDBENCH=134572
IDSOLVER=2654
FILE ID=node127/4265090-1502756794
RUNJOBID= node127-1502653304-21655
PBS_JOBID= 
Free space on /tmp= 61992 MiB

SOLVER NAME= BTD 2017-08-10
BENCH NAME= XCSP17/Blackhole/Blackhole-xcsp2-s07/Blackhole-4-07h-5_X2.xml
COMMAND LINE= BTD TIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265090-1502756794/watcher-4265090-1502756794 -o /tmp/evaluation-result-4265090-1502756794/solver-4265090-1502756794 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21655 --watchdog 2580  BTD 2520 HOME/instance-4265090-1502756794.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0d344e361328211ed16699cc315bd3d7
RANDOM SEED=1165670353

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31242596 kB
MemAvailable:   31929404 kB
Buffers:          241528 kB
Cached:           732928 kB
SwapCached:            0 kB
Active:           801240 kB
Inactive:         281144 kB
Active(anon):      57432 kB
Inactive(anon):    83808 kB
Active(file):     743808 kB
Inactive(file):   197336 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             38428 kB
Writeback:             0 kB
AnonPages:        128132 kB
Mapped:            52280 kB
Shmem:             33444 kB
Slab:             148948 kB
SReclaimable:     122996 kB
SUnreclaim:        25952 kB
KernelStack:        3264 kB
PageTables:         5076 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     384308 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     77824 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 61956 MiB
End job on node127 at 2017-08-15 02:54:26