Trace number 4386909

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 19.07.01? (TO) 2520.01 2519.8

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-07.xml
MD5SUMcae06e42b01baa71e2bfd0e1b4deb8b1
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark18.1078
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 19.07.01

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8506 MiB free)
  memory of node 1: 16384 MiB (8982 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4386909-1568283697/watcher-4386909-1568283697 -o /tmp/evaluation-result-4386909-1568283697/solver-4386909-1568283697 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1568280861-8240 --watchdog 2580 BTD 2520 HOME/instance-4386909-1568283697.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=9355, runsolver pid=9352

[startup+0.100154 s]*
/proc/loadavg: 2.00 2.01 1.91 3/200 9356
/proc/meminfo: memFree=17902888/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=37768 memory=7376 CPUtime=0.1 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 2011 0 0 0 10 0 0 0 20 0 1 0 404531290 38674432 1844 33554432000 4194304 36700936 140733536420528 140733536420528 4620329 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9442 1844 464 7937 0 1470 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 37768 KiB
Current children cumulated memory: 7376 KiB

[startup+0.209631 s]*
/proc/loadavg: 2.00 2.01 1.91 3/200 9356
/proc/meminfo: memFree=17902888/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=37768 memory=7376 CPUtime=0.21 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 2012 0 0 0 21 0 0 0 20 0 1 0 404531290 38674432 1844 33554432000 4194304 36700936 140733536420528 140733536420528 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9442 1844 464 7937 0 1470 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 37768 KiB
Current children cumulated memory: 7376 KiB

[startup+0.309081 s]*
/proc/loadavg: 2.00 2.01 1.91 3/200 9356
/proc/meminfo: memFree=17902516/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=38032 memory=7640 CPUtime=0.31 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 2071 0 0 0 31 0 0 0 20 0 1 0 404531290 38944768 1910 33554432000 4194304 36700936 140733536420528 140733536420528 4620203 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9508 1910 485 7937 0 1536 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 38032 KiB
Current children cumulated memory: 7640 KiB

[startup+0.700271 s]
/proc/loadavg: 2.00 2.01 1.91 3/200 9356
/proc/meminfo: memFree=17902220/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=38296 memory=7904 CPUtime=0.69 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 2130 0 0 0 69 0 0 0 20 0 1 0 404531290 39215104 1976 33554432000 4194304 36700936 140733536420528 140733536420528 6947475 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9574 1976 486 7937 0 1602 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38296 KiB
Current children cumulated memory: 7904 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 1.91 3/200 9356
/proc/meminfo: memFree=17901848/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=38428 memory=8168 CPUtime=1.49 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 2180 0 0 0 149 0 0 0 20 0 1 0 404531290 39350272 2042 33554432000 4194304 36700936 140733536420528 140733536420528 4269584 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9607 2042 486 7937 0 1635 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 38428 KiB
Current children cumulated memory: 8168 KiB

[startup+3.10907 s]
/proc/loadavg: 1.84 1.98 1.90 3/200 9356
/proc/meminfo: memFree=17899572/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=38560 memory=8220 CPUtime=3.1 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 3153 0 0 0 309 1 0 0 20 0 1 0 404531290 39485440 2055 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9640 2055 486 7937 0 1668 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 38560 KiB
Current children cumulated memory: 8220 KiB

[startup+6.30026 s]
/proc/loadavg: 1.84 1.98 1.90 3/200 9357
/proc/meminfo: memFree=17900412/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=38824 memory=8568 CPUtime=6.29 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 4220 0 0 0 627 2 0 0 20 0 1 0 404531290 39755776 2142 33554432000 4194304 36700936 140733536420528 140733536419112 4620276 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9706 2142 486 7937 0 1734 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 38824 KiB
Current children cumulated memory: 8568 KiB

[startup+12.7003 s]
/proc/loadavg: 1.87 1.98 1.90 3/200 9357
/proc/meminfo: memFree=17900056/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=38956 memory=8676 CPUtime=12.69 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 5277 0 0 0 1265 4 0 0 20 0 1 0 404531290 39890944 2169 33554432000 4194304 36700936 140733536420528 140733536419576 6947456 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9739 2169 486 7937 0 1767 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 38956 KiB
Current children cumulated memory: 8676 KiB

[startup+25.5003 s]
/proc/loadavg: 1.89 1.98 1.90 3/200 9357
/proc/meminfo: memFree=17899372/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39088 memory=8760 CPUtime=25.49 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 7447 0 0 0 2541 8 0 0 20 0 1 0 404531290 40026112 2190 33554432000 4194304 36700936 140733536420528 140733536419576 4620255 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9772 2190 486 7937 0 1800 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 39088 KiB
Current children cumulated memory: 8760 KiB

[startup+51.1093 s]
/proc/loadavg: 2.01 2.00 1.91 3/200 9359
/proc/meminfo: memFree=17899236/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39088 memory=8880 CPUtime=51.1 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 8531 0 0 0 5094 16 0 0 20 0 1 0 404531290 40026112 2220 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9772 2220 486 7937 0 1800 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 39088 KiB
Current children cumulated memory: 8880 KiB

[startup+102.3 s]
/proc/loadavg: 2.32 2.10 1.95 3/200 9363
/proc/meminfo: memFree=17896664/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39220 memory=8984 CPUtime=102.3 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 9733 0 0 0 10201 29 0 0 20 0 1 0 404531290 40161280 2246 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9805 2246 486 7937 0 1833 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 39220 KiB
Current children cumulated memory: 8984 KiB

[startup+162.3 s]
/proc/loadavg: 2.12 2.09 1.95 3/200 9367
/proc/meminfo: memFree=17897388/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39352 memory=9108 CPUtime=162.3 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 10390 0 0 0 16186 44 0 0 20 0 1 0 404531290 40296448 2277 33554432000 4194304 36700936 140733536420528 140733536419576 6947504 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9838 2277 486 7937 0 1866 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 39352 KiB
Current children cumulated memory: 9108 KiB

[startup+222.3 s]
/proc/loadavg: 2.04 2.07 1.95 3/200 9373
/proc/meminfo: memFree=17897016/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39352 memory=9156 CPUtime=222.31 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 11042 0 0 0 22171 60 0 0 20 0 1 0 404531290 40296448 2289 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9838 2289 486 7937 0 1866 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 39352 KiB
Current children cumulated memory: 9156 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.06 1.95 3/199 9378
/proc/meminfo: memFree=17897444/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39484 memory=9248 CPUtime=282.32 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 11083 0 0 0 28156 76 0 0 20 0 1 0 404531290 40431616 2312 33554432000 4194304 36700936 140733536420528 140733536419576 4620264 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9871 2312 486 7937 0 1899 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 39484 KiB
Current children cumulated memory: 9248 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.05 1.95 3/199 9382
/proc/meminfo: memFree=17897536/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39484 memory=9248 CPUtime=342.32 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 11699 0 0 0 34142 90 0 0 20 0 1 0 404531290 40431616 2312 33554432000 4194304 36700936 140733536420528 140733536419576 4620288 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9871 2312 486 7937 0 1899 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 39484 KiB
Current children cumulated memory: 9248 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 1.95 3/199 9388
/proc/meminfo: memFree=17897532/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39484 memory=9248 CPUtime=402.32 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 11700 0 0 0 40125 107 0 0 20 0 1 0 404531290 40431616 2312 33554432000 4194304 36700936 140733536420528 140733536419576 4620288 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9871 2312 486 7937 0 1899 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 39484 KiB
Current children cumulated memory: 9248 KiB

[startup+462.3 s]
/proc/loadavg: 1.95 2.02 1.95 3/199 9393
/proc/meminfo: memFree=17897596/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39484 memory=9324 CPUtime=462.33 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 12428 0 0 0 46111 122 0 0 20 0 1 0 404531290 40431616 2331 33554432000 4194304 36700936 140733536420528 140733536419576 6947475 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9871 2331 486 7937 0 1899 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 39484 KiB
Current children cumulated memory: 9324 KiB


################
# More data... #
################

/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 1722.44 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9519
/proc/meminfo: memFree=17895828/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=1782.45 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 16422 0 0 0 177858 387 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 1782.45 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9525
/proc/meminfo: memFree=17895904/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=1842.45 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 16422 0 0 0 183845 400 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 4620264 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 1842.45 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9529
/proc/meminfo: memFree=17895936/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=1902.45 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 16718 0 0 0 189834 411 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 4620276 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 1902.45 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9533
/proc/meminfo: memFree=17896740/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=1962.46 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 16742 0 0 0 195823 423 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 6947517 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 1962.46 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9539
/proc/meminfo: memFree=17896700/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=2022.47 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17062 0 0 0 201813 434 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 2022.47 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/198 9544
/proc/meminfo: memFree=17897316/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=2082.47 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17062 0 0 0 207803 444 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 8340231 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 2082.47 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/199 9549
/proc/meminfo: memFree=17896752/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=39880 memory=9672 CPUtime=2142.47 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17358 0 0 0 213792 455 0 0 20 0 1 0 404531290 40837120 2418 33554432000 4194304 36700936 140733536420528 140733536419576 6947479 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 9970 2418 486 7937 0 1998 0
Current children cumulated CPU time: 2142.47 s
Current children cumulated vsize: 39880 KiB
Current children cumulated memory: 9672 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/199 9555
/proc/meminfo: memFree=17896076/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2202.48 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17415 0 0 0 219781 467 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4620255 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2202.48 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/199 9560
/proc/meminfo: memFree=17896808/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2262.48 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17677 0 0 0 225769 479 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4620264 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2262.48 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/199 9564
/proc/meminfo: memFree=17896920/32770624 swapFree=67004032/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2322.49 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17677 0 0 0 231758 491 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4620276 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2322.49 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9578
/proc/meminfo: memFree=17895964/32770624 swapFree=67004036/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2382.5 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17939 0 0 0 237747 503 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4620348 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2382.5 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9604
/proc/meminfo: memFree=17895412/32770624 swapFree=67004036/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2442.5 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 17939 0 0 0 243736 514 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4620288 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2442.5 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/200 9608
/proc/meminfo: memFree=17896292/32770624 swapFree=67004036/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2502.51 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 18201 0 0 0 249724 527 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4620281 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2502.51 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 2.01 2.01 2/193 9656
/proc/meminfo: memFree=17965836/32770624 swapFree=67004036/67108860
[pid=9355] ppid=9352 vsize=40016 memory=9760 CPUtime=2520 cores=1,3,5,7
/proc/9355/stat : 9355 (BTD) R 9352 9355 8208 0 -1 4202496 18201 0 0 0 251468 532 0 0 20 0 1 0 404531290 40976384 2440 33554432000 4194304 36700936 140733536420528 140733536419576 4468743 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38800048 38936640 61706240 140733536425000 140733536425076 140733536425076 140733536427985 0
/proc/9355/statm: 10004 2440 486 7937 0 2032 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 40016 KiB
Current children cumulated memory: 9760 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 9355 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2514.69 s, system=5.32348 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.8
CPU time (s): 2520.01
CPU user time (s): 2514.69
CPU system time (s): 5.32348
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 40016
Max. memory (cumulated for all children) (KiB): 9760

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2514.69
system time used= 5.32348
maximum resident set size= 9760
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18201
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 3119


# summary of solver processes directly reported to runsolver:
#   pid: 9355
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2514.69
#   total CPU system time (s): 5.32348

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.2191 second user time and 16.5695 second system time

The end

Launcher Data 

Begin job on node148 at 2019-09-12 12:21:00
IDJOB=4386909
IDBENCH=138974
IDSOLVER=2822
FILE ID=node148/4386909-1568283697
RUNJOBID= node148-1568280861-8240
PBS_JOBID= 21701063
Free space on /tmp= 54228 MiB

SOLVER NAME= BTD 19.07.01
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-07.xml
COMMAND LINE= BTD TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4386909-1568283697/watcher-4386909-1568283697 -o /tmp/evaluation-result-4386909-1568283697/solver-4386909-1568283697 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1568280861-8240 --watchdog 2580  BTD 2520 HOME/instance-4386909-1568283697.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cae06e42b01baa71e2bfd0e1b4deb8b1
RANDOM SEED=453247886

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        17908412 kB
MemAvailable:   31856288 kB
Buffers:          162944 kB
Cached:         13889484 kB
SwapCached:         3980 kB
Active:          2713888 kB
Inactive:       11351656 kB
Active(anon):      16208 kB
Inactive(anon):    37656 kB
Active(file):    2697680 kB
Inactive(file): 11314000 kB
Unevictable:      109256 kB
Mlocked:          109256 kB
SwapTotal:      67108860 kB
SwapFree:       67004032 kB
Dirty:             44460 kB
Writeback:         69748 kB
AnonPages:        124000 kB
Mapped:            43496 kB
Shmem:             32152 kB
Slab:             392300 kB
SReclaimable:     364656 kB
SUnreclaim:        27644 kB
KernelStack:        3616 kB
PageTables:         5112 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     533940 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 54228 MiB
End job on node148 at 2019-09-12 13:03:00