Trace number 4306098

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD_12 2018.07.27_12? (TO) 2520.04 2520.01

General information on the benchmark

NameEternity/
Eternity-15-15_c18.xml
MD5SUM07f6a500cdb84e44b97e5b2e1697edff
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables705
Number of constraints286
Number of domains2
Minimum domain size22
Maximum domain size225
Distribution of domain sizes[{"size":22,"count":480},{"size":225,"count":225}]
Minimum variable degree1
Maximum variable degree16
Distribution of variable degrees[{"degree":1,"count":14},{"degree":2,"count":690},{"degree":16,"count":1}]
Minimum constraint arity1
Maximum constraint arity225
Distribution of constraint arities[{"arity":1,"count":60},{"arity":5,"count":225},{"arity":225,"count":1}]
Number of extensional constraints225
Number of intensional constraints60
Distribution of constraint types[{"type":"extension","count":225},{"type":"intension","count":60},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.07.27_12

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10527 MiB free)
  memory of node 1: 16384 MiB (13552 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4306098-1534131927/watcher-4306098-1534131927 -o /tmp/evaluation-result-4306098-1534131927/solver-4306098-1534131927 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1534100983-28908 --watchdog 2580 BTD 12 2520 HOME/instance-4306098-1534131927.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=404, runsolver pid=401

[startup+0.100168 s]*
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24647376/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=41788 memory=11684 CPUtime=0.1 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 3067 0 0 0 10 0 0 0 20 0 1 0 230755916 42790912 2921 33554432000 4194304 36388936 140725086584672 140725086584672 7657254 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 10447 2921 441 7861 0 2551 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 41788 KiB
Current children cumulated memory: 11684 KiB

[startup+0.209583 s]*
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24642540/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=47004 memory=16700 CPUtime=0.2 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 4358 0 0 0 20 0 0 0 20 0 1 0 230755916 48132096 4175 33554432000 4194304 36388936 140725086584672 140725086584672 6634302 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 11751 4175 441 7861 0 3855 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 47004 KiB
Current children cumulated memory: 16700 KiB

[startup+0.309506 s]*
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24633240/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=56196 memory=25412 CPUtime=0.3 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 6538 0 0 0 30 0 0 0 20 0 1 0 230755916 57544704 6353 33554432000 4194304 36388936 140725086584672 140725086584672 7657254 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14049 6353 505 7861 0 6153 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 56196 KiB
Current children cumulated memory: 25412 KiB

[startup+0.700398 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24633240/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=56328 memory=25676 CPUtime=0.69 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 6578 0 0 0 69 0 0 0 20 0 1 0 230755916 57679872 6419 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14082 6419 510 7861 0 6186 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 56328 KiB
Current children cumulated memory: 25676 KiB

[startup+1.50035 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24632836/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=56460 memory=25676 CPUtime=1.49 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 6610 0 0 0 149 0 0 0 20 0 1 0 230755916 57815040 6419 33554432000 4194304 36388936 140725086584672 140725086583512 4420665 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14115 6419 510 7861 0 6219 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 56460 KiB
Current children cumulated memory: 25676 KiB

[startup+3.10927 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24632588/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=56592 memory=25972 CPUtime=3.1 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 10130 0 0 0 310 0 0 0 20 0 1 0 230755916 57950208 6493 33554432000 4194304 36388936 140725086584672 140725086583512 4420591 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14148 6493 511 7861 0 6252 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 56592 KiB
Current children cumulated memory: 25972 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24632208/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=56592 memory=26092 CPUtime=6.29 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 13379 0 0 0 629 0 0 0 20 0 1 0 230755916 57950208 6523 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14148 6523 511 7861 0 6252 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 56592 KiB
Current children cumulated memory: 26092 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24632208/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=56724 memory=26108 CPUtime=12.69 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 16394 0 0 0 1268 1 0 0 20 0 1 0 230755916 58085376 6527 33554432000 4194304 36388936 140725086584672 140725086583512 4420719 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14181 6527 511 7861 0 6285 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 56724 KiB
Current children cumulated memory: 26108 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24631464/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=57388 memory=26880 CPUtime=25.49 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 24107 0 0 0 2548 1 0 0 20 0 1 0 230755916 58765312 6720 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14347 6720 514 7861 0 6451 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 57388 KiB
Current children cumulated memory: 26880 KiB

[startup+51.109 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 405
/proc/meminfo: memFree=24630844/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=57788 memory=27232 CPUtime=51.1 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 28554 0 0 0 5109 1 0 0 20 0 1 0 230755916 59174912 6808 33554432000 4194304 36388936 140725086584672 140725086583512 4420302 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14447 6808 524 7861 0 6551 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 57788 KiB
Current children cumulated memory: 27232 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 406
/proc/meminfo: memFree=24631132/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=57920 memory=27488 CPUtime=102.28 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 30452 0 0 0 10227 1 0 0 20 0 1 0 230755916 59310080 6872 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14480 6872 524 7861 0 6584 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 57920 KiB
Current children cumulated memory: 27488 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 407
/proc/meminfo: memFree=24630760/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=58052 memory=27672 CPUtime=162.29 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 30920 0 0 0 16227 2 0 0 20 0 1 0 230755916 59445248 6918 33554432000 4194304 36388936 140725086584672 140725086583512 6663872 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14513 6918 524 7861 0 6617 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 58052 KiB
Current children cumulated memory: 27672 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 408
/proc/meminfo: memFree=24630792/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=58184 memory=27720 CPUtime=222.29 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 31389 0 0 0 22227 2 0 0 20 0 1 0 230755916 59580416 6930 33554432000 4194304 36388936 140725086584672 140725086583512 4420665 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14546 6930 524 7861 0 6650 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 58184 KiB
Current children cumulated memory: 27720 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 418
/proc/meminfo: memFree=24630188/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=58184 memory=27760 CPUtime=282.29 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 31868 0 0 0 28227 2 0 0 20 0 1 0 230755916 59580416 6940 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14546 6940 524 7861 0 6650 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 58184 KiB
Current children cumulated memory: 27760 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 419
/proc/meminfo: memFree=24630680/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=58184 memory=27812 CPUtime=342.28 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 32333 0 0 0 34226 2 0 0 20 0 1 0 230755916 59580416 6953 33554432000 4194304 36388936 140725086584672 140725086583512 4420660 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14546 6953 524 7861 0 6650 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 58184 KiB
Current children cumulated memory: 27812 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 420
/proc/meminfo: memFree=24630448/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=58316 memory=27904 CPUtime=402.28 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 32817 0 0 0 40226 2 0 0 20 0 1 0 230755916 59715584 6976 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14579 6976 524 7861 0 6683 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 58316 KiB
Current children cumulated memory: 27904 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 421
/proc/meminfo: memFree=24630328/32770624 swapFree=67058932/67108860
[pid=404] ppid=401 vsize=58316 memory=27928 CPUtime=462.28 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 33168 0 0 0 46226 2 0 0 20 0 1 0 230755916 59715584 6982 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14579 6982 524 7861 0 6683 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 58316 KiB
Current children cumulated memory: 27928 KiB


################
# More data... #
################

/proc/404/statm: 14744 7143 524 7861 0 6848 0
Current children cumulated CPU time: 1722.31 s
Current children cumulated vsize: 58976 KiB
Current children cumulated memory: 28572 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/187 487
/proc/meminfo: memFree=24630028/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=58976 memory=28572 CPUtime=1782.31 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 36320 0 0 0 178227 4 0 0 20 0 1 0 230755916 60391424 7143 33554432000 4194304 36388936 140725086584672 140725086583512 6663856 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14744 7143 524 7861 0 6848 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 58976 KiB
Current children cumulated memory: 28572 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 488
/proc/meminfo: memFree=24629540/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28612 CPUtime=1842.31 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 36517 0 0 0 184227 4 0 0 20 0 1 0 230755916 60526592 7153 33554432000 4194304 36388936 140725086584672 140725086583512 4420660 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7153 524 7861 0 6881 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28612 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 489
/proc/meminfo: memFree=24629792/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28612 CPUtime=1902.31 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 36648 0 0 0 190227 4 0 0 20 0 1 0 230755916 60526592 7153 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7153 524 7861 0 6881 0
Current children cumulated CPU time: 1902.31 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28612 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 490
/proc/meminfo: memFree=24629544/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28612 CPUtime=1962.31 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 36778 0 0 0 196227 4 0 0 20 0 1 0 230755916 60526592 7153 33554432000 4194304 36388936 140725086584672 140725086583512 4420738 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7153 524 7861 0 6881 0
Current children cumulated CPU time: 1962.31 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28612 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 491
/proc/meminfo: memFree=24629420/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28612 CPUtime=2022.31 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 36993 0 0 0 202227 4 0 0 20 0 1 0 230755916 60526592 7153 33554432000 4194304 36388936 140725086584672 140725086583512 4420665 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7153 524 7861 0 6881 0
Current children cumulated CPU time: 2022.31 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28612 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 500
/proc/meminfo: memFree=24628716/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28636 CPUtime=2082.31 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37125 0 0 0 208227 4 0 0 20 0 1 0 230755916 60526592 7159 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7159 524 7861 0 6881 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28636 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 501
/proc/meminfo: memFree=24629080/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28664 CPUtime=2142.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37332 0 0 0 214227 5 0 0 20 0 1 0 230755916 60526592 7166 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7166 524 7861 0 6881 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28664 KiB

[startup+2202.3 s]
/proc/loadavg: 1.56 1.90 2.01 2/181 555
/proc/meminfo: memFree=24834588/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28684 CPUtime=2202.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37446 0 0 0 220227 5 0 0 20 0 1 0 230755916 60526592 7171 33554432000 4194304 36388936 140725086584672 140725086583512 4420672 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7171 524 7861 0 6881 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28684 KiB

[startup+2262.3 s]
/proc/loadavg: 1.21 1.74 1.94 2/181 556
/proc/meminfo: memFree=24834956/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28684 CPUtime=2262.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37555 0 0 0 226227 5 0 0 20 0 1 0 230755916 60526592 7171 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7171 524 7861 0 6881 0
Current children cumulated CPU time: 2262.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28684 KiB

[startup+2322.3 s]
/proc/loadavg: 1.08 1.60 1.89 2/181 557
/proc/meminfo: memFree=24835364/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28688 CPUtime=2322.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37652 0 0 0 232227 5 0 0 20 0 1 0 230755916 60526592 7172 33554432000 4194304 36388936 140725086584672 140725086583512 4420683 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7172 524 7861 0 6881 0
Current children cumulated CPU time: 2322.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28688 KiB

[startup+2382.3 s]
/proc/loadavg: 1.03 1.49 1.83 2/180 559
/proc/meminfo: memFree=24835456/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28688 CPUtime=2382.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37746 0 0 0 238227 5 0 0 20 0 1 0 230755916 60526592 7172 33554432000 4194304 36388936 140725086584672 140725086583512 4420648 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7172 524 7861 0 6881 0
Current children cumulated CPU time: 2382.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28688 KiB

[startup+2442.3 s]
/proc/loadavg: 1.01 1.40 1.78 2/180 560
/proc/meminfo: memFree=24835472/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28692 CPUtime=2442.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 37959 0 0 0 244227 5 0 0 20 0 1 0 230755916 60526592 7173 33554432000 4194304 36388936 140725086584672 140725086583512 4420669 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7173 524 7861 0 6881 0
Current children cumulated CPU time: 2442.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28692 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.33 1.73 2/180 561
/proc/meminfo: memFree=24835664/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28700 CPUtime=2502.32 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 38091 0 0 0 250227 5 0 0 20 0 1 0 230755916 60526592 7175 33554432000 4194304 36388936 140725086584672 140725086583512 4420665 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7175 524 7861 0 6881 0
Current children cumulated CPU time: 2502.32 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28700 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.31 1.71 2/180 561
/proc/meminfo: memFree=24835664/32770624 swapFree=67058936/67108860
[pid=404] ppid=401 vsize=59108 memory=28700 CPUtime=2520.03 cores=1,3,5,7
/proc/404/stat : 404 (BTD) R 401 404 28876 0 -1 4202496 38202 0 0 0 251998 5 0 0 20 0 1 0 230755916 60526592 7175 33554432000 4194304 36388936 140725086584672 140725086583512 4420674 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 71286784 140725086590140 140725086590219 140725086590219 140725086592977 0
/proc/404/statm: 14777 7175 524 7861 0 6881 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 59108 KiB
Current children cumulated memory: 28700 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 404 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.99 s, system=0.058 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2520.04
CPU user time (s): 2519.99
CPU system time (s): 0.058
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 59108
Max. memory (cumulated for all children) (KiB): 28700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.99
system time used= 0.058
maximum resident set size= 28700
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 38202
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11
involuntary context switches= 891


# summary of solver processes directly reported to runsolver:
#   pid: 404
#   total CPU time (s): 2520.04
#   total CPU user time (s): 2519.99
#   total CPU system time (s): 0.058

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.80028 second user time and 16.5817 second system time

The end

Launcher Data 

Begin job on node103 at 2018-08-13 05:45:27
IDJOB=4306098
IDBENCH=141653
IDSOLVER=2785
FILE ID=node103/4306098-1534131927
RUNJOBID= node103-1534100983-28908
PBS_JOBID= 21037009
Free space on /tmp= 34580 MiB

SOLVER NAME= BTD_12 2018.07.27_12
BENCH NAME= XCSP18/Eternity/Eternity-15-15_c18.xml
COMMAND LINE= BTD 12 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4306098-1534131927/watcher-4306098-1534131927 -o /tmp/evaluation-result-4306098-1534131927/solver-4306098-1534131927 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1534100983-28908 --watchdog 2580  BTD 12 2520 HOME/instance-4306098-1534131927.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 07f6a500cdb84e44b97e5b2e1697edff
RANDOM SEED=802798944

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24657316 kB
MemAvailable:   31793700 kB
Buffers:          137716 kB
Cached:          7182212 kB
SwapCached:         5340 kB
Active:          4175920 kB
Inactive:        3307300 kB
Active(anon):     155392 kB
Inactive(anon):    59464 kB
Active(file):    4020528 kB
Inactive(file):  3247836 kB
Unevictable:        7796 kB
Mlocked:            7796 kB
SwapTotal:      67108860 kB
SwapFree:       67058932 kB
Dirty:             55572 kB
Writeback:             0 kB
AnonPages:        174572 kB
Mapped:            53372 kB
Shmem:             48664 kB
Slab:             325844 kB
SReclaimable:     296480 kB
SUnreclaim:        29364 kB
KernelStack:        3568 kB
PageTables:         5240 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     529544 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    157696 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 34580 MiB
End job on node103 at 2018-08-13 06:27:27