Trace number 4295635

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD_12 2018-06-11_12? (TO) 2520.08 2520.01

General information on the benchmark

NameFrb/
frb-59-26-2-mgd_c18.xml
MD5SUMdbc5e7d30fbc7022ec2241ba28b1d399
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables59
Number of constraints549
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":59}]
Minimum variable degree13
Maximum variable degree29
Distribution of variable degrees[{"degree":13,"count":1},{"degree":14,"count":3},{"degree":15,"count":6},{"degree":16,"count":9},{"degree":17,"count":8},{"degree":18,"count":10},{"degree":19,"count":2},{"degree":20,"count":4},{"degree":21,"count":3},{"degree":22,"count":2},{"degree":23,"count":5},{"degree":24,"count":3},{"degree":25,"count":1},{"degree":27,"count":1},{"degree":29,"count":1}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":549}]
Number of extensional constraints549
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":549}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.06.11_12
2519.96/2520.00	s UNKNOWN
2519.96/2520.00	c  # Nodes: 2074968

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9634 MiB free)
  memory of node 1: 16384 MiB (10149 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4295635-1532594862/watcher-4295635-1532594862 -o /tmp/evaluation-result-4295635-1532594862/solver-4295635-1532594862 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532594862-3691 --watchdog 2580 BTD 12 2520 HOME/instance-4295635-1532594862.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=3719, runsolver pid=3715
Current StackSize limit: 8192 KiB


[startup+0.100108 s]*
/proc/loadavg: 0.92 1.12 1.38 3/190 3724
/proc/meminfo: memFree=20251640/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36048 memory=6016 CPUtime=0.1 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 1658 0 0 0 10 0 0 0 20 0 1 0 77049410 36913152 1504 33554432000 4194304 36388972 140731223903424 140731223897080 4458654 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9012 1504 487 7861 0 1116 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 36048 KiB
Current children cumulated memory: 6016 KiB

[startup+0.209636 s]*
/proc/loadavg: 0.92 1.12 1.38 4/190 3724
/proc/meminfo: memFree=20251640/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36196 memory=6016 CPUtime=0.21 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 1691 0 0 0 21 0 0 0 20 0 1 0 77049410 37064704 1504 33554432000 4194304 36388972 140731223903424 140731223897080 4458640 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9049 1504 487 7861 0 1153 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 36196 KiB
Current children cumulated memory: 6016 KiB

[startup+0.309341 s]*
/proc/loadavg: 0.92 1.12 1.38 3/190 3724
/proc/meminfo: memFree=20251268/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36196 memory=6280 CPUtime=0.31 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 1707 0 0 0 31 0 0 0 20 0 1 0 77049410 37064704 1570 33554432000 4194304 36388972 140731223903424 140731223897080 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9049 1570 499 7861 0 1153 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 36196 KiB
Current children cumulated memory: 6280 KiB

[startup+0.700233 s]
/proc/loadavg: 0.92 1.12 1.38 3/190 3724
/proc/meminfo: memFree=20250648/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36196 memory=6280 CPUtime=0.69 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 1712 0 0 0 69 0 0 0 20 0 1 0 77049410 37064704 1570 33554432000 4194304 36388972 140731223903424 140731223897080 4458654 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9049 1570 499 7861 0 1153 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36196 KiB
Current children cumulated memory: 6280 KiB

[startup+1.50025 s]
/proc/loadavg: 0.92 1.12 1.38 3/190 3724
/proc/meminfo: memFree=20250648/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36196 memory=6280 CPUtime=1.49 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 1723 0 0 0 149 0 0 0 20 0 1 0 77049410 37064704 1570 33554432000 4194304 36388972 140731223903424 140731223897080 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9049 1570 499 7861 0 1153 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 36196 KiB
Current children cumulated memory: 6280 KiB

[startup+3.10917 s]
/proc/loadavg: 0.92 1.12 1.38 3/190 3724
/proc/meminfo: memFree=20250256/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36328 memory=6392 CPUtime=3.1 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 2669 0 0 0 310 0 0 0 20 0 1 0 77049410 37199872 1598 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9082 1598 500 7861 0 1186 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 36328 KiB
Current children cumulated memory: 6392 KiB

[startup+6.30028 s]
/proc/loadavg: 0.93 1.11 1.38 3/190 3724
/proc/meminfo: memFree=20249352/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36328 memory=6448 CPUtime=6.29 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 3631 0 0 0 629 0 0 0 20 0 1 0 77049410 37199872 1612 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9082 1612 500 7861 0 1186 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 36328 KiB
Current children cumulated memory: 6448 KiB

[startup+12.7003 s]
/proc/loadavg: 1.02 1.13 1.38 3/190 3724
/proc/meminfo: memFree=20248176/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36460 memory=6520 CPUtime=12.69 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 4612 0 0 0 1268 1 0 0 20 0 1 0 77049410 37335040 1630 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9115 1630 500 7861 0 1219 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 36460 KiB
Current children cumulated memory: 6520 KiB

[startup+25.5003 s]
/proc/loadavg: 1.23 1.17 1.39 3/190 3724
/proc/meminfo: memFree=20248464/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36460 memory=6620 CPUtime=25.48 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 5722 0 0 0 2546 2 0 0 20 0 1 0 77049410 37335040 1655 33554432000 4194304 36388972 140731223903424 140731223902264 4458640 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9115 1655 500 7861 0 1219 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 36460 KiB
Current children cumulated memory: 6620 KiB

[startup+51.1092 s]
/proc/loadavg: 1.50 1.24 1.41 3/190 3724
/proc/meminfo: memFree=20248340/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6644 CPUtime=51.1 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 6289 0 0 0 5104 6 0 0 20 0 1 0 77049410 37470208 1661 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1661 500 7861 0 1252 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6644 KiB

[startup+102.3 s]
/proc/loadavg: 1.78 1.35 1.44 3/190 3725
/proc/meminfo: memFree=20248720/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6684 CPUtime=102.29 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 6869 0 0 0 10214 15 0 0 20 0 1 0 77049410 37470208 1671 33554432000 4194304 36388972 140731223903424 140731223902264 4458671 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1671 500 7861 0 1252 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6684 KiB

[startup+162.3 s]
/proc/loadavg: 1.92 1.47 1.47 3/191 3734
/proc/meminfo: memFree=20248360/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6712 CPUtime=162.3 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 7451 0 0 0 16205 25 0 0 20 0 1 0 77049410 37470208 1678 33554432000 4194304 36388972 140731223903424 140731223902264 4458353 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1678 500 7861 0 1252 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6712 KiB

[startup+222.3 s]
/proc/loadavg: 2.61 1.71 1.56 3/191 3735
/proc/meminfo: memFree=20248236/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6744 CPUtime=222.3 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 8035 0 0 0 22196 34 0 0 20 0 1 0 77049410 37470208 1686 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1686 502 7861 0 1252 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6744 KiB

[startup+282.3 s]
/proc/loadavg: 2.57 1.90 1.63 3/191 3736
/proc/meminfo: memFree=20249252/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6752 CPUtime=282.29 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 8621 0 0 0 28187 42 0 0 20 0 1 0 77049410 37470208 1688 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1688 502 7861 0 1252 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6752 KiB

[startup+342.3 s]
/proc/loadavg: 2.21 1.91 1.65 3/188 3737
/proc/meminfo: memFree=20249364/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6768 CPUtime=342.3 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 9210 0 0 0 34179 51 0 0 20 0 1 0 77049410 37470208 1692 33554432000 4194304 36388972 140731223903424 140731223902264 4458654 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1692 502 7861 0 1252 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6768 KiB

[startup+402.3 s]
/proc/loadavg: 2.08 1.93 1.68 3/188 3738
/proc/meminfo: memFree=20249364/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6772 CPUtime=402.3 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 9801 0 0 0 40171 59 0 0 20 0 1 0 77049410 37470208 1693 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1693 502 7861 0 1252 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6772 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 1.94 1.69 3/187 3740
/proc/meminfo: memFree=20249624/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36592 memory=6784 CPUtime=462.3 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 10395 0 0 0 46163 67 0 0 20 0 1 0 77049410 37470208 1696 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9148 1696 502 7861 0 1252 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 36592 KiB
Current children cumulated memory: 6784 KiB


################
# More data... #
################

/proc/3719/statm: 9181 1713 502 7861 0 1285 0
Current children cumulated CPU time: 1722.34 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6852 KiB

[startup+1782.3 s]
/proc/loadavg: 2.02 2.02 1.94 3/187 3802
/proc/meminfo: memFree=20249176/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6852 CPUtime=1782.33 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 23596 0 0 0 177954 279 0 0 20 0 1 0 77049410 37605376 1713 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1713 502 7861 0 1285 0
Current children cumulated CPU time: 1782.33 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6852 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 1.94 3/187 3803
/proc/meminfo: memFree=20249176/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6852 CPUtime=1842.34 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 24205 0 0 0 183947 287 0 0 20 0 1 0 77049410 37605376 1713 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1713 502 7861 0 1285 0
Current children cumulated CPU time: 1842.34 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6852 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/187 3804
/proc/meminfo: memFree=20248928/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6852 CPUtime=1902.34 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 24809 0 0 0 189937 297 0 0 20 0 1 0 77049410 37605376 1713 33554432000 4194304 36388972 140731223903424 140731223902264 4458633 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1713 502 7861 0 1285 0
Current children cumulated CPU time: 1902.34 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6852 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 3813
/proc/meminfo: memFree=20248556/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6852 CPUtime=1962.35 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 25413 0 0 0 195927 308 0 0 20 0 1 0 77049410 37605376 1713 33554432000 4194304 36388972 140731223903424 140731223902264 4458624 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1713 502 7861 0 1285 0
Current children cumulated CPU time: 1962.35 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6852 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 3814
/proc/meminfo: memFree=20248680/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6852 CPUtime=2022.34 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 26021 0 0 0 201917 317 0 0 20 0 1 0 77049410 37605376 1713 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1713 502 7861 0 1285 0
Current children cumulated CPU time: 2022.34 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6852 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 3815
/proc/meminfo: memFree=20249052/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2082.34 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 26625 0 0 0 207906 328 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2082.34 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 3816
/proc/meminfo: memFree=20249164/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2142.35 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 27228 0 0 0 213896 339 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2142.35 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2202.3 s]
/proc/loadavg: 2.08 2.03 1.96 3/188 3817
/proc/meminfo: memFree=20248916/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2202.35 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 27837 0 0 0 219888 347 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2202.35 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2262.3 s]
/proc/loadavg: 2.03 2.03 1.96 3/187 3819
/proc/meminfo: memFree=20248776/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2262.36 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 28443 0 0 0 225881 355 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 4458652 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2262.36 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 1.96 3/187 3820
/proc/meminfo: memFree=20248828/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2322.36 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 29048 0 0 0 231874 362 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 4466941 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2322.36 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 3821
/proc/meminfo: memFree=20248836/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2382.36 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 29652 0 0 0 237865 371 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2382.36 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 3823
/proc/meminfo: memFree=20249244/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6860 CPUtime=2442.36 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 30264 0 0 0 243858 378 0 0 20 0 1 0 77049410 37605376 1715 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1715 502 7861 0 1285 0
Current children cumulated CPU time: 2442.36 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6860 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 3824
/proc/meminfo: memFree=20248996/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6864 CPUtime=2502.36 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 30868 0 0 0 249848 388 0 0 20 0 1 0 77049410 37605376 1716 33554432000 4194304 36388972 140731223903424 140731223902264 8047815 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1716 502 7861 0 1285 0
Current children cumulated CPU time: 2502.36 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6864 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 1.96 3/187 3824
/proc/meminfo: memFree=20249120/32770624 swapFree=67108860/67108860
[pid=3719] ppid=3715 vsize=36724 memory=6872 CPUtime=2520.06 cores=1,3,5,7
/proc/3719/stat : 3719 (BTD) R 3715 3719 2022 0 -1 4202496 31543 0 0 0 251615 391 0 0 20 0 1 0 77049410 37605376 1718 33554432000 4194304 36388972 140731223903424 140731223902264 7015728 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 67641344 140731223909564 140731223909643 140731223909643 140731223912401 0
/proc/3719/statm: 9181 1718 504 7861 0 1285 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 36724 KiB
Current children cumulated memory: 6872 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 3719 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2516.16 s, system=3.92011 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2520.08
CPU user time (s): 2516.16
CPU system time (s): 3.92011
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 36724
Max. memory (cumulated for all children) (KiB): 6872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2516.16
system time used= 3.92011
maximum resident set size= 6880
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31544
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 870


# summary of solver processes directly reported to runsolver:
#   pid: 3719
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2516.16
#   total CPU system time (s): 3.92011

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.096 second user time and 15.0389 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-26 10:47:42
IDJOB=4295635
IDBENCH=141585
IDSOLVER=2748
FILE ID=node103/4295635-1532594862
RUNJOBID= node103-1532594862-3691
PBS_JOBID= 21021969
Free space on /tmp= 56544 MiB

SOLVER NAME= BTD_12 2018-06-11_12
BENCH NAME= XCSP18/Frb/frb-59-26-2-mgd_c18.xml
COMMAND LINE= BTD 12 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4295635-1532594862/watcher-4295635-1532594862 -o /tmp/evaluation-result-4295635-1532594862/solver-4295635-1532594862 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532594862-3691 --watchdog 2580  BTD 12 2520 HOME/instance-4295635-1532594862.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dbc5e7d30fbc7022ec2241ba28b1d399
RANDOM SEED=136177321

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20259248 kB
MemAvailable:   31930340 kB
Buffers:          285456 kB
Cached:         11572164 kB
SwapCached:            0 kB
Active:          3896564 kB
Inactive:        8013748 kB
Active(anon):      55932 kB
Inactive(anon):    25192 kB
Active(file):    3840632 kB
Inactive(file):  7988556 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:            106336 kB
Writeback:            12 kB
AnonPages:         64084 kB
Mapped:            40520 kB
Shmem:             25228 kB
Slab:             298208 kB
SReclaimable:     270364 kB
SUnreclaim:        27844 kB
KernelStack:        3248 kB
PageTables:         5148 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     325924 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56440 MiB
End job on node103 at 2018-07-26 11:29:42