Trace number 4265167

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2017-08-10? (TO) 2519.79 2520.01

General information on the benchmark

NameHaystacks/Haystacks-m1-s1/
Haystacks-44.xml
MD5SUM7674c6d5068d08c652f92e457f6b136c
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark29.971001
Satisfiable
(Un)Satisfiability was proved
Number of variables1936
Number of constraints41667
Number of domains1
Minimum domain size44
Maximum domain size44
Distribution of domain sizes[{"size":44,"count":1936}]
Minimum variable degree43
Maximum variable degree44
Distribution of variable degrees[{"degree":43,"count":1850},{"degree":44,"count":86}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":41667}]
Number of extensional constraints0
Number of intensional constraints41667
Distribution of constraint types[{"type":"intension","count":41667}]
Optimization problemNO
Type of objective

Solver Data 

42.80/42.91	c Version: 2017-08-10

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15078 MiB free)
  memory of node 1: 16384 MiB (15471 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265167-1502722956/watcher-4265167-1502722956 -o /tmp/evaluation-result-4265167-1502722956/solver-4265167-1502722956 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21654 --watchdog 2580 BTD 2520 HOME/instance-4265167-1502722956.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=10223, runsolver pid=10220

[startup+0.100156 s]*
/proc/loadavg: 2.01 2.02 2.05 3/181 10224
/proc/meminfo: memFree=31281956/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=33356 memory=3768 CPUtime=0.02 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 1082 0 0 0 2 0 0 0 20 0 1 0 74488853 34156544 942 18446744073709551615 4194304 35031035 140735232900064 140735232900064 4632139 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 8339 942 232 7529 0 786 0
Current children cumulated CPU time: 0.02 s
Current children cumulated vsize: 33356 KiB
Current children cumulated memory: 3768 KiB

[startup+0.209362 s]*
/proc/loadavg: 2.01 2.02 2.05 3/181 10224
/proc/meminfo: memFree=31275716/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=38584 memory=9088 CPUtime=0.13 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 2454 0 0 0 13 0 0 0 20 0 1 0 74488853 39510016 2272 18446744073709551615 4194304 35031035 140735232900064 140735232897240 7408826 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 9646 2272 242 7529 0 2093 0
Current children cumulated CPU time: 0.13 s
Current children cumulated vsize: 38584 KiB
Current children cumulated memory: 9088 KiB

[startup+0.309278 s]*
/proc/loadavg: 2.01 2.02 2.05 3/181 10224
/proc/meminfo: memFree=31275004/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=39364 memory=9664 CPUtime=0.22 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 2694 0 0 0 22 0 0 0 20 0 1 0 74488853 40308736 2416 18446744073709551615 4194304 35031035 140735232900064 140735232897240 7406622 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 9841 2416 285 7529 0 2288 0
Current children cumulated CPU time: 0.22 s
Current children cumulated vsize: 39364 KiB
Current children cumulated memory: 9664 KiB

[startup+0.700336 s]
/proc/loadavg: 1.93 2.00 2.04 3/181 10224
/proc/meminfo: memFree=31275004/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=39892 memory=10192 CPUtime=0.61 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 2832 0 0 0 61 0 0 0 20 0 1 0 74488853 40849408 2548 18446744073709551615 4194304 35031035 140735232900064 140735232897240 6449152 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 9973 2548 285 7529 0 2420 0
Current children cumulated CPU time: 0.61 s
Current children cumulated vsize: 39892 KiB
Current children cumulated memory: 10192 KiB

[startup+1.50033 s]
/proc/loadavg: 1.93 2.00 2.04 3/181 10224
/proc/meminfo: memFree=31274260/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=41124 memory=11248 CPUtime=1.41 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 3136 0 0 0 141 0 0 0 20 0 1 0 74488853 42110976 2812 18446744073709551615 4194304 35031035 140735232900064 140735232897240 4801843 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 10281 2812 285 7529 0 2728 0
Current children cumulated CPU time: 1.41 s
Current children cumulated vsize: 41124 KiB
Current children cumulated memory: 11248 KiB

[startup+3.10906 s]
/proc/loadavg: 1.93 2.00 2.04 3/181 10224
/proc/meminfo: memFree=31271036/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=43516 memory=13604 CPUtime=3.01 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 5722 0 0 0 301 0 0 0 20 0 1 0 74488853 44560384 3401 18446744073709551615 4194304 35031035 140735232900064 140735232897240 7982127 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 10879 3401 285 7529 0 3326 0
Current children cumulated CPU time: 3.01 s
Current children cumulated vsize: 43516 KiB
Current children cumulated memory: 13604 KiB

[startup+6.30036 s]
/proc/loadavg: 1.93 2.00 2.04 3/181 10224
/proc/meminfo: memFree=31265724/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=47984 memory=18128 CPUtime=6.2 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 9593 0 0 0 620 0 0 0 20 0 1 0 74488853 49135616 4532 18446744073709551615 4194304 35031035 140735232900064 140735232892888 7398467 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 11996 4532 285 7529 0 4443 0
Current children cumulated CPU time: 6.2 s
Current children cumulated vsize: 47984 KiB
Current children cumulated memory: 18128 KiB

[startup+12.7004 s]
/proc/loadavg: 1.94 2.00 2.04 3/181 10224
/proc/meminfo: memFree=31258656/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=55584 memory=25796 CPUtime=12.61 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 15449 0 0 0 1260 1 0 0 20 0 1 0 74488853 56918016 6449 18446744073709551615 4194304 35031035 140735232900064 140735232892888 4256494 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 13896 6449 285 7529 0 6343 0
Current children cumulated CPU time: 12.61 s
Current children cumulated vsize: 55584 KiB
Current children cumulated memory: 25796 KiB

[startup+25.5005 s]
/proc/loadavg: 1.95 2.00 2.04 3/181 10224
/proc/meminfo: memFree=31247400/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=66928 memory=37112 CPUtime=25.4 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 32228 0 0 0 2538 2 0 0 20 0 1 0 74488853 68534272 9278 18446744073709551615 4194304 35031035 140735232900064 140735232892696 7511436 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 16732 9278 286 7529 0 9179 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 66928 KiB
Current children cumulated memory: 37112 KiB

[startup+51.1094 s]
/proc/loadavg: 1.97 2.00 2.04 3/181 10225
/proc/meminfo: memFree=31156260/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159300 memory=127676 CPUtime=51.02 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 66369 0 0 0 5042 60 0 0 20 0 1 0 74488853 163123200 31919 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39825 31919 343 7529 0 32272 0
Current children cumulated CPU time: 51.02 s
Current children cumulated vsize: 159300 KiB
Current children cumulated memory: 127676 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/184 10240
/proc/meminfo: memFree=31152216/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159564 memory=128012 CPUtime=102.19 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 78434 0 0 0 9606 613 0 0 20 0 1 0 74488853 163393536 32003 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39891 32003 343 7529 0 32338 0
Current children cumulated CPU time: 102.19 s
Current children cumulated vsize: 159564 KiB
Current children cumulated memory: 128012 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/184 10242
/proc/meminfo: memFree=31150220/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159564 memory=129416 CPUtime=162.18 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 79070 0 0 0 14917 1301 0 0 20 0 1 0 74488853 163393536 32354 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39891 32354 343 7529 0 32338 0
Current children cumulated CPU time: 162.18 s
Current children cumulated vsize: 159564 KiB
Current children cumulated memory: 129416 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/181 10244
/proc/meminfo: memFree=31153148/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159564 memory=129444 CPUtime=222.17 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 79233 0 0 0 20247 1970 0 0 20 0 1 0 74488853 163393536 32361 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39891 32361 343 7529 0 32338 0
Current children cumulated CPU time: 222.17 s
Current children cumulated vsize: 159564 KiB
Current children cumulated memory: 129444 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/181 10246
/proc/meminfo: memFree=31153272/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159696 memory=129480 CPUtime=282.17 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 79390 0 0 0 25582 2635 0 0 20 0 1 0 74488853 163528704 32370 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39924 32370 343 7529 0 32371 0
Current children cumulated CPU time: 282.17 s
Current children cumulated vsize: 159696 KiB
Current children cumulated memory: 129480 KiB

[startup+342.3 s]
/proc/loadavg: 2.04 2.01 2.05 3/181 10248
/proc/meminfo: memFree=31153560/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159696 memory=129496 CPUtime=342.17 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 79522 0 0 0 30904 3313 0 0 20 0 1 0 74488853 163528704 32374 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39924 32374 343 7529 0 32371 0
Current children cumulated CPU time: 342.17 s
Current children cumulated vsize: 159696 KiB
Current children cumulated memory: 129496 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/181 10251
/proc/meminfo: memFree=31153692/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159696 memory=129512 CPUtime=402.17 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 79684 0 0 0 36242 3975 0 0 20 0 1 0 74488853 163528704 32378 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39924 32378 343 7529 0 32371 0
Current children cumulated CPU time: 402.17 s
Current children cumulated vsize: 159696 KiB
Current children cumulated memory: 129512 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/181 10253
/proc/meminfo: memFree=31153940/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159696 memory=129528 CPUtime=462.17 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 79822 0 0 0 41554 4663 0 0 20 0 1 0 74488853 163528704 32382 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39924 32382 343 7529 0 32371 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 159696 KiB
Current children cumulated memory: 129528 KiB


################
# More data... #
################

/proc/10223/statm: 39957 32417 343 7529 0 32404 0
Current children cumulated CPU time: 1722.1 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 129668 KiB

[startup+1782.3 s]
/proc/loadavg: 2.08 2.02 2.05 3/181 11528
/proc/meminfo: memFree=31152940/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=1782.1 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82084 0 0 0 159333 18877 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 1782.1 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+1842.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/181 11530
/proc/meminfo: memFree=31153072/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=1842.09 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82123 0 0 0 164739 19470 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 1842.09 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+1902.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/185 11547
/proc/meminfo: memFree=31148232/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=1902.1 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82172 0 0 0 170145 20065 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 1902.1 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+1962.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/185 11549
/proc/meminfo: memFree=31149044/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=1962.1 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82211 0 0 0 175553 20657 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 1962.1 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/182 11551
/proc/meminfo: memFree=31151588/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2022.09 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82250 0 0 0 180962 21247 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2022.09 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 11552
/proc/meminfo: memFree=31152084/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2082.09 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82299 0 0 0 186381 21828 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2082.09 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 11554
/proc/meminfo: memFree=31152596/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2142.08 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82338 0 0 0 191786 22422 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2142.08 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 11557
/proc/meminfo: memFree=31152340/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2202.08 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82377 0 0 0 197209 22999 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2202.08 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 11559
/proc/meminfo: memFree=31152264/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2262.08 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82426 0 0 0 202613 23595 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2262.08 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 11561
/proc/meminfo: memFree=31152364/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2322.08 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82469 0 0 0 208036 24172 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2322.08 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2382.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/181 11564
/proc/meminfo: memFree=31152364/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2382.07 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82512 0 0 0 213451 24756 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2382.07 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2442.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/180 11566
/proc/meminfo: memFree=31154048/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2442.07 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82561 0 0 0 218862 25345 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2442.07 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

[startup+2502.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/184 11583
/proc/meminfo: memFree=31149484/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2502.07 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82600 0 0 0 224288 25919 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2502.07 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.02 2.05 3/184 11585
/proc/meminfo: memFree=31149088/32770624 swapFree=67108860/67108860
[pid=10223] ppid=10220 vsize=159828 memory=130784 CPUtime=2519.78 cores=0,2,4,6
/proc/10223/stat : 10223 (BTD) R 10220 10223 17093 0 -1 4202496 82639 0 0 0 225888 26090 0 0 20 0 1 0 74488853 163663872 32696 18446744073709551615 4194304 35031035 140735232900064 140735232899064 7760122 0 0 1 0 0 0 0 17 4 0 0 8 0 0 37130264 37226188 41746432 140735232905695 140735232905771 140735232905771 140735232909265 0
/proc/10223/statm: 39957 32696 343 7529 0 32404 0
Current children cumulated CPU time: 2519.78 s
Current children cumulated vsize: 159828 KiB
Current children cumulated memory: 130784 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 10223 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2258.88 s, system=260.904 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.79
CPU user time (s): 2258.88
CPU system time (s): 260.904
CPU usage (%): 99.9912
Max. virtual memory (cumulated for all children) (KiB): 159828
Max. memory (cumulated for all children) (KiB): 130784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2258.88
system time used= 260.904
maximum resident set size= 130784
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 82639
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33
involuntary context switches= 2503


# summary of solver processes directly reported to runsolver:
#   pid: 10223
#   total CPU time (s): 2519.79
#   total CPU user time (s): 2258.88
#   total CPU system time (s): 260.904

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.30424 second user time and 15.8727 second system time

The end

Launcher Data 

Begin job on node127 at 2017-08-14 16:48:27
IDJOB=4265167
IDBENCH=126976
IDSOLVER=2654
FILE ID=node127/4265167-1502722956
RUNJOBID= node127-1502653304-21654
PBS_JOBID= 
Free space on /tmp= 61992 MiB

SOLVER NAME= BTD 2017-08-10
BENCH NAME= XCSP17/Haystacks/Haystacks-m1-s1/Haystacks-44.xml
COMMAND LINE= BTD TIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265167-1502722956/watcher-4265167-1502722956 -o /tmp/evaluation-result-4265167-1502722956/solver-4265167-1502722956 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21654 --watchdog 2580  BTD 2520 HOME/instance-4265167-1502722956.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7674c6d5068d08c652f92e457f6b136c
RANDOM SEED=1291884169

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31283480 kB
MemAvailable:   31942420 kB
Buffers:          232760 kB
Cached:           714828 kB
SwapCached:            0 kB
Active:           747884 kB
Inactive:         299180 kB
Active(anon):      49096 kB
Inactive(anon):    83820 kB
Active(file):     698788 kB
Inactive(file):   215360 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             39948 kB
Writeback:             4 kB
AnonPages:         99100 kB
Mapped:            50852 kB
Shmem:             33444 kB
Slab:             146668 kB
SReclaimable:     121252 kB
SUnreclaim:        25416 kB
KernelStack:        3216 kB
PageTables:         4960 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     376440 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     47104 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 61952 MiB
End job on node127 at 2017-08-14 17:30:27