Trace number 4301129

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
miniBTD 2018.07.27_3? (TO) 2519.95 2520.01

General information on the benchmark

NameSubisomorphism/
Subisomorphism-g29-g50_c18.xml
MD5SUM6b43bee46cd3f7faf4796c0903a8d917
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints996
Number of domains1
Minimum domain size128
Maximum domain size128
Distribution of domain sizes[{"size":128,"count":100}]
Minimum variable degree11
Maximum variable degree33
Distribution of variable degrees[{"degree":11,"count":1},{"degree":12,"count":2},{"degree":13,"count":4},{"degree":14,"count":4},{"degree":16,"count":2},{"degree":17,"count":7},{"degree":18,"count":10},{"degree":19,"count":11},{"degree":20,"count":17},{"degree":21,"count":14},{"degree":22,"count":6},{"degree":23,"count":4},{"degree":24,"count":7},{"degree":25,"count":3},{"degree":26,"count":5},{"degree":27,"count":2},{"degree":33,"count":1}]
Minimum constraint arity1
Maximum constraint arity100
Distribution of constraint arities[{"arity":1,"count":89},{"arity":2,"count":906},{"arity":100,"count":1}]
Number of extensional constraints995
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":995},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 2018-07-27_3

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11581 MiB free)
  memory of node 1: 16384 MiB (15691 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4301129-1532858985/watcher-4301129-1532858985 -o /tmp/evaluation-result-4301129-1532858985/solver-4301129-1532858985 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1532843502-8703 --watchdog 2580 miniBTD 3 2520 HOME/instance-4301129-1532858985.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=10851, runsolver pid=10848

[startup+0.100121 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27901256/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=53684 memory=29856 CPUtime=0.1 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 7660 0 0 0 10 0 0 0 20 0 1 0 103461718 54972416 7464 33554432000 4194304 5224696 140737386958736 140737386955736 140697551452990 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 13421 7464 594 252 0 6967 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 53684 KiB
Current children cumulated memory: 29856 KiB

[startup+0.209722 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27872224/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=82328 memory=58632 CPUtime=0.2 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 14849 0 0 0 19 1 0 0 20 0 1 0 103461718 84303872 14658 33554432000 4194304 5224696 140737386958736 140737386955736 140697551457253 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 20582 14658 594 252 0 14128 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 82328 KiB
Current children cumulated memory: 58632 KiB

[startup+0.309501 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27845812/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=108596 memory=84768 CPUtime=0.3 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 21399 0 0 0 28 2 0 0 20 0 1 0 103461718 111202304 21192 33554432000 4194304 5224696 140737386958736 140737386955736 140697551457253 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 27149 21192 594 252 0 20695 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 108596 KiB
Current children cumulated memory: 84768 KiB

[startup+0.700313 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27793608/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=208124 memory=184296 CPUtime=0.69 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 46283 0 0 0 64 5 0 0 20 0 1 0 103461718 213118976 46074 33554432000 4194304 5224696 140737386958736 140737386953464 4518045 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 52031 46074 594 252 0 45577 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 208124 KiB
Current children cumulated memory: 184296 KiB

[startup+1.50033 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27675368/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=291596 memory=267524 CPUtime=1.49 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 67129 0 0 0 141 8 0 0 20 0 1 0 103461718 298594304 66881 33554432000 4194304 5224696 140737386958736 140737386953464 4463172 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 72899 66881 647 252 0 66445 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 291596 KiB
Current children cumulated memory: 267524 KiB

[startup+3.10948 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27658008/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=295356 memory=270660 CPUtime=3.1 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 129931 0 0 0 300 10 0 0 20 0 1 0 103461718 302444544 67665 33554432000 4194304 5224696 140737386958736 140737386957752 4463199 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 73839 67665 648 252 0 67385 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 295356 KiB
Current children cumulated memory: 270660 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27656312/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=296316 memory=271508 CPUtime=6.29 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 192551 0 0 0 615 14 0 0 20 0 1 0 103461718 303427584 67877 33554432000 4194304 5224696 140737386958736 140737386956744 4363224 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 74079 67877 648 252 0 67625 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 296316 KiB
Current children cumulated memory: 271508 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10852
/proc/meminfo: memFree=27655136/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=298148 memory=273000 CPUtime=12.69 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 257051 0 0 0 1251 18 0 0 20 0 1 0 103461718 305303552 68250 33554432000 4194304 5224696 140737386958736 140737386957752 4463172 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 74537 68250 648 252 0 68083 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 298148 KiB
Current children cumulated memory: 273000 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 10860
/proc/meminfo: memFree=27653452/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=298308 memory=273120 CPUtime=25.48 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 320582 0 0 0 2526 22 0 0 20 0 1 0 103461718 305467392 68280 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 74577 68280 648 252 0 68123 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 298308 KiB
Current children cumulated memory: 273120 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 10860
/proc/meminfo: memFree=27653032/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=298948 memory=273636 CPUtime=51.07 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 378181 0 0 0 5081 26 0 0 20 0 1 0 103461718 306122752 68409 33554432000 4194304 5224696 140737386958736 140737386957752 4463199 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 74737 68409 648 252 0 68283 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 298948 KiB
Current children cumulated memory: 273636 KiB

[startup+102.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/188 10861
/proc/meminfo: memFree=27653096/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=299748 memory=274204 CPUtime=102.24 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 460388 0 0 0 10189 35 0 0 20 0 1 0 103461718 306941952 68551 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 74937 68551 648 252 0 68483 0
Current children cumulated CPU time: 102.24 s
Current children cumulated vsize: 299748 KiB
Current children cumulated memory: 274204 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/188 10862
/proc/meminfo: memFree=27651340/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=302628 memory=276208 CPUtime=162.2 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 475129 0 0 0 16181 39 0 0 20 0 1 0 103461718 309891072 69052 33554432000 4194304 5224696 140737386958736 140737386957752 4463202 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 75657 69052 648 252 0 69203 0
Current children cumulated CPU time: 162.2 s
Current children cumulated vsize: 302628 KiB
Current children cumulated memory: 276208 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 10863
/proc/meminfo: memFree=27649792/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=304068 memory=279272 CPUtime=222.2 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 477101 0 0 0 22177 43 0 0 20 0 1 0 103461718 311365632 69818 33554432000 4194304 5224696 140737386958736 140737386957752 4465675 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76017 69818 648 252 0 69563 0
Current children cumulated CPU time: 222.2 s
Current children cumulated vsize: 304068 KiB
Current children cumulated memory: 279272 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 10864
/proc/meminfo: memFree=27649128/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=305188 memory=280288 CPUtime=282.19 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 478448 0 0 0 28172 47 0 0 20 0 1 0 103461718 312512512 70072 33554432000 4194304 5224696 140737386958736 140737386957752 4465412 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76297 70072 648 252 0 69843 0
Current children cumulated CPU time: 282.19 s
Current children cumulated vsize: 305188 KiB
Current children cumulated memory: 280288 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10865
/proc/meminfo: memFree=27648968/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=305188 memory=280292 CPUtime=342.19 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 479579 0 0 0 34169 50 0 0 20 0 1 0 103461718 312512512 70073 33554432000 4194304 5224696 140737386958736 140737386957752 4463184 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76297 70073 648 252 0 69843 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 305188 KiB
Current children cumulated memory: 280292 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10866
/proc/meminfo: memFree=27648884/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=305188 memory=280344 CPUtime=402.19 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 480734 0 0 0 40166 53 0 0 20 0 1 0 103461718 312512512 70086 33554432000 4194304 5224696 140737386958736 140737386957752 4463184 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76297 70086 648 252 0 69843 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 305188 KiB
Current children cumulated memory: 280344 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10867
/proc/meminfo: memFree=27648376/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=305320 memory=280408 CPUtime=462.2 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 481915 0 0 0 46163 57 0 0 20 0 1 0 103461718 312647680 70102 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76330 70102 648 252 0 69876 0
Current children cumulated CPU time: 462.2 s
Current children cumulated vsize: 305320 KiB
Current children cumulated memory: 280408 KiB


################
# More data... #
################

/proc/10851/statm: 76770 70797 648 252 0 70316 0
Current children cumulated CPU time: 1722.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283188 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/187 10967
/proc/meminfo: memFree=27776568/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283188 CPUtime=1782.21 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 494457 0 0 0 178070 151 0 0 20 0 1 0 103461718 314449920 70797 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70797 648 252 0 70316 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283188 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 10975
/proc/meminfo: memFree=27775984/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283196 CPUtime=1842.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 494885 0 0 0 184066 156 0 0 20 0 1 0 103461718 314449920 70799 33554432000 4194304 5224696 140737386958736 140737386957752 4363224 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70799 648 252 0 70316 0
Current children cumulated CPU time: 1842.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283196 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/187 10976
/proc/meminfo: memFree=27776460/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283196 CPUtime=1902.21 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 495307 0 0 0 190062 159 0 0 20 0 1 0 103461718 314449920 70799 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70799 648 252 0 70316 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283196 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 10977
/proc/meminfo: memFree=27776656/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283196 CPUtime=1962.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 495837 0 0 0 196058 164 0 0 20 0 1 0 103461718 314449920 70799 33554432000 4194304 5224696 140737386958736 140737386957752 4363002 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70799 648 252 0 70316 0
Current children cumulated CPU time: 1962.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283196 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 10978
/proc/meminfo: memFree=27776532/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2022.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 496249 0 0 0 202054 168 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4463184 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2022.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 10979
/proc/meminfo: memFree=27776392/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2082.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 496680 0 0 0 208051 171 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 140697557750279 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2082.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 10980
/proc/meminfo: memFree=27776612/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2142.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 497201 0 0 0 214046 176 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 140697557750304 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2142.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 10981
/proc/meminfo: memFree=27777332/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2202.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 497627 0 0 0 220042 180 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4463394 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2202.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10982
/proc/meminfo: memFree=27777112/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2262.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 498059 0 0 0 226039 183 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4465628 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10983
/proc/meminfo: memFree=27777360/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2322.23 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 498466 0 0 0 232036 187 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4363224 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10984
/proc/meminfo: memFree=27777468/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2382.23 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 499014 0 0 0 238033 190 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10992
/proc/meminfo: memFree=27775980/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2442.22 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 499426 0 0 0 244028 194 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2442.22 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10993
/proc/meminfo: memFree=27776352/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2502.23 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 499858 0 0 0 250025 198 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4463195 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2502.23 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 10994
/proc/meminfo: memFree=27776600/32770624 swapFree=67108860/67108860
[pid=10851] ppid=10848 vsize=307080 memory=283200 CPUtime=2519.94 cores=0,2,4,6
/proc/10851/stat : 10851 (miniBTD) R 10848 10851 8672 0 -1 4202496 500001 0 0 0 251794 200 0 0 20 0 1 0 103461718 314449920 70800 33554432000 4194304 5224696 140737386958736 140737386957752 4463394 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7325440 7329888 34959360 140737386960053 140737386960135 140737386960135 140737386962893 0
/proc/10851/statm: 76770 70800 648 252 0 70316 0
Current children cumulated CPU time: 2519.94 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 283200 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 10851 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.94 s, system=2.00702 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.95
CPU user time (s): 2517.94
CPU system time (s): 2.00702
CPU usage (%): 99.9975
Max. virtual memory (cumulated for all children) (KiB): 307080
Max. memory (cumulated for all children) (KiB): 283200

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.94
system time used= 2.00702
maximum resident set size= 283200
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 500001
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 109
involuntary context switches= 2184


# summary of solver processes directly reported to runsolver:
#   pid: 10851
#   total CPU time (s): 2519.95
#   total CPU user time (s): 2517.94
#   total CPU system time (s): 2.00702

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.51336 second user time and 19.1294 second system time

The end

Launcher Data 

Begin job on node136 at 2018-07-29 12:09:45
IDJOB=4301129
IDBENCH=141503
IDSOLVER=2771
FILE ID=node136/4301129-1532858985
RUNJOBID= node136-1532843502-8703
PBS_JOBID= 21022496
Free space on /tmp= 55772 MiB

SOLVER NAME= miniBTD 2018.07.27_3
BENCH NAME= XCSP18/Subisomorphism/Subisomorphism-g29-g50_c18.xml
COMMAND LINE= miniBTD 3 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4301129-1532858985/watcher-4301129-1532858985 -o /tmp/evaluation-result-4301129-1532858985/solver-4301129-1532858985 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1532843502-8703 --watchdog 2580  miniBTD 3 2520 HOME/instance-4301129-1532858985.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b43bee46cd3f7faf4796c0903a8d917
RANDOM SEED=290832071

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27927548 kB
MemAvailable:   31832504 kB
Buffers:          208092 kB
Cached:          3955628 kB
SwapCached:            0 kB
Active:          1944088 kB
Inactive:        2401748 kB
Active(anon):     133016 kB
Inactive(anon):    76472 kB
Active(file):    1811072 kB
Inactive(file):  2325276 kB
Unevictable:        7336 kB
Mlocked:            7336 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             19636 kB
Writeback:             0 kB
AnonPages:        188688 kB
Mapped:            35272 kB
Shmem:             25228 kB
Slab:             197168 kB
SReclaimable:     168888 kB
SUnreclaim:        28280 kB
KernelStack:        3344 kB
PageTables:         5400 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     480228 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    131072 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 55760 MiB
End job on node136 at 2018-07-29 12:51:46