Trace number 4265150

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2017-08-10? (TO) 2519.9099 2520.4399

General information on the benchmark

NameFischer/Fischer-m1-s1/
Fischer-08-07-fair.xml
MD5SUM5f690ca061a68a4e848a5e1ee5dffcd4
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark824.70099
Satisfiable
(Un)Satisfiability was proved
Number of variables14823
Number of constraints14025
Number of domains3
Minimum domain size2
Maximum domain size20001
Distribution of domain sizes[{"size":2,"count":2009},{"size":201,"count":72},{"size":20001,"count":12742}]
Minimum variable degree2
Maximum variable degree121
Distribution of variable degrees[{"degree":2,"count":13085},{"degree":3,"count":336},{"degree":4,"count":31},{"degree":5,"count":160},{"degree":6,"count":95},{"degree":7,"count":288},{"degree":8,"count":391},{"degree":9,"count":247},{"degree":10,"count":88},{"degree":11,"count":8},{"degree":13,"count":56},{"degree":18,"count":1},{"degree":26,"count":8},{"degree":42,"count":8},{"degree":44,"count":5},{"degree":52,"count":1},{"degree":59,"count":7},{"degree":92,"count":2},{"degree":93,"count":5},{"degree":121,"count":1}]
Minimum constraint arity1
Maximum constraint arity3
Distribution of constraint arities[{"arity":1,"count":2},{"arity":2,"count":2319},{"arity":3,"count":11704}]
Number of extensional constraints0
Number of intensional constraints14025
Distribution of constraint types[{"type":"intension","count":14025}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10986 MiB free)
  memory of node 1: 16384 MiB (15495 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265150-1502788519/watcher-4265150-1502788519 -o /tmp/evaluation-result-4265150-1502788519/solver-4265150-1502788519 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21655 --watchdog 2580 BTD 2520 HOME/instance-4265150-1502788519.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=27794, runsolver pid=27791

[startup+0.100155 s]*
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27115476/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=33240 memory=3680 CPUtime=0.03 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 1062 0 0 0 3 0 0 0 20 0 1 0 81045171 34037760 920 18446744073709551615 4194304 35031035 140725137297312 140725137297312 4208986 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 8310 920 230 7529 0 757 0
Current children cumulated CPU time: 0.03 s
Current children cumulated vsize: 33240 KiB
Current children cumulated memory: 3680 KiB

[startup+0.209392 s]*
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27114732/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=33832 memory=4340 CPUtime=0.13 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 2679 0 0 0 13 0 0 0 20 0 1 0 81045171 34643968 1085 18446744073709551615 4194304 35031035 140725137297312 140725137297312 4207309 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 8458 1085 230 7529 0 905 0
Current children cumulated CPU time: 0.13 s
Current children cumulated vsize: 33832 KiB
Current children cumulated memory: 4340 KiB

[startup+0.308915 s]*
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27113988/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=34060 memory=4568 CPUtime=0.23 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 10481 0 0 0 22 1 0 0 20 0 1 0 81045171 34877440 1142 18446744073709551615 4194304 35031035 140725137297312 140725137297312 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 8515 1142 230 7529 0 962 0
Current children cumulated CPU time: 0.23 s
Current children cumulated vsize: 34060 KiB
Current children cumulated memory: 4568 KiB

[startup+0.700274 s]
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27111384/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=35652 memory=5908 CPUtime=0.62 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 33827 0 0 0 59 3 0 0 20 0 1 0 81045171 36507648 1477 18446744073709551615 4194304 35031035 140725137297312 140725137293128 4208689 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 8913 1477 231 7529 0 1360 0
Current children cumulated CPU time: 0.62 s
Current children cumulated vsize: 35652 KiB
Current children cumulated memory: 5908 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27109152/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=38564 memory=9080 CPUtime=1.42 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 72746 0 0 0 134 8 0 0 20 0 1 0 81045171 39489536 2270 18446744073709551615 4194304 35031035 140725137297312 140725137293128 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 9641 2270 232 7529 0 2088 0
Current children cumulated CPU time: 1.42 s
Current children cumulated vsize: 38564 KiB
Current children cumulated memory: 9080 KiB

[startup+3.10913 s]
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27093900/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=45092 memory=15280 CPUtime=3.03 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 181029 0 0 0 281 22 0 0 20 0 1 0 81045171 46174208 3820 18446744073709551615 4194304 35031035 140725137297312 140725137293128 4208979 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 11273 3820 232 7529 0 3720 0
Current children cumulated CPU time: 3.03 s
Current children cumulated vsize: 45092 KiB
Current children cumulated memory: 15280 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27070708/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=55988 memory=26504 CPUtime=6.22 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 406860 0 0 0 574 48 0 0 20 0 1 0 81045171 57331712 6626 18446744073709551615 4194304 35031035 140725137297312 140725137293272 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 13997 6626 232 7529 0 6444 0
Current children cumulated CPU time: 6.22 s
Current children cumulated vsize: 55988 KiB
Current children cumulated memory: 26504 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.05 2.06 3/184 27795
/proc/meminfo: memFree=27027456/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=78796 memory=49280 CPUtime=12.61 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 852072 0 0 0 1158 103 0 0 20 0 1 0 81045171 80687104 12320 18446744073709551615 4194304 35031035 140725137297312 140725137293128 4208689 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 19699 12320 232 7529 0 12146 0
Current children cumulated CPU time: 12.61 s
Current children cumulated vsize: 78796 KiB
Current children cumulated memory: 49280 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.04 2.06 3/184 27795
/proc/meminfo: memFree=26934052/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=123656 memory=94100 CPUtime=25.41 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 1849041 0 0 0 2320 221 0 0 20 0 1 0 81045171 126623744 23506 18446744073709551615 4194304 35031035 140725137297312 140725137293272 4208684 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 30914 23506 232 7529 0 23361 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 123656 KiB
Current children cumulated memory: 94100 KiB

[startup+51.1093 s]
/proc/loadavg: 2.00 2.04 2.05 3/184 27795
/proc/meminfo: memFree=26744456/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=214964 memory=185156 CPUtime=51.03 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 3740109 0 0 0 4656 447 0 0 20 0 1 0 81045171 220123136 46289 18446744073709551615 4194304 35031035 140725137297312 140725137293128 4209280 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 53741 46289 232 7529 0 46188 0
Current children cumulated CPU time: 51.03 s
Current children cumulated vsize: 214964 KiB
Current children cumulated memory: 185156 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/181 27797
/proc/meminfo: memFree=26375188/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=396040 memory=366552 CPUtime=102.21 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 7403424 0 0 0 9336 885 0 0 20 0 1 0 81045171 405544960 91573 18446744073709551615 4194304 35031035 140725137297312 140725137293080 7408826 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 99043 91638 232 7529 0 91490 0
Current children cumulated CPU time: 102.21 s
Current children cumulated vsize: 396040 KiB
Current children cumulated memory: 366552 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/181 27799
/proc/meminfo: memFree=25937964/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=609976 memory=580176 CPUtime=162.2 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 11576729 0 0 0 14828 1392 0 0 20 0 1 0 81045171 624615424 145044 18446744073709551615 4194304 35031035 140725137297312 140725137293080 4208386 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 152494 145044 232 7529 0 144941 0
Current children cumulated CPU time: 162.2 s
Current children cumulated vsize: 609976 KiB
Current children cumulated memory: 580176 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/181 27801
/proc/meminfo: memFree=25497676/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=823236 memory=793676 CPUtime=222.2 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 15655281 0 0 0 20341 1879 0 0 20 0 1 0 81045171 842993664 198438 18446744073709551615 4194304 35031035 140725137297312 140725137293080 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 205790 198419 232 7529 0 198237 0
Current children cumulated CPU time: 222.2 s
Current children cumulated vsize: 823236 KiB
Current children cumulated memory: 793676 KiB

[startup+282.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/181 27803
/proc/meminfo: memFree=24047888/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=1037904 memory=1008112 CPUtime=282.19 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 19743299 0 0 0 25853 2366 0 0 20 0 1 0 81045171 1062813696 252028 18446744073709551615 4194304 35031035 140725137297312 140725137293080 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 259399 252028 232 7529 0 251846 0
Current children cumulated CPU time: 282.19 s
Current children cumulated vsize: 1037904 KiB
Current children cumulated memory: 1008112 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/181 27805
/proc/meminfo: memFree=23832728/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=1253084 memory=1223508 CPUtime=342.18 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 23663921 0 0 0 31383 2835 0 0 20 0 1 0 81045171 1283158016 305877 18446744073709551615 4194304 35031035 140725137297312 140725137293128 4208395 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 313271 305877 232 7529 0 305718 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 1253084 KiB
Current children cumulated memory: 1223508 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/181 27807
/proc/meminfo: memFree=23617360/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=1467608 memory=1438124 CPUtime=402.19 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 27498451 0 0 0 36919 3300 0 0 20 0 1 0 81045171 1502830592 359531 18446744073709551615 4194304 35031035 140725137297312 140725137293080 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 366902 359531 232 7529 0 359349 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 1467608 KiB
Current children cumulated memory: 1438124 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/181 27809
/proc/meminfo: memFree=23403832/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=1681952 memory=1652336 CPUtime=462.18 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 31589600 0 0 0 42440 3778 0 0 20 0 1 0 81045171 1722318848 413084 18446744073709551615 4194304 35031035 140725137297312 140725137293128 4209291 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 420455 413084 232 7529 0 412902 0
Current children cumulated CPU time: 462.18 s
Current children cumulated vsize: 1681952 KiB
Current children cumulated memory: 1652336 KiB


################
# More data... #
################

/proc/meminfo: memFree=24713056/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=6570180 memory=6540512 CPUtime=1781.97 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 81609087 0 0 0 168412 9785 0 0 20 0 1 0 81045171 6727864320 1635128 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4207316 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1642545 1635128 232 7529 0 1634992 0
Current children cumulated CPU time: 1781.97 s
Current children cumulated vsize: 6570180 KiB
Current children cumulated memory: 6540512 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/182 28460
/proc/meminfo: memFree=24487824/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=6798132 memory=6768648 CPUtime=1841.93 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 82410327 0 0 0 174284 9909 0 0 20 0 1 0 81045171 6961287168 1692162 18446744073709551615 4194304 35031035 140725137297312 140725137293272 4208379 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1699533 1692162 232 7529 0 1691980 0
Current children cumulated CPU time: 1841.93 s
Current children cumulated vsize: 6798132 KiB
Current children cumulated memory: 6768648 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/182 28462
/proc/meminfo: memFree=24259832/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=7025852 memory=6996360 CPUtime=1901.92 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 83323444 0 0 0 180144 10048 0 0 20 0 1 0 81045171 7194472448 1749090 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4209280 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1756463 1749090 232 7529 0 1748910 0
Current children cumulated CPU time: 1901.92 s
Current children cumulated vsize: 7025852 KiB
Current children cumulated memory: 6996360 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/182 28464
/proc/meminfo: memFree=24031576/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=7253684 memory=7224108 CPUtime=1961.9 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 84250787 0 0 0 186009 10181 0 0 20 0 1 0 81045171 7427772416 1806027 18446744073709551615 4194304 35031035 140725137297312 140725137293080 4209280 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1813421 1806027 232 7529 0 1805868 0
Current children cumulated CPU time: 1961.9 s
Current children cumulated vsize: 7253684 KiB
Current children cumulated memory: 7224108 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.01 2.05 3/182 28466
/proc/meminfo: memFree=23803320/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=7481648 memory=7451868 CPUtime=2021.88 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 85135278 0 0 0 191875 10313 0 0 20 0 1 0 81045171 7661207552 1862967 18446744073709551615 4194304 35031035 140725137297312 140725137293080 7407705 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1870412 1862967 232 7529 0 1862859 0
Current children cumulated CPU time: 2021.88 s
Current children cumulated vsize: 7481648 KiB
Current children cumulated memory: 7451868 KiB

[startup+2082.3 s]
/proc/loadavg: 2.03 2.01 2.05 3/181 28468
/proc/meminfo: memFree=23574708/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=7708296 memory=7678656 CPUtime=2081.87 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 86117379 0 0 0 197731 10456 0 0 20 0 1 0 81045171 7893295104 1919664 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4207320 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1927035 1919664 232 7529 0 1919482 0
Current children cumulated CPU time: 2081.87 s
Current children cumulated vsize: 7708296 KiB
Current children cumulated memory: 7678656 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/181 28470
/proc/meminfo: memFree=23346452/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=7937328 memory=7907548 CPUtime=2141.86 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 87011689 0 0 0 203599 10587 0 0 20 0 1 0 81045171 8127823872 1976887 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4208395 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 1984332 1976887 232 7529 0 1976779 0
Current children cumulated CPU time: 2141.86 s
Current children cumulated vsize: 7937328 KiB
Current children cumulated memory: 7907548 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 28472
/proc/meminfo: memFree=23119188/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=8163820 memory=8134336 CPUtime=2201.83 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 87961265 0 0 0 209456 10727 0 0 20 0 1 0 81045171 8359751680 2033584 18446744073709551615 4194304 35031035 140725137297312 140725137293128 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2040955 2033584 232 7529 0 2033402 0
Current children cumulated CPU time: 2201.83 s
Current children cumulated vsize: 8163820 KiB
Current children cumulated memory: 8134336 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 28474
/proc/meminfo: memFree=22890188/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=8393008 memory=8363440 CPUtime=2261.83 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 88755556 0 0 0 215339 10844 0 0 20 0 1 0 81045171 8594440192 2090860 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4208386 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2098252 2090860 232 7529 0 2090699 0
Current children cumulated CPU time: 2261.83 s
Current children cumulated vsize: 8393008 KiB
Current children cumulated memory: 8363440 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 28476
/proc/meminfo: memFree=22660624/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=8622196 memory=8592584 CPUtime=2321.81 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 89526402 0 0 0 221228 10953 0 0 20 0 1 0 81045171 8829128704 2148146 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4208689 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2155549 2148146 232 7529 0 2147996 0
Current children cumulated CPU time: 2321.81 s
Current children cumulated vsize: 8622196 KiB
Current children cumulated memory: 8592584 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/184 28492
/proc/meminfo: memFree=22426676/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=8850188 memory=8820548 CPUtime=2381.8 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 90346928 0 0 0 227114 11066 0 0 20 0 1 0 81045171 9062592512 2205137 18446744073709551615 4194304 35031035 140725137297312 140725137293144 4208684 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2212528 2205144 232 7529 0 2204975 0
Current children cumulated CPU time: 2381.8 s
Current children cumulated vsize: 8850188 KiB
Current children cumulated memory: 8820548 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 28494
/proc/meminfo: memFree=22199972/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=9079296 memory=9049736 CPUtime=2441.78 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 91149184 0 0 0 233005 11173 0 0 20 0 1 0 81045171 9297199104 2262440 18446744073709551615 4194304 35031035 140725137297312 140725137293032 7993641 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2269805 2262434 232 7529 0 2262252 0
Current children cumulated CPU time: 2441.78 s
Current children cumulated vsize: 9079296 KiB
Current children cumulated memory: 9049736 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 28496
/proc/meminfo: memFree=21970352/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=9308408 memory=9278852 CPUtime=2501.77 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 91929020 0 0 0 238888 11289 0 0 20 0 1 0 81045171 9531809792 2319713 18446744073709551615 4194304 35031035 140725137297312 140725137293144 4209287 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2327102 2319713 232 7529 0 2319549 0
Current children cumulated CPU time: 2501.77 s
Current children cumulated vsize: 9308408 KiB
Current children cumulated memory: 9278852 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/181 28496
/proc/meminfo: memFree=21902052/32770624 swapFree=67108860/67108860
[pid=27794] ppid=27791 vsize=9377164 memory=9347464 CPUtime=2519.46 cores=1,3,5,7
/proc/27794/stat : 27794 (BTD) R 27791 27794 17093 0 -1 4202496 92170022 0 0 0 240622 11324 0 0 20 0 1 0 81045171 9602215936 2336866 18446744073709551615 4194304 35031035 140725137297312 140725137293032 4207859 0 0 1 0 0 0 0 17 1 0 0 7 0 0 37130264 37226188 62242816 140725137301983 140725137302059 140725137302059 140725137305553 0
/proc/27794/statm: 2344291 2336866 232 7529 0 2336738 0
Current children cumulated CPU time: 2519.46 s
Current children cumulated vsize: 9377164 KiB
Current children cumulated memory: 9347464 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.44 s]
# the end of solver process 27794 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2406.23 s, system=113.677 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 28497
/proc/meminfo: memFree=25473680/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.44
CPU time (s): 2519.91
CPU user time (s): 2406.23
CPU system time (s): 113.677
CPU usage (%): 99.9789
Max. virtual memory (cumulated for all children) (KiB): 9377164
Max. memory (cumulated for all children) (KiB): 9347464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2406.23
system time used= 113.677
maximum resident set size= 9347552
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 92170022
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 393
involuntary context switches= 3107


# summary of solver processes directly reported to runsolver:
#   pid: 27794
#   total CPU time (s): 2519.91
#   total CPU user time (s): 2406.23
#   total CPU system time (s): 113.677

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.1782 second user time and 16.3404 second system time

The end

Launcher Data 

Begin job on node127 at 2017-08-15 11:01:10
IDJOB=4265150
IDBENCH=139283
IDSOLVER=2654
FILE ID=node127/4265150-1502788519
RUNJOBID= node127-1502653304-21655
PBS_JOBID= 
Free space on /tmp= 61992 MiB

SOLVER NAME= BTD 2017-08-10
BENCH NAME= XCSP17/Fischer/Fischer-m1-s1/Fischer-08-07-fair.xml
COMMAND LINE= BTD TIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265150-1502788519/watcher-4265150-1502788519 -o /tmp/evaluation-result-4265150-1502788519/solver-4265150-1502788519 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1502653304-21655 --watchdog 2580  BTD 2520 HOME/instance-4265150-1502788519.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f690ca061a68a4e848a5e1ee5dffcd4
RANDOM SEED=1097535467

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27117708 kB
MemAvailable:   27825456 kB
Buffers:          248196 kB
Cached:           746492 kB
SwapCached:            0 kB
Active:          4902704 kB
Inactive:         295684 kB
Active(anon):    4152952 kB
Inactive(anon):    83808 kB
Active(file):     749752 kB
Inactive(file):   211876 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             38892 kB
Writeback:             0 kB
AnonPages:       4186856 kB
Mapped:            53616 kB
Shmem:             33444 kB
Slab:             149936 kB
SReclaimable:     123912 kB
SUnreclaim:        26024 kB
KernelStack:        3312 kB
PageTables:        13536 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    4481744 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 61956 MiB
End job on node127 at 2017-08-15 11:43:11