Trace number 4299560

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.99 2520.01

General information on the benchmark

NameHaystacks/
Haystacks-ext-13_c18.xml
MD5SUMd20946c70cb8756d1a4b7fb63c02a1de
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables169
Number of constraints1026
Number of domains1
Minimum domain size13
Maximum domain size13
Distribution of domain sizes[{"size":13,"count":169}]
Minimum variable degree12
Maximum variable degree13
Distribution of variable degrees[{"degree":12,"count":145},{"degree":13,"count":24}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":1026}]
Number of extensional constraints1026
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":1026}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.98/2520.01	c
2519.98/2520.01	c # time = 2519.98
2519.98/2520.01	c # Dec = 11038763
2519.98/2520.01	c # Propagate Calls = 1126427224
2519.98/2520.01	c # assignAt Calls = 33967336
2519.98/2520.01	c # removeAt Calls = 99841861
2519.98/2520.01	c # Run = 15356
2519.98/2520.01	c # Conflicts = 9417897
2519.98/2520.01	c # Memory used = 235.984 Mb
2519.98/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10369 MiB free)
  memory of node 1: 16384 MiB (15794 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299560-1532786186/watcher-4299560-1532786186 -o /tmp/evaluation-result-4299560-1532786186/solver-4299560-1532786186 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29943 --watchdog 2580 nacre_mini_release HOME/instance-4299560-1532786186.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=30960, runsolver pid=30957

[startup+0.100107 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 30961
/proc/meminfo: memFree=26786520/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=30960 memory=7424 CPUtime=0.1 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 2029 0 0 0 10 0 0 0 20 0 1 0 96181786 31703040 1856 33554432000 4194304 4933779 140725072349184 140725072346184 4447810 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 7740 1856 603 181 0 1357 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30960 KiB
Current children cumulated memory: 7424 KiB

[startup+0.209413 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 30961
/proc/meminfo: memFree=26783916/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=32532 memory=8996 CPUtime=0.21 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 2461 0 0 0 21 0 0 0 20 0 1 0 96181786 33312768 2249 33554432000 4194304 4933779 140725072349184 140725072346184 4333147 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 8133 2249 603 181 0 1750 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32532 KiB
Current children cumulated memory: 8996 KiB

[startup+0.309234 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 30961
/proc/meminfo: memFree=26782428/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=34104 memory=10372 CPUtime=0.31 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 2866 0 0 0 31 0 0 0 20 0 1 0 96181786 34922496 2593 33554432000 4194304 4933779 140725072349184 140725072346184 4332816 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 8526 2593 603 181 0 2143 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 34104 KiB
Current children cumulated memory: 10372 KiB

[startup+0.700245 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 30961
/proc/meminfo: memFree=26779712/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=36264 memory=12748 CPUtime=0.69 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 3451 0 0 0 69 0 0 0 20 0 1 0 96181786 37134336 3187 33554432000 4194304 4933779 140725072349184 140725072346184 4475584 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 9066 3187 603 181 0 2683 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36264 KiB
Current children cumulated memory: 12748 KiB

[startup+1.50025 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 30961
/proc/meminfo: memFree=26775808/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=40380 memory=16596 CPUtime=1.49 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 4497 0 0 0 149 0 0 0 20 0 1 0 96181786 41349120 4149 33554432000 4194304 4933779 140725072349184 140725072346872 4437393 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 10095 4149 603 181 0 3712 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 40380 KiB
Current children cumulated memory: 16596 KiB

[startup+3.10926 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31022
/proc/meminfo: memFree=26778396/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=44252 memory=20560 CPUtime=3.1 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 9301 0 0 0 309 1 0 0 20 0 1 0 96181786 45314048 5140 33554432000 4194304 4933779 140725072349184 140725072346936 4437389 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 11063 5140 603 181 0 4680 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 44252 KiB
Current children cumulated memory: 20560 KiB

[startup+6.30023 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26764092/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=49120 memory=25616 CPUtime=6.28 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 14427 0 0 0 627 1 0 0 20 0 1 0 96181786 50298880 6404 33554432000 4194304 4933779 140725072349184 140725072346936 4435215 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 12280 6404 603 181 0 5897 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 49120 KiB
Current children cumulated memory: 25616 KiB

[startup+12.7002 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 31266
/proc/meminfo: memFree=26746260/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=57428 memory=32924 CPUtime=12.68 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 21474 0 0 0 1266 2 0 0 20 0 1 0 96181786 58806272 8231 33554432000 4194304 4933779 140725072349184 140725072346872 4381111 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 14357 8231 603 181 0 7974 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 57428 KiB
Current children cumulated memory: 32924 KiB

[startup+25.5003 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 31266
/proc/meminfo: memFree=26726012/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=66284 memory=42244 CPUtime=25.47 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 26826 0 0 0 2545 2 0 0 20 0 1 0 96181786 67874816 10561 33554432000 4194304 4933779 140725072349184 140725072346872 4437393 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 16571 10561 603 181 0 10188 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 66284 KiB
Current children cumulated memory: 42244 KiB

[startup+51.1095 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 31266
/proc/meminfo: memFree=26699656/32770624 swapFree=67028268/67108860
[pid=30960] ppid=30957 vsize=78192 memory=53868 CPUtime=51.08 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 32464 0 0 0 5105 3 0 0 20 0 1 0 96181786 80068608 13467 33554432000 4194304 4933779 140725072349184 140725072346936 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 19548 13467 603 181 0 13165 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 78192 KiB
Current children cumulated memory: 53868 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 31268
/proc/meminfo: memFree=26671320/32770624 swapFree=67028276/67108860
[pid=30960] ppid=30957 vsize=91892 memory=67424 CPUtime=102.28 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 40667 0 0 0 10224 4 0 0 20 0 1 0 96181786 94097408 16856 33554432000 4194304 4933779 140725072349184 140725072346872 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 22973 16856 603 181 0 16590 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 91892 KiB
Current children cumulated memory: 67424 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 31269
/proc/meminfo: memFree=26647300/32770624 swapFree=67028276/67108860
[pid=30960] ppid=30957 vsize=106688 memory=79612 CPUtime=162.27 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 50556 0 0 0 16222 5 0 0 20 0 1 0 96181786 109248512 19903 33554432000 4194304 4933779 140725072349184 140725072346872 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 26672 19903 603 181 0 20289 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 106688 KiB
Current children cumulated memory: 79612 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 31277
/proc/meminfo: memFree=26620952/32770624 swapFree=67028276/67108860
[pid=30960] ppid=30957 vsize=117660 memory=92276 CPUtime=222.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 54534 0 0 0 22220 6 0 0 20 0 1 0 96181786 120483840 23069 33554432000 4194304 4933779 140725072349184 140725072346872 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 29415 23069 603 181 0 23032 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 117660 KiB
Current children cumulated memory: 92276 KiB

[startup+282.3 s]
/proc/loadavg: 2.06 2.01 2.04 3/187 31300
/proc/meminfo: memFree=26606356/32770624 swapFree=67028280/67108860
[pid=30960] ppid=30957 vsize=125932 memory=100160 CPUtime=282.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 60164 0 0 0 28219 7 0 0 20 0 1 0 96181786 128954368 25040 33554432000 4194304 4933779 140725072349184 140725072346888 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 31483 25040 603 181 0 25100 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 125932 KiB
Current children cumulated memory: 100160 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.01 2.04 3/187 31301
/proc/meminfo: memFree=26592760/32770624 swapFree=67028280/67108860
[pid=30960] ppid=30957 vsize=133576 memory=107596 CPUtime=342.25 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 66432 0 0 0 34218 7 0 0 20 0 1 0 96181786 136781824 26899 33554432000 4194304 4933779 140725072349184 140725072346872 4437558 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 33394 26899 603 181 0 27011 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 133576 KiB
Current children cumulated memory: 107596 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.04 3/187 31302
/proc/meminfo: memFree=26581464/32770624 swapFree=67028280/67108860
[pid=30960] ppid=30957 vsize=139668 memory=114016 CPUtime=402.25 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 69045 0 0 0 40218 7 0 0 20 0 1 0 96181786 143020032 28504 33554432000 4194304 4933779 140725072349184 140725072346872 4437368 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 34917 28504 603 181 0 28534 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 139668 KiB
Current children cumulated memory: 114016 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31303
/proc/meminfo: memFree=26570564/32770624 swapFree=67028280/67108860
[pid=30960] ppid=30957 vsize=144876 memory=118780 CPUtime=462.25 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 72019 0 0 0 46217 8 0 0 20 0 1 0 96181786 148353024 29695 33554432000 4194304 4933779 140725072349184 140725072346872 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 36219 29695 603 181 0 29836 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 144876 KiB
Current children cumulated memory: 118780 KiB


################
# More data... #
################

/proc/30960/statm: 56682 49979 603 181 0 50299 0
Current children cumulated CPU time: 1722.26 s
Current children cumulated vsize: 226728 KiB
Current children cumulated memory: 199916 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31342
/proc/meminfo: memFree=26407116/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=233288 memory=206036 CPUtime=1782.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 135713 0 0 0 178210 16 0 0 20 0 1 0 96181786 238886912 51509 33554432000 4194304 4933779 140725072349184 140725072346872 4437479 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 58322 51509 603 181 0 51939 0
Current children cumulated CPU time: 1782.26 s
Current children cumulated vsize: 233288 KiB
Current children cumulated memory: 206036 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31343
/proc/meminfo: memFree=26403380/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=233908 memory=206632 CPUtime=1842.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 138645 0 0 0 184209 17 0 0 20 0 1 0 96181786 239521792 51658 33554432000 4194304 4933779 140725072349184 140725072346696 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 58477 51658 603 181 0 52094 0
Current children cumulated CPU time: 1842.26 s
Current children cumulated vsize: 233908 KiB
Current children cumulated memory: 206632 KiB

[startup+1902.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31345
/proc/meminfo: memFree=26397648/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=236008 memory=209596 CPUtime=1902.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 142114 0 0 0 190209 17 0 0 20 0 1 0 96181786 241672192 52399 33554432000 4194304 4933779 140725072349184 140725072346872 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 59002 52399 603 181 0 52619 0
Current children cumulated CPU time: 1902.26 s
Current children cumulated vsize: 236008 KiB
Current children cumulated memory: 209596 KiB

[startup+1962.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 31346
/proc/meminfo: memFree=26392928/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=239600 memory=212472 CPUtime=1962.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 143708 0 0 0 196209 17 0 0 20 0 1 0 96181786 245350400 53118 33554432000 4194304 4933779 140725072349184 140725072346696 4437368 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 59900 53118 603 181 0 53517 0
Current children cumulated CPU time: 1962.26 s
Current children cumulated vsize: 239600 KiB
Current children cumulated memory: 212472 KiB

[startup+2022.3 s]
/proc/loadavg: 2.09 2.04 2.05 3/188 31355
/proc/meminfo: memFree=26385840/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=242544 memory=214892 CPUtime=2022.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 145566 0 0 0 202209 17 0 0 20 0 1 0 96181786 248365056 53723 33554432000 4194304 4933779 140725072349184 140725072346696 4437538 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 60636 53723 603 181 0 54253 0
Current children cumulated CPU time: 2022.26 s
Current children cumulated vsize: 242544 KiB
Current children cumulated memory: 214892 KiB

[startup+2082.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/188 31356
/proc/meminfo: memFree=26382088/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=244604 memory=216856 CPUtime=2082.27 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 147658 0 0 0 208209 18 0 0 20 0 1 0 96181786 250474496 54214 33554432000 4194304 4933779 140725072349184 140725072346696 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 61151 54214 603 181 0 54768 0
Current children cumulated CPU time: 2082.27 s
Current children cumulated vsize: 244604 KiB
Current children cumulated memory: 216856 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 31357
/proc/meminfo: memFree=26375932/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=247048 memory=221328 CPUtime=2142.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 149912 0 0 0 214208 18 0 0 20 0 1 0 96181786 252977152 55332 33554432000 4194304 4933779 140725072349184 140725072346696 4437824 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 61762 55332 603 181 0 55379 0
Current children cumulated CPU time: 2142.26 s
Current children cumulated vsize: 247048 KiB
Current children cumulated memory: 221328 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 31358
/proc/meminfo: memFree=26371208/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=250532 memory=224628 CPUtime=2202.27 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 152892 0 0 0 220208 19 0 0 20 0 1 0 96181786 256544768 56157 33554432000 4194304 4933779 140725072349184 140725072346936 4437824 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 62633 56157 603 181 0 56250 0
Current children cumulated CPU time: 2202.27 s
Current children cumulated vsize: 250532 KiB
Current children cumulated memory: 224628 KiB

[startup+2262.3 s]
/proc/loadavg: 2.12 2.06 2.06 3/188 31359
/proc/meminfo: memFree=26363316/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=253100 memory=228952 CPUtime=2262.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 154088 0 0 0 226207 19 0 0 20 0 1 0 96181786 259174400 57238 33554432000 4194304 4933779 140725072349184 140725072346744 4335590 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 63275 57238 603 181 0 56892 0
Current children cumulated CPU time: 2262.26 s
Current children cumulated vsize: 253100 KiB
Current children cumulated memory: 228952 KiB

[startup+2322.3 s]
/proc/loadavg: 2.04 2.05 2.05 3/187 31360
/proc/meminfo: memFree=26361852/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=253712 memory=229600 CPUtime=2322.26 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 155172 0 0 0 232207 19 0 0 20 0 1 0 96181786 259801088 57400 33554432000 4194304 4933779 140725072349184 140725072346872 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 63428 57400 603 181 0 57045 0
Current children cumulated CPU time: 2322.26 s
Current children cumulated vsize: 253712 KiB
Current children cumulated memory: 229600 KiB

[startup+2382.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/187 31361
/proc/meminfo: memFree=26357512/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=255436 memory=231004 CPUtime=2382.27 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 156446 0 0 0 238208 19 0 0 20 0 1 0 96181786 261566464 57751 33554432000 4194304 4933779 140725072349184 140725072346872 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 63859 57751 603 181 0 57476 0
Current children cumulated CPU time: 2382.27 s
Current children cumulated vsize: 255436 KiB
Current children cumulated memory: 231004 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 31362
/proc/meminfo: memFree=26354448/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=257856 memory=233304 CPUtime=2442.27 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 158152 0 0 0 244208 19 0 0 20 0 1 0 96181786 264044544 58326 33554432000 4194304 4933779 140725072349184 140725072346872 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 64464 58326 603 181 0 58081 0
Current children cumulated CPU time: 2442.27 s
Current children cumulated vsize: 257856 KiB
Current children cumulated memory: 233304 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 31363
/proc/meminfo: memFree=26350864/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=259572 memory=234840 CPUtime=2502.27 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 160080 0 0 0 250208 19 0 0 20 0 1 0 96181786 265801728 58710 33554432000 4194304 4933779 140725072349184 140725072346872 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 64893 58710 603 181 0 58510 0
Current children cumulated CPU time: 2502.27 s
Current children cumulated vsize: 259572 KiB
Current children cumulated memory: 234840 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.03 2.05 3/187 31363
/proc/meminfo: memFree=26349996/32770624 swapFree=67028300/67108860
[pid=30960] ppid=30957 vsize=260652 memory=235984 CPUtime=2519.98 cores=0,2,4,6
/proc/30960/stat : 30960 (nacre_mini_rele) R 30957 30960 29912 0 -1 4202496 162104 0 0 0 251979 19 0 0 20 0 1 0 96181786 266907648 58996 33554432000 4194304 4933779 140725072349184 140725072346872 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 9977856 140725072356504 140725072356604 140725072356604 140725072359362 0
/proc/30960/statm: 65163 58996 603 181 0 58780 0
Current children cumulated CPU time: 2519.98 s
Current children cumulated vsize: 260652 KiB
Current children cumulated memory: 235984 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 30960 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.79 s, system=0.198003 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.99
CPU user time (s): 2519.79
CPU system time (s): 0.198003
CPU usage (%): 99.9991
Max. virtual memory (cumulated for all children) (KiB): 260652
Max. memory (cumulated for all children) (KiB): 235984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.79
system time used= 0.198003
maximum resident set size= 236060
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 162147
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 112
involuntary context switches= 1594


# summary of solver processes directly reported to runsolver:
#   pid: 30960
#   total CPU time (s): 2519.99
#   total CPU user time (s): 2519.79
#   total CPU system time (s): 0.198003

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.85445 second user time and 18.9389 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-28 15:56:26
IDJOB=4299560
IDBENCH=141414
IDSOLVER=2764
FILE ID=node102/4299560-1532786186
RUNJOBID= node102-1532776103-29943
PBS_JOBID= 21022470
Free space on /tmp= 52748 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Haystacks/Haystacks-ext-13_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299560-1532786186/watcher-4299560-1532786186 -o /tmp/evaluation-result-4299560-1532786186/solver-4299560-1532786186 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29943 --watchdog 2580  nacre_mini_release HOME/instance-4299560-1532786186.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d20946c70cb8756d1a4b7fb63c02a1de
RANDOM SEED=106535107

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26791124 kB
MemAvailable:   31926808 kB
Buffers:          214192 kB
Cached:          5177008 kB
SwapCached:        53464 kB
Active:          1210728 kB
Inactive:        4268024 kB
Active(anon):      13504 kB
Inactive(anon):    99048 kB
Active(file):    1197224 kB
Inactive(file):  4168976 kB
Unevictable:        6644 kB
Mlocked:            6644 kB
SwapTotal:      67108860 kB
SwapFree:       67028268 kB
Dirty:              1776 kB
Writeback:             0 kB
AnonPages:         50216 kB
Mapped:            36844 kB
Shmem:             22044 kB
Slab:             198704 kB
SReclaimable:     170636 kB
SUnreclaim:        28068 kB
KernelStack:        3680 kB
PageTables:         5552 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     358156 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52744 MiB
End job on node102 at 2018-07-28 16:38:26