Trace number 4299536

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.96 2520.01

General information on the benchmark

NameHaystacks/
Haystacks-ext-11_c18.xml
MD5SUMdd1566dde9022858d7af3144994afffb
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark197.639
Satisfiable
(Un)Satisfiability was proved
Number of variables121
Number of constraints615
Number of domains1
Minimum domain size11
Maximum domain size11
Distribution of domain sizes[{"size":11,"count":121}]
Minimum variable degree10
Maximum variable degree11
Distribution of variable degrees[{"degree":10,"count":101},{"degree":11,"count":20}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":615}]
Number of extensional constraints615
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":615}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c NACRE 1.0.4
2519.95/2520.01	c
2519.95/2520.01	c # time = 2519.95
2519.95/2520.01	c # Dec = 10215634
2519.95/2520.01	c # Propagate Calls = 716013929
2519.95/2520.01	c # assignAt Calls = 31289647
2519.95/2520.01	c # removeAt Calls = 76314869
2519.95/2520.01	c # Run = 15099
2519.95/2520.01	c # Conflicts = 9246320
2519.95/2520.01	c # Memory used = 203.992 Mb
2519.95/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9499 MiB free)
  memory of node 1: 16384 MiB (10162 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299536-1532785440/watcher-4299536-1532785440 -o /tmp/evaluation-result-4299536-1532785440/solver-4299536-1532785440 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27028 --watchdog 2580 nacre_mini_release HOME/instance-4299536-1532785440.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28843, runsolver pid=28840

[startup+0.100141 s]*
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20130176/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=29968 memory=6368 CPUtime=0.1 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 1820 0 0 0 10 0 0 0 20 0 1 0 96107170 30687232 1592 33554432000 4194304 4933779 140729717301808 140729717298808 140622683753445 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 7492 1592 602 181 0 1109 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29968 KiB
Current children cumulated memory: 6368 KiB

[startup+0.209622 s]*
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20128316/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=31900 memory=8352 CPUtime=0.21 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 2301 0 0 0 21 0 0 0 20 0 1 0 96107170 32665600 2088 33554432000 4194304 4933779 140729717301808 140729717298808 140622683753445 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 7975 2088 603 181 0 1592 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31900 KiB
Current children cumulated memory: 8352 KiB

[startup+0.30934 s]*
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20126936/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=32840 memory=9408 CPUtime=0.31 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 2583 0 0 0 31 0 0 0 20 0 1 0 96107170 33628160 2352 33554432000 4194304 4933779 140729717301808 140729717298808 4380793 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 8210 2352 603 181 0 1827 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32840 KiB
Current children cumulated memory: 9408 KiB

[startup+0.700304 s]
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20125448/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=35128 memory=11784 CPUtime=0.69 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 3174 0 0 0 69 0 0 0 20 0 1 0 96107170 35971072 2946 33554432000 4194304 4933779 140729717301808 140729717299320 4439656 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 8782 2946 603 181 0 2399 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35128 KiB
Current children cumulated memory: 11784 KiB

[startup+1.50035 s]
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20122968/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=38516 memory=14556 CPUtime=1.49 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 4031 0 0 0 149 0 0 0 20 0 1 0 96107170 39440384 3639 33554432000 4194304 4933779 140729717301808 140729717299576 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 9629 3639 603 181 0 3246 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 38516 KiB
Current children cumulated memory: 14556 KiB

[startup+3.1096 s]
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20117124/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=42300 memory=18664 CPUtime=3.1 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 8353 0 0 0 310 0 0 0 20 0 1 0 96107170 43315200 4666 33554432000 4194304 4933779 140729717301808 140729717299496 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 10575 4666 603 181 0 4192 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 42300 KiB
Current children cumulated memory: 18664 KiB

[startup+6.30028 s]
/proc/loadavg: 2.01 2.10 2.07 3/188 28844
/proc/meminfo: memFree=20112272/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=46216 memory=22732 CPUtime=6.29 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 13764 0 0 0 629 0 0 0 20 0 1 0 96107170 47325184 5683 33554432000 4194304 4933779 140729717301808 140729717299320 4437570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 11554 5683 603 181 0 5171 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 46216 KiB
Current children cumulated memory: 22732 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.09 2.07 3/188 28844
/proc/meminfo: memFree=20104940/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=53824 memory=29240 CPUtime=12.69 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 20902 0 0 0 1268 1 0 0 20 0 1 0 96107170 55115776 7310 33554432000 4194304 4933779 140729717301808 140729717299496 4437416 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 13456 7310 603 181 0 7073 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 53824 KiB
Current children cumulated memory: 29240 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.09 2.07 3/188 28844
/proc/meminfo: memFree=20094640/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=61004 memory=36408 CPUtime=25.49 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 36650 0 0 0 2547 2 0 0 20 0 1 0 96107170 62468096 9102 33554432000 4194304 4933779 140729717301808 140729717299560 4437389 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 15251 9102 603 181 0 8868 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 61004 KiB
Current children cumulated memory: 36408 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.08 2.07 3/188 28844
/proc/meminfo: memFree=20077992/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=70648 memory=46316 CPUtime=51.09 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 48475 0 0 0 5107 2 0 0 20 0 1 0 96107170 72343552 11579 33554432000 4194304 4933779 140729717301808 140729717299320 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 17662 11579 603 181 0 11279 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 70648 KiB
Current children cumulated memory: 46316 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.07 2.06 3/187 28845
/proc/meminfo: memFree=20054368/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=83248 memory=59256 CPUtime=102.27 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 61070 0 0 0 10223 4 0 0 20 0 1 0 96107170 85245952 14814 33554432000 4194304 4933779 140729717301808 140729717299496 4437824 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 20812 14814 603 181 0 14429 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 83248 KiB
Current children cumulated memory: 59256 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 28846
/proc/meminfo: memFree=20035032/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=94988 memory=68168 CPUtime=162.27 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 65673 0 0 0 16223 4 0 0 20 0 1 0 96107170 97267712 17042 33554432000 4194304 4933779 140729717301808 140729717299320 4437792 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 23747 17042 603 181 0 17364 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 94988 KiB
Current children cumulated memory: 68168 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 28847
/proc/meminfo: memFree=20015736/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=102688 memory=75924 CPUtime=222.27 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 70608 0 0 0 22223 4 0 0 20 0 1 0 96107170 105152512 18981 33554432000 4194304 4933779 140729717301808 140729717299496 4437678 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 25672 18981 603 181 0 19289 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 102688 KiB
Current children cumulated memory: 75924 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 28848
/proc/meminfo: memFree=19998512/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=109736 memory=84688 CPUtime=282.26 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 77205 0 0 0 28221 5 0 0 20 0 1 0 96107170 112369664 21172 33554432000 4194304 4933779 140729717301808 140729717299496 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 27434 21172 603 181 0 21051 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 109736 KiB
Current children cumulated memory: 84688 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 28849
/proc/meminfo: memFree=19985632/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=115608 memory=90724 CPUtime=342.26 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 80149 0 0 0 34221 5 0 0 20 0 1 0 96107170 118382592 22681 33554432000 4194304 4933779 140729717301808 140729717299496 4437792 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 28902 22681 603 181 0 22519 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 115608 KiB
Current children cumulated memory: 90724 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 28857
/proc/meminfo: memFree=19972092/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=120360 memory=94848 CPUtime=402.26 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 83572 0 0 0 40220 6 0 0 20 0 1 0 96107170 123248640 23712 33554432000 4194304 4933779 140729717301808 140729717299496 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 30090 23712 603 181 0 23707 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 120360 KiB
Current children cumulated memory: 94848 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 28858
/proc/meminfo: memFree=19955936/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=127040 memory=100632 CPUtime=462.26 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 87715 0 0 0 46220 6 0 0 20 0 1 0 96107170 130088960 25158 33554432000 4194304 4933779 140729717301808 140729717299512 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 31760 25158 603 181 0 25377 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 127040 KiB
Current children cumulated memory: 100632 KiB


################
# More data... #
################

/proc/28843/statm: 51419 44715 603 181 0 45036 0
Current children cumulated CPU time: 1722.24 s
Current children cumulated vsize: 205676 KiB
Current children cumulated memory: 178860 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28919
/proc/meminfo: memFree=19774788/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=206024 memory=179420 CPUtime=1782.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 152615 0 0 0 178211 13 0 0 20 0 1 0 96107170 210968576 44855 33554432000 4194304 4933779 140729717301808 140729717299496 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 51506 44855 603 181 0 45123 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 206024 KiB
Current children cumulated memory: 179420 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28920
/proc/meminfo: memFree=19770944/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=206980 memory=180340 CPUtime=1842.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 154305 0 0 0 184211 13 0 0 20 0 1 0 96107170 211947520 45085 33554432000 4194304 4933779 140729717301808 140729717299496 4437389 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 51745 45085 603 181 0 45362 0
Current children cumulated CPU time: 1842.24 s
Current children cumulated vsize: 206980 KiB
Current children cumulated memory: 180340 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28921
/proc/meminfo: memFree=19764204/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=207904 memory=183772 CPUtime=1902.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 156161 0 0 0 190210 14 0 0 20 0 1 0 96107170 212893696 45943 33554432000 4194304 4933779 140729717301808 140729717299496 4437547 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 51976 45943 603 181 0 45593 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 207904 KiB
Current children cumulated memory: 183772 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28922
/proc/meminfo: memFree=19757324/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=210660 memory=185880 CPUtime=1962.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 157508 0 0 0 196210 14 0 0 20 0 1 0 96107170 215715840 46470 33554432000 4194304 4933779 140729717301808 140729717299496 4437449 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 52665 46470 603 181 0 46282 0
Current children cumulated CPU time: 1962.24 s
Current children cumulated vsize: 210660 KiB
Current children cumulated memory: 185880 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28923
/proc/meminfo: memFree=19753456/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=212648 memory=187652 CPUtime=2022.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 158717 0 0 0 202210 14 0 0 20 0 1 0 96107170 217751552 46913 33554432000 4194304 4933779 140729717301808 140729717299496 4437570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 53162 46913 603 181 0 46779 0
Current children cumulated CPU time: 2022.24 s
Current children cumulated vsize: 212648 KiB
Current children cumulated memory: 187652 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28924
/proc/meminfo: memFree=19747008/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=216312 memory=191196 CPUtime=2082.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 160621 0 0 0 208209 15 0 0 20 0 1 0 96107170 221503488 47799 33554432000 4194304 4933779 140729717301808 140729717299496 4437389 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 54078 47799 603 181 0 47695 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 216312 KiB
Current children cumulated memory: 191196 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28925
/proc/meminfo: memFree=19739856/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=219004 memory=193900 CPUtime=2142.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 163210 0 0 0 214209 15 0 0 20 0 1 0 96107170 224260096 48475 33554432000 4194304 4933779 140729717301808 140729717299512 4437445 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 54751 48475 603 181 0 48368 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 219004 KiB
Current children cumulated memory: 193900 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28933
/proc/meminfo: memFree=19735464/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=220776 memory=195688 CPUtime=2202.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 166246 0 0 0 220208 16 0 0 20 0 1 0 96107170 226074624 48922 33554432000 4194304 4933779 140729717301808 140729717299496 4437547 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 55194 48922 603 181 0 48811 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 220776 KiB
Current children cumulated memory: 195688 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28934
/proc/meminfo: memFree=19730428/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=223000 memory=198860 CPUtime=2262.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 169556 0 0 0 226208 16 0 0 20 0 1 0 96107170 228352000 49715 33554432000 4194304 4933779 140729717301808 140729717299496 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 55750 49715 603 181 0 49367 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 223000 KiB
Current children cumulated memory: 198860 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28935
/proc/meminfo: memFree=19727000/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=224336 memory=200084 CPUtime=2322.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 171036 0 0 0 232208 16 0 0 20 0 1 0 96107170 229720064 50021 33554432000 4194304 4933779 140729717301808 140729717299496 4437680 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 56084 50021 603 181 0 49701 0
Current children cumulated CPU time: 2322.24 s
Current children cumulated vsize: 224336 KiB
Current children cumulated memory: 200084 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19857604/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=225392 memory=201320 CPUtime=2382.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 172773 0 0 0 238208 16 0 0 20 0 1 0 96107170 230801408 50330 33554432000 4194304 4933779 140729717301808 140729717299496 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 56348 50330 603 181 0 49965 0
Current children cumulated CPU time: 2382.24 s
Current children cumulated vsize: 225392 KiB
Current children cumulated memory: 201320 KiB

[startup+2442.3 s]
/proc/loadavg: 2.22 2.06 2.06 3/187 28997
/proc/meminfo: memFree=19827964/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=226800 memory=202392 CPUtime=2442.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 174543 0 0 0 244208 16 0 0 20 0 1 0 96107170 232243200 50598 33554432000 4194304 4933779 140729717301808 140729717299496 4437445 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 56700 50598 603 181 0 50317 0
Current children cumulated CPU time: 2442.24 s
Current children cumulated vsize: 226800 KiB
Current children cumulated memory: 202392 KiB

[startup+2502.3 s]
/proc/loadavg: 2.47 2.18 2.10 3/187 28999
/proc/meminfo: memFree=19806000/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=227980 memory=203660 CPUtime=2502.24 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 175537 0 0 0 250208 16 0 0 20 0 1 0 96107170 233451520 50915 33554432000 4194304 4933779 140729717301808 140729717299496 4380282 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 56995 50915 603 181 0 50612 0
Current children cumulated CPU time: 2502.24 s
Current children cumulated vsize: 227980 KiB
Current children cumulated memory: 203660 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.37 2.17 2.10 3/187 29000
/proc/meminfo: memFree=19801768/32770624 swapFree=67108860/67108860
[pid=28843] ppid=28840 vsize=228556 memory=203992 CPUtime=2519.95 cores=1,3,5,7
/proc/28843/stat : 28843 (nacre_mini_rele) R 28840 28843 26996 0 -1 4202496 176403 0 0 0 251979 16 0 0 20 0 1 0 96107170 234041344 50998 33554432000 4194304 4933779 140729717301808 140729717299368 4437389 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 16277504 140729717310616 140729717310716 140729717310716 140729717313474 0
/proc/28843/statm: 57139 50998 603 181 0 50756 0
Current children cumulated CPU time: 2519.95 s
Current children cumulated vsize: 228556 KiB
Current children cumulated memory: 203992 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 28843 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.79 s, system=0.17 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.96
CPU user time (s): 2519.79
CPU system time (s): 0.17
CPU usage (%): 99.9981
Max. virtual memory (cumulated for all children) (KiB): 228556
Max. memory (cumulated for all children) (KiB): 203992

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.79
system time used= 0.17
maximum resident set size= 204068
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 176448
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 98
involuntary context switches= 1659


# summary of solver processes directly reported to runsolver:
#   pid: 28843
#   total CPU time (s): 2519.96
#   total CPU user time (s): 2519.79
#   total CPU system time (s): 0.17

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0566 second user time and 17.6648 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 15:44:00
IDJOB=4299536
IDBENCH=141411
IDSOLVER=2764
FILE ID=node103/4299536-1532785440
RUNJOBID= node103-1532775163-27028
PBS_JOBID= 21022463
Free space on /tmp= 56536 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Haystacks/Haystacks-ext-11_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299536-1532785440/watcher-4299536-1532785440 -o /tmp/evaluation-result-4299536-1532785440/solver-4299536-1532785440 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27028 --watchdog 2580  nacre_mini_release HOME/instance-4299536-1532785440.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dd1566dde9022858d7af3144994afffb
RANDOM SEED=1875219964

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20134436 kB
MemAvailable:   31832900 kB
Buffers:          302560 kB
Cached:         11579668 kB
SwapCached:            0 kB
Active:          4014024 kB
Inactive:        8021788 kB
Active(anon):     156280 kB
Inactive(anon):    25184 kB
Active(file):    3857744 kB
Inactive(file):  7996604 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              1268 kB
Writeback:             0 kB
AnonPages:        160452 kB
Mapped:            44372 kB
Shmem:             25228 kB
Slab:             300528 kB
SReclaimable:     272576 kB
SUnreclaim:        27952 kB
KernelStack:        3328 kB
PageTables:         4908 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     454324 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56532 MiB
End job on node103 at 2018-07-28 16:26:00