Trace number 4299738

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.9 2520.01

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-14-15_c18.xml
MD5SUMac0b4f561f7e67952eb47b21f0f500f8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables210
Number of constraints29
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":210}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":210}]
Minimum constraint arity14
Maximum constraint arity15
Distribution of constraint arities[{"arity":14,"count":15},{"arity":15,"count":14}]
Number of extensional constraints29
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":29}]
Optimization problemNO
Type of objective

Solver Data 

0.79/0.87	c NACRE 1.0.4
2519.89/2520.01	c
2519.89/2520.01	c # time = 2519.89
2519.89/2520.01	c # Dec = 123538
2519.89/2520.01	c # Propagate Calls = 8469553
2519.89/2520.01	c # assignAt Calls = 155320
2519.89/2520.01	c # removeAt Calls = 200880672
2519.89/2520.01	c # Run = 318
2519.89/2520.01	c # Conflicts = 121028
2519.89/2520.01	c # Memory used = 330.272 Mb
2519.89/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8837 MiB free)
  memory of node 1: 16384 MiB (12654 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299738-1532786920/watcher-4299738-1532786920 -o /tmp/evaluation-result-4299738-1532786920/solver-4299738-1532786920 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19388 --watchdog 2580 nacre_mini_release HOME/instance-4299738-1532786920.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22257, runsolver pid=22254
Current StackSize limit: 8192 KiB


[startup+0.100174 s]*
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21997396/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=41708 memory=17148 CPUtime=0.1 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 4990 0 0 0 10 0 0 0 20 0 1 0 96255140 42708992 4287 33554432000 4194304 4933779 140721949669776 140721949666776 139640301537242 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 10427 4287 568 181 0 4044 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 41708 KiB
Current children cumulated memory: 17148 KiB

[startup+0.209686 s]*
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21974332/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=62296 memory=36416 CPUtime=0.21 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 9834 0 0 0 21 0 0 0 20 0 1 0 96255140 63791104 9104 33554432000 4194304 4933779 140721949669776 140721949666776 4273659 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 15574 9104 571 181 0 9191 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 62296 KiB
Current children cumulated memory: 36416 KiB

[startup+0.309575 s]*
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21955360/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=82088 memory=54896 CPUtime=0.31 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 14479 0 0 0 30 1 0 0 20 0 1 0 96255140 84058112 13724 33554432000 4194304 4933779 140721949669776 140721949666776 4273600 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 20522 13724 571 181 0 14139 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 82088 KiB
Current children cumulated memory: 54896 KiB

[startup+0.700376 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21937132/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=133460 memory=105376 CPUtime=0.69 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 27468 0 0 0 66 3 0 0 20 0 1 0 96255140 136663040 26344 33554432000 4194304 4933779 140721949669776 140721949666776 139640301538859 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 33365 26344 571 181 0 26982 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 133460 KiB
Current children cumulated memory: 105376 KiB

[startup+1.50039 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21873148/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=166376 memory=137320 CPUtime=1.49 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 35493 0 0 0 145 4 0 0 20 0 1 0 96255140 170369024 34330 33554432000 4194304 4933779 140721949669776 140721949664376 4336764 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 41594 34330 571 181 0 35211 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 166376 KiB
Current children cumulated memory: 137320 KiB

[startup+3.1095 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21872276/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=166376 memory=137644 CPUtime=3.1 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 54748 0 0 0 305 5 0 0 20 0 1 0 96255140 170369024 34411 33554432000 4194304 4933779 140721949669776 140721949668296 139640302409245 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 41594 34411 604 181 0 35211 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 166376 KiB
Current children cumulated memory: 137644 KiB

[startup+6.30037 s]
/proc/loadavg: 1.99 2.00 2.04 4/187 22258
/proc/meminfo: memFree=21868848/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=166376 memory=137644 CPUtime=6.29 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 78550 0 0 0 623 6 0 0 20 0 1 0 96255140 170369024 34411 33554432000 4194304 4933779 140721949669776 140721949668296 139640302411207 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 41594 34411 604 181 0 35211 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 166376 KiB
Current children cumulated memory: 137644 KiB

[startup+12.7004 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21867020/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=166376 memory=137644 CPUtime=12.68 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 126359 0 0 0 1261 7 0 0 20 0 1 0 96255140 170369024 34411 33554432000 4194304 4933779 140721949669776 140721949668296 139640302411207 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 41594 34411 604 181 0 35211 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 166376 KiB
Current children cumulated memory: 137644 KiB

[startup+25.5004 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21863812/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=166376 memory=137644 CPUtime=25.49 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 174494 0 0 0 2539 10 0 0 20 0 1 0 96255140 170369024 34411 33554432000 4194304 4933779 140721949669776 140721949668296 4377514 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 41594 34411 604 181 0 35211 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 166376 KiB
Current children cumulated memory: 137644 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22258
/proc/meminfo: memFree=21852444/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=169464 memory=141528 CPUtime=51.1 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 222210 0 0 0 5098 12 0 0 20 0 1 0 96255140 173531136 35382 33554432000 4194304 4933779 140721949669776 140721949667528 4377638 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 42366 35382 604 181 0 35983 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 169464 KiB
Current children cumulated memory: 141528 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22266
/proc/meminfo: memFree=21822372/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=182820 memory=158348 CPUtime=102.28 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 246972 0 0 0 10213 15 0 0 20 0 1 0 96255140 187207680 39587 33554432000 4194304 4933779 140721949669776 140721949667544 139640301539124 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 45705 39587 604 181 0 39322 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 182820 KiB
Current children cumulated memory: 158348 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22267
/proc/meminfo: memFree=21792924/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=203664 memory=179860 CPUtime=162.28 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 256849 0 0 0 16211 17 0 0 20 0 1 0 96255140 208551936 44965 33554432000 4194304 4933779 140721949669776 140721949667528 4377379 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 50916 44965 604 181 0 44533 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 203664 KiB
Current children cumulated memory: 179860 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22268
/proc/meminfo: memFree=21772480/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=218476 memory=194888 CPUtime=222.27 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 263669 0 0 0 22209 18 0 0 20 0 1 0 96255140 223719424 48722 33554432000 4194304 4933779 140721949669776 140721949667528 139640302411655 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 54619 48722 604 181 0 48236 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 218476 KiB
Current children cumulated memory: 194888 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22269
/proc/meminfo: memFree=21753020/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=229264 memory=205804 CPUtime=282.27 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 272244 0 0 0 28208 19 0 0 20 0 1 0 96255140 234766336 51451 33554432000 4194304 4933779 140721949669776 140721949667528 4376896 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 57316 51451 604 181 0 50933 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 229264 KiB
Current children cumulated memory: 205804 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22270
/proc/meminfo: memFree=21733696/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=237704 memory=214248 CPUtime=342.27 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 282219 0 0 0 34206 21 0 0 20 0 1 0 96255140 243408896 53562 33554432000 4194304 4933779 140721949669776 140721949667480 4377418 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 59426 53562 604 181 0 53043 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 237704 KiB
Current children cumulated memory: 214248 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22271
/proc/meminfo: memFree=21718212/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=243736 memory=220268 CPUtime=402.26 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 293139 0 0 0 40204 22 0 0 20 0 1 0 96255140 249585664 55067 33554432000 4194304 4933779 140721949669776 140721949667528 139640301556624 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 60934 55067 604 181 0 54551 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 243736 KiB
Current children cumulated memory: 220268 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 22272
/proc/meminfo: memFree=21708952/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=249604 memory=226220 CPUtime=462.27 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 305762 0 0 0 46203 24 0 0 20 0 1 0 96255140 255594496 56555 33554432000 4194304 4933779 140721949669776 140721949667480 139640302411207 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 62401 56555 604 181 0 56018 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 249604 KiB
Current children cumulated memory: 226220 KiB


################
# More data... #
################

/proc/22257/statm: 80428 74557 604 181 0 74045 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 321712 KiB
Current children cumulated memory: 298228 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.08 2.08 3/187 22311
/proc/meminfo: memFree=21539388/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=325184 memory=301716 CPUtime=1782.21 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 387979 0 0 0 178183 38 0 0 20 0 1 0 96255140 332988416 75429 33554432000 4194304 4933779 140721949669776 140721949667480 139640302409245 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 81296 75429 604 181 0 74913 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 325184 KiB
Current children cumulated memory: 301716 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.07 2.07 3/187 22312
/proc/meminfo: memFree=21531072/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=329460 memory=306024 CPUtime=1842.2 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 393307 0 0 0 184181 39 0 0 20 0 1 0 96255140 337367040 76506 33554432000 4194304 4933779 140721949669776 140721949667480 139640307745680 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 82365 76506 604 181 0 75982 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 329460 KiB
Current children cumulated memory: 306024 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/187 22320
/proc/meminfo: memFree=21523928/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=332136 memory=308716 CPUtime=1902.2 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 398090 0 0 0 190180 40 0 0 20 0 1 0 96255140 340107264 77179 33554432000 4194304 4933779 140721949669776 140721949667480 139640302411207 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 83034 77179 604 181 0 76651 0
Current children cumulated CPU time: 1902.2 s
Current children cumulated vsize: 332136 KiB
Current children cumulated memory: 308716 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/187 22321
/proc/meminfo: memFree=21520052/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=333468 memory=310024 CPUtime=1962.2 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 402829 0 0 0 196179 41 0 0 20 0 1 0 96255140 341471232 77506 33554432000 4194304 4933779 140721949669776 140721949667480 139640302411207 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 83367 77506 604 181 0 76984 0
Current children cumulated CPU time: 1962.2 s
Current children cumulated vsize: 333468 KiB
Current children cumulated memory: 310024 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 22322
/proc/meminfo: memFree=21516980/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=335580 memory=311944 CPUtime=2022.2 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 404034 0 0 0 202179 41 0 0 20 0 1 0 96255140 343633920 77986 33554432000 4194304 4933779 140721949669776 140721949667464 139640301555693 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 83895 77986 604 181 0 77512 0
Current children cumulated CPU time: 2022.2 s
Current children cumulated vsize: 335580 KiB
Current children cumulated memory: 311944 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 22323
/proc/meminfo: memFree=21514368/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=336920 memory=313364 CPUtime=2082.19 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 405209 0 0 0 208178 41 0 0 20 0 1 0 96255140 345006080 78341 33554432000 4194304 4933779 140721949669776 140721949667528 4377391 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 84230 78341 604 181 0 77847 0
Current children cumulated CPU time: 2082.19 s
Current children cumulated vsize: 336920 KiB
Current children cumulated memory: 313364 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 22324
/proc/meminfo: memFree=21509648/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=338800 memory=315356 CPUtime=2142.2 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 406912 0 0 0 214178 42 0 0 20 0 1 0 96255140 346931200 78839 33554432000 4194304 4933779 140721949669776 140721949667528 4377379 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 84700 78839 604 181 0 78317 0
Current children cumulated CPU time: 2142.2 s
Current children cumulated vsize: 338800 KiB
Current children cumulated memory: 315356 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 22325
/proc/meminfo: memFree=21506904/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=339768 memory=316344 CPUtime=2202.19 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 408430 0 0 0 220177 42 0 0 20 0 1 0 96255140 347922432 79086 33554432000 4194304 4933779 140721949669776 140721949667480 4377638 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 84942 79086 604 181 0 78559 0
Current children cumulated CPU time: 2202.19 s
Current children cumulated vsize: 339768 KiB
Current children cumulated memory: 316344 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22326
/proc/meminfo: memFree=21502540/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=340836 memory=317380 CPUtime=2262.19 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 410416 0 0 0 226177 42 0 0 20 0 1 0 96255140 349016064 79345 33554432000 4194304 4933779 140721949669776 140721949667528 4377379 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 85209 79345 604 181 0 78826 0
Current children cumulated CPU time: 2262.19 s
Current children cumulated vsize: 340836 KiB
Current children cumulated memory: 317380 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22327
/proc/meminfo: memFree=21495216/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=344064 memory=320620 CPUtime=2322.18 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 413355 0 0 0 232176 42 0 0 20 0 1 0 96255140 352321536 80155 33554432000 4194304 4933779 140721949669776 140721949667480 4377638 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 86016 80155 604 181 0 79633 0
Current children cumulated CPU time: 2322.18 s
Current children cumulated vsize: 344064 KiB
Current children cumulated memory: 320620 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22328
/proc/meminfo: memFree=21492092/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=346416 memory=323044 CPUtime=2382.18 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 416582 0 0 0 238175 43 0 0 20 0 1 0 96255140 354729984 80761 33554432000 4194304 4933779 140721949669776 140721949667480 139640301555736 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 86604 80761 604 181 0 80221 0
Current children cumulated CPU time: 2382.18 s
Current children cumulated vsize: 346416 KiB
Current children cumulated memory: 323044 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21826432/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=349632 memory=326060 CPUtime=2442.18 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 420330 0 0 0 244175 43 0 0 20 0 1 0 96255140 358023168 81515 33554432000 4194304 4933779 140721949669776 140721949667544 4377591 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 87408 81515 604 181 0 81025 0
Current children cumulated CPU time: 2442.18 s
Current children cumulated vsize: 349632 KiB
Current children cumulated memory: 326060 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22398
/proc/meminfo: memFree=21812020/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=351924 memory=328408 CPUtime=2502.18 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 424494 0 0 0 250174 44 0 0 20 0 1 0 96255140 360370176 82102 33554432000 4194304 4933779 140721949669776 140721949667480 139640301538984 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 87981 82102 604 181 0 81598 0
Current children cumulated CPU time: 2502.18 s
Current children cumulated vsize: 351924 KiB
Current children cumulated memory: 328408 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 22399
/proc/meminfo: memFree=21806568/32770624 swapFree=67108796/67108860
[pid=22257] ppid=22254 vsize=353624 memory=330204 CPUtime=2519.89 cores=1,3,5,7
/proc/22257/stat : 22257 (nacre_mini_rele) R 22254 22257 24279 0 -1 4202496 425067 0 0 0 251945 44 0 0 20 0 1 0 96255140 362110976 82551 33554432000 4194304 4933779 140721949669776 140721949667464 139640301538984 0 0 4096 24578 0 0 0 17 3 0 0 0 0 0 7034520 7039168 29073408 140721949672600 140721949672700 140721949672700 140721949675458 0
/proc/22257/statm: 88406 82551 604 181 0 82023 0
Current children cumulated CPU time: 2519.89 s
Current children cumulated vsize: 353624 KiB
Current children cumulated memory: 330204 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 22257 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.45 s, system=0.446982 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.9
CPU user time (s): 2519.45
CPU system time (s): 0.446982
CPU usage (%): 99.9956
Max. virtual memory (cumulated for all children) (KiB): 353624
Max. memory (cumulated for all children) (KiB): 330204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.45
system time used= 0.446982
maximum resident set size= 330276
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 425109
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31
involuntary context switches= 2207


# summary of solver processes directly reported to runsolver:
#   pid: 22257
#   total CPU time (s): 2519.9
#   total CPU user time (s): 2519.45
#   total CPU system time (s): 0.446982

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.46934 second user time and 18.6283 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-28 16:08:40
IDJOB=4299738
IDBENCH=141438
IDSOLVER=2764
FILE ID=node138/4299738-1532786920
RUNJOBID= node138-1532773607-19388
PBS_JOBID= 21022455
Free space on /tmp= 53792 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-14-15_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299738-1532786920/watcher-4299738-1532786920 -o /tmp/evaluation-result-4299738-1532786920/solver-4299738-1532786920 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19388 --watchdog 2580  nacre_mini_release HOME/instance-4299738-1532786920.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac0b4f561f7e67952eb47b21f0f500f8
RANDOM SEED=1223739741

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22007344 kB
MemAvailable:   31674192 kB
Buffers:          210916 kB
Cached:          9660264 kB
SwapCached:           44 kB
Active:          2804264 kB
Inactive:        7375772 kB
Active(anon):     253476 kB
Inactive(anon):    83488 kB
Active(file):    2550788 kB
Inactive(file):  7292284 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:              3888 kB
Writeback:             0 kB
AnonPages:        400032 kB
Mapped:            39352 kB
Shmem:             25164 kB
Slab:             280036 kB
SReclaimable:     252236 kB
SUnreclaim:        27800 kB
KernelStack:        3360 kB
PageTables:         5236 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     602124 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    292864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53796 MiB
End job on node138 at 2018-07-28 16:50:40