Trace number 4299770

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.89 2520.02

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-08-09_c18.xml
MD5SUM352bf2632dd9da6639b1d332c92c1592
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables72
Number of constraints17
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":72}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":72}]
Minimum constraint arity8
Maximum constraint arity9
Distribution of constraint arities[{"arity":8,"count":9},{"arity":9,"count":8}]
Number of extensional constraints17
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":17}]
Optimization problemNO
Type of objective

Solver Data 

0.89/0.95	c NACRE 1.0.4
2519.88/2520.01	c
2519.88/2520.01	c # time = 2519.88
2519.88/2520.01	c # Dec = 845064
2519.88/2520.01	c # Propagate Calls = 38358352
2519.88/2520.01	c # assignAt Calls = 1068067
2519.88/2520.01	c # removeAt Calls = 369795286
2519.88/2520.01	c # Run = 1775
2519.88/2520.01	c # Conflicts = 818849
2519.88/2520.01	c # Memory used = 436.844 Mb
2519.88/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9591 MiB free)
  memory of node 1: 16384 MiB (9967 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299770-1532787772/watcher-4299770-1532787772 -o /tmp/evaluation-result-4299770-1532787772/solver-4299770-1532787772 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580 nacre_mini_release HOME/instance-4299770-1532787772.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28995, runsolver pid=28992

[startup+0.100107 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=20023708/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=32672 memory=7716 CPUtime=0.1 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 2835 0 0 0 10 0 0 0 20 0 1 0 96340366 33456128 1929 33554432000 4194304 4933779 140722967519248 140722967516824 140408757652453 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 8168 1929 558 181 0 1785 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32672 KiB
Current children cumulated memory: 7716 KiB

[startup+0.209506 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19999288/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=56676 memory=32024 CPUtime=0.2 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 9516 0 0 0 20 0 0 0 20 0 1 0 96340366 58036224 8006 33554432000 4194304 4933779 140722967519248 140722967514072 140408757644856 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 14169 8006 570 181 0 7786 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 56676 KiB
Current children cumulated memory: 32024 KiB

[startup+0.309455 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19983664/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=72488 memory=47336 CPUtime=0.31 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 13342 0 0 0 30 1 0 0 20 0 1 0 96340366 74227712 11834 33554432000 4194304 4933779 140722967519248 140722967514072 140408757662639 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 18122 11834 570 181 0 11739 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 72488 KiB
Current children cumulated memory: 47336 KiB

[startup+0.700328 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19953408/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=116220 memory=90352 CPUtime=0.69 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 24118 0 0 0 67 2 0 0 20 0 1 0 96340366 119009280 22588 33554432000 4194304 4933779 140722967519248 140722967513928 4273659 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 29055 22588 570 181 0 22672 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 116220 KiB
Current children cumulated memory: 90352 KiB

[startup+1.50033 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19889732/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=170576 memory=141568 CPUtime=1.49 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 36969 0 0 0 145 4 0 0 20 0 1 0 96340366 174669824 35392 33554432000 4194304 4933779 140722967519248 140722967517768 140408758507532 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 42644 35392 570 181 0 36261 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 170576 KiB
Current children cumulated memory: 141568 KiB

[startup+3.10955 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19889112/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=170576 memory=141844 CPUtime=3.1 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 66571 0 0 0 304 6 0 0 20 0 1 0 96340366 174669824 35461 33554432000 4194304 4933779 140722967519248 140722967517768 140408758518107 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 42644 35461 604 181 0 36261 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 170576 KiB
Current children cumulated memory: 141844 KiB

[startup+6.30045 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19889236/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=170576 memory=141844 CPUtime=6.28 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 96876 0 0 0 621 7 0 0 20 0 1 0 96340366 174669824 35461 33554432000 4194304 4933779 140722967519248 140722967517768 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 42644 35461 604 181 0 36261 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 170576 KiB
Current children cumulated memory: 141844 KiB

[startup+12.7005 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19889240/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=170576 memory=141844 CPUtime=12.69 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 128642 0 0 0 1260 9 0 0 20 0 1 0 96340366 174669824 35461 33554432000 4194304 4933779 140722967519248 140722967517768 140408758507524 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 42644 35461 604 181 0 36261 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 170576 KiB
Current children cumulated memory: 141844 KiB

[startup+25.5005 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19883520/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=177436 memory=148408 CPUtime=25.49 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 197095 0 0 0 2537 12 0 0 20 0 1 0 96340366 181694464 37102 33554432000 4194304 4933779 140722967519248 140722967517000 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 44359 37102 604 181 0 37976 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 177436 KiB
Current children cumulated memory: 148408 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28996
/proc/meminfo: memFree=19857232/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=202636 memory=173644 CPUtime=51.09 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 241763 0 0 0 5094 15 0 0 20 0 1 0 96340366 207499264 43411 33554432000 4194304 4933779 140722967519248 140722967517016 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 50659 43411 604 181 0 44276 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 202636 KiB
Current children cumulated memory: 173644 KiB

[startup+102.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 28997
/proc/meminfo: memFree=19832556/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=226172 memory=197368 CPUtime=102.29 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 290790 0 0 0 10209 20 0 0 20 0 1 0 96340366 231600128 49342 33554432000 4194304 4933779 140722967519248 140722967516952 140408757649994 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 56543 49342 604 181 0 50160 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 226172 KiB
Current children cumulated memory: 197368 KiB

[startup+162.3 s]
/proc/loadavg: 2.56 2.19 2.10 3/187 28999
/proc/meminfo: memFree=19809612/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=245320 memory=218244 CPUtime=162.27 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 343328 0 0 0 16202 25 0 0 20 0 1 0 96340366 251207680 54561 33554432000 4194304 4933779 140722967519248 140722967516952 4377445 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 61330 54561 604 181 0 54947 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 245320 KiB
Current children cumulated memory: 218244 KiB

[startup+222.3 s]
/proc/loadavg: 2.21 2.15 2.10 3/187 29061
/proc/meminfo: memFree=19813788/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=257860 memory=234316 CPUtime=222.25 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 375962 0 0 0 22198 27 0 0 20 0 1 0 96340366 264048640 58579 33554432000 4194304 4933779 140722967519248 140722967517000 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 64465 58579 604 181 0 58082 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 257860 KiB
Current children cumulated memory: 234316 KiB

[startup+282.3 s]
/proc/loadavg: 2.08 2.13 2.09 3/187 29062
/proc/meminfo: memFree=19766696/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=271616 memory=248220 CPUtime=282.24 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 387556 0 0 0 28196 28 0 0 20 0 1 0 96340366 278134784 62055 33554432000 4194304 4933779 140722967519248 140722967516952 140408758516785 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 67904 62055 604 181 0 61521 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 271616 KiB
Current children cumulated memory: 248220 KiB

[startup+342.3 s]
/proc/loadavg: 2.12 2.13 2.10 3/187 29064
/proc/meminfo: memFree=19724436/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=285900 memory=262400 CPUtime=342.24 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 394159 0 0 0 34195 29 0 0 20 0 1 0 96340366 292761600 65600 33554432000 4194304 4933779 140722967519248 140722967516952 140408758516785 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 71475 65600 604 181 0 65092 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 285900 KiB
Current children cumulated memory: 262400 KiB

[startup+402.3 s]
/proc/loadavg: 2.04 2.11 2.09 3/187 29065
/proc/meminfo: memFree=19701056/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=292788 memory=269476 CPUtime=402.24 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 402219 0 0 0 40194 30 0 0 20 0 1 0 96340366 299814912 67369 33554432000 4194304 4933779 140722967519248 140722967516952 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 73197 67369 604 181 0 66814 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 292788 KiB
Current children cumulated memory: 269476 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.09 2.09 3/188 29074
/proc/meminfo: memFree=19674260/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=300000 memory=276764 CPUtime=462.24 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 412892 0 0 0 46193 31 0 0 20 0 1 0 96340366 307200000 69191 33554432000 4194304 4933779 140722967519248 140722967516952 140408758516785 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 75000 69191 604 181 0 68617 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 300000 KiB
Current children cumulated memory: 276764 KiB


################
# More data... #
################

/proc/28995/statm: 104617 98806 604 181 0 98234 0
Current children cumulated CPU time: 1722.19 s
Current children cumulated vsize: 418468 KiB
Current children cumulated memory: 395224 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29112
/proc/meminfo: memFree=19428852/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=422148 memory=398940 CPUtime=1782.19 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 585511 0 0 0 178166 53 0 0 20 0 1 0 96340366 432279552 99735 33554432000 4194304 4933779 140722967519248 140722967516952 4212880 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 105537 99735 604 181 0 99154 0
Current children cumulated CPU time: 1782.19 s
Current children cumulated vsize: 422148 KiB
Current children cumulated memory: 398940 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29113
/proc/meminfo: memFree=19422120/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=424236 memory=400904 CPUtime=1842.19 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 590890 0 0 0 184165 54 0 0 20 0 1 0 96340366 434417664 100226 33554432000 4194304 4933779 140722967519248 140722967516952 4423397 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 106059 100226 604 181 0 99676 0
Current children cumulated CPU time: 1842.19 s
Current children cumulated vsize: 424236 KiB
Current children cumulated memory: 400904 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29114
/proc/meminfo: memFree=19411820/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=426992 memory=403736 CPUtime=1902.18 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 597220 0 0 0 190164 54 0 0 20 0 1 0 96340366 437239808 100934 33554432000 4194304 4933779 140722967519248 140722967516952 140408757650007 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 106748 100934 604 181 0 100365 0
Current children cumulated CPU time: 1902.18 s
Current children cumulated vsize: 426992 KiB
Current children cumulated memory: 403736 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29116
/proc/meminfo: memFree=19406224/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=430176 memory=406828 CPUtime=1962.18 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 604213 0 0 0 196163 55 0 0 20 0 1 0 96340366 440500224 101707 33554432000 4194304 4933779 140722967519248 140722967516952 140408758518120 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 107544 101707 604 181 0 101161 0
Current children cumulated CPU time: 1962.18 s
Current children cumulated vsize: 430176 KiB
Current children cumulated memory: 406828 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29117
/proc/meminfo: memFree=19401992/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=432436 memory=409092 CPUtime=2022.18 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 610961 0 0 0 202163 55 0 0 20 0 1 0 96340366 442814464 102273 33554432000 4194304 4933779 140722967519248 140722967516952 140408757649935 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 108109 102273 604 181 0 101726 0
Current children cumulated CPU time: 2022.18 s
Current children cumulated vsize: 432436 KiB
Current children cumulated memory: 409092 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29118
/proc/meminfo: memFree=19396636/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=434976 memory=411656 CPUtime=2082.19 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 619529 0 0 0 208162 57 0 0 20 0 1 0 96340366 445415424 102914 33554432000 4194304 4933779 140722967519248 140722967517000 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 108744 102914 604 181 0 102361 0
Current children cumulated CPU time: 2082.19 s
Current children cumulated vsize: 434976 KiB
Current children cumulated memory: 411656 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29120
/proc/meminfo: memFree=19388840/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=437688 memory=414392 CPUtime=2142.17 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 622091 0 0 0 214160 57 0 0 20 0 1 0 96340366 448192512 103598 33554432000 4194304 4933779 140722967519248 140722967517000 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 109422 103598 604 181 0 103039 0
Current children cumulated CPU time: 2142.17 s
Current children cumulated vsize: 437688 KiB
Current children cumulated memory: 414392 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29121
/proc/meminfo: memFree=19380448/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=441924 memory=418596 CPUtime=2202.17 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 624926 0 0 0 220160 57 0 0 20 0 1 0 96340366 452530176 104649 33554432000 4194304 4933779 140722967519248 140722967517000 140408757649981 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 110481 104649 604 181 0 104098 0
Current children cumulated CPU time: 2202.17 s
Current children cumulated vsize: 441924 KiB
Current children cumulated memory: 418596 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29130
/proc/meminfo: memFree=19371568/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=447676 memory=424204 CPUtime=2262.17 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 629392 0 0 0 226159 58 0 0 20 0 1 0 96340366 458420224 106051 33554432000 4194304 4933779 140722967519248 140722967516936 4377609 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 111919 106051 604 181 0 105536 0
Current children cumulated CPU time: 2262.17 s
Current children cumulated vsize: 447676 KiB
Current children cumulated memory: 424204 KiB

[startup+2322.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/188 29153
/proc/meminfo: memFree=19367800/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=449392 memory=426064 CPUtime=2322.17 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 633434 0 0 0 232159 58 0 0 20 0 1 0 96340366 460177408 106516 33554432000 4194304 4933779 140722967519248 140722967517000 140408758518097 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 112348 106516 604 181 0 105965 0
Current children cumulated CPU time: 2322.17 s
Current children cumulated vsize: 449392 KiB
Current children cumulated memory: 426064 KiB

[startup+2382.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/188 29154
/proc/meminfo: memFree=19359340/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=452072 memory=428680 CPUtime=2382.16 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 638293 0 0 0 238157 59 0 0 20 0 1 0 96340366 462921728 107170 33554432000 4194304 4933779 140722967519248 140722967517000 4437839 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 113018 107170 604 181 0 106635 0
Current children cumulated CPU time: 2382.16 s
Current children cumulated vsize: 452072 KiB
Current children cumulated memory: 428680 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 29155
/proc/meminfo: memFree=19349636/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=454788 memory=431424 CPUtime=2442.16 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 643775 0 0 0 244156 60 0 0 20 0 1 0 96340366 465702912 107856 33554432000 4194304 4933779 140722967519248 140722967517000 140408757652453 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 113731 107856 604 181 0 107348 0
Current children cumulated CPU time: 2442.16 s
Current children cumulated vsize: 454788 KiB
Current children cumulated memory: 431424 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29156
/proc/meminfo: memFree=19339568/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=458828 memory=435400 CPUtime=2502.16 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 650772 0 0 0 250155 61 0 0 20 0 1 0 96340366 469839872 108850 33554432000 4194304 4933779 140722967519248 140722967516952 4437538 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 114707 108850 604 181 0 108324 0
Current children cumulated CPU time: 2502.16 s
Current children cumulated vsize: 458828 KiB
Current children cumulated memory: 435400 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29156
/proc/meminfo: memFree=19335600/32770624 swapFree=67108860/67108860
[pid=28995] ppid=28992 vsize=460212 memory=436688 CPUtime=2519.88 cores=0,2,4,6
/proc/28995/stat : 28995 (nacre_mini_rele) R 28992 28995 26996 0 -1 4202496 651823 0 0 0 251926 62 0 0 20 0 1 0 96340366 471257088 109172 33554432000 4194304 4933779 140722967519248 140722967516936 140408758514715 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38854656 140722967524504 140722967524604 140722967524604 140722967527362 0
/proc/28995/statm: 115053 109172 604 181 0 108670 0
Current children cumulated CPU time: 2519.88 s
Current children cumulated vsize: 460212 KiB
Current children cumulated memory: 436688 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 28995 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.27 s, system=0.623985 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.02
CPU time (s): 2519.89
CPU user time (s): 2519.27
CPU system time (s): 0.623985
CPU usage (%): 99.995
Max. virtual memory (cumulated for all children) (KiB): 460212
Max. memory (cumulated for all children) (KiB): 436688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.27
system time used= 0.623985
maximum resident set size= 436888
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 652348
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 96
involuntary context switches= 3161


# summary of solver processes directly reported to runsolver:
#   pid: 28995
#   total CPU time (s): 2519.89
#   total CPU user time (s): 2519.27
#   total CPU system time (s): 0.623985

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.272 second user time and 14.4511 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 16:22:52
IDJOB=4299770
IDBENCH=141442
IDSOLVER=2764
FILE ID=node103/4299770-1532787772
RUNJOBID= node103-1532775163-27027
PBS_JOBID= 21022463
Free space on /tmp= 56532 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-08-09_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299770-1532787772/watcher-4299770-1532787772 -o /tmp/evaluation-result-4299770-1532787772/solver-4299770-1532787772 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580  nacre_mini_release HOME/instance-4299770-1532787772.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 352bf2632dd9da6639b1d332c92c1592
RANDOM SEED=1467327157

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20028684 kB
MemAvailable:   31731564 kB
Buffers:          302656 kB
Cached:         11584532 kB
SwapCached:            0 kB
Active:          4117372 kB
Inactive:        8022272 kB
Active(anon):     255712 kB
Inactive(anon):    25184 kB
Active(file):    3861660 kB
Inactive(file):  7997088 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              4860 kB
Writeback:             0 kB
AnonPages:        354096 kB
Mapped:            44508 kB
Shmem:             25228 kB
Slab:             300580 kB
SReclaimable:     272592 kB
SUnreclaim:        27988 kB
KernelStack:        3360 kB
PageTables:         5508 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     551152 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    292864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56528 MiB
End job on node103 at 2018-07-28 17:04:52