Trace number 4299810

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.76 2520.01

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-15-16_c18.xml
MD5SUM57cb1bb20db45191d6ed694399d37744
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables240
Number of constraints31
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":240}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":240}]
Minimum constraint arity15
Maximum constraint arity16
Distribution of constraint arities[{"arity":15,"count":16},{"arity":16,"count":15}]
Number of extensional constraints31
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":31}]
Optimization problemNO
Type of objective

Solver Data 

0.60/0.67	c NACRE 1.0.4
2519.75/2520.00	c
2519.75/2520.00	c # time = 2519.75
2519.75/2520.00	c # Dec = 96869
2519.75/2520.00	c # Propagate Calls = 7236210
2519.75/2520.00	c # assignAt Calls = 125676
2519.75/2520.00	c # removeAt Calls = 176831340
2519.75/2520.00	c # Run = 255
2519.75/2520.00	c # Conflicts = 94970
2519.75/2520.01	c # Memory used = 296.228 Mb
2519.75/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9084 MiB free)
  memory of node 1: 16384 MiB (12338 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299810-1532789319/watcher-4299810-1532789319 -o /tmp/evaluation-result-4299810-1532789319/solver-4299810-1532789319 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580 nacre_mini_release HOME/instance-4299810-1532789319.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22388, runsolver pid=22385
Current StackSize limit: 8192 KiB


[startup+0.100848 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21922464/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=41452 memory=17192 CPUtime=0.09 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 4791 0 0 0 9 0 0 0 20 0 1 0 96495119 42446848 4298 33554432000 4194304 4933779 140724857751632 140724857746232 140305100209980 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 10363 4298 570 181 0 3980 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 17192 KiB

[startup+0.209486 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21904148/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=61016 memory=36200 CPUtime=0.21 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 9515 0 0 0 20 1 0 0 20 0 1 0 96495119 62480384 9050 33554432000 4194304 4933779 140724857751632 140724857746232 4274455 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 15254 9050 570 181 0 8871 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 61016 KiB
Current children cumulated memory: 36200 KiB

[startup+0.309618 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21894476/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=70028 memory=45260 CPUtime=0.3 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 11877 0 0 0 29 1 0 0 20 0 1 0 96495119 71708672 11315 33554432000 4194304 4933779 140724857751632 140724857746232 140305100655616 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 17507 11315 570 181 0 11124 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 70028 KiB
Current children cumulated memory: 45260 KiB

[startup+0.700323 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21860904/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=137116 memory=108452 CPUtime=0.69 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 28019 0 0 0 66 3 0 0 20 0 1 0 96495119 140406784 27113 33554432000 4194304 4933779 140724857751632 140724857746232 140305100226500 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 34279 27113 570 181 0 27896 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 137116 KiB
Current children cumulated memory: 108452 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21831316/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=137116 memory=108452 CPUtime=1.49 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 28036 0 0 0 146 3 0 0 20 0 1 0 96495119 140406784 27113 33554432000 4194304 4933779 140724857751632 140724857750152 4377379 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 34279 27113 570 181 0 27896 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 137116 KiB
Current children cumulated memory: 108452 KiB

[startup+3.10933 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21831148/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=137116 memory=108592 CPUtime=3.1 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 44477 0 0 0 306 4 0 0 20 0 1 0 96495119 140406784 27148 33554432000 4194304 4933779 140724857751632 140724857750152 140305100209696 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 34279 27148 604 181 0 27896 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 137116 KiB
Current children cumulated memory: 108592 KiB

[startup+6.30032 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21830772/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=137116 memory=108592 CPUtime=6.28 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 76550 0 0 0 623 5 0 0 20 0 1 0 96495119 140406784 27148 33554432000 4194304 4933779 140724857751632 140724857750152 4377379 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 34279 27148 604 181 0 27896 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 137116 KiB
Current children cumulated memory: 108592 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21830648/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=137116 memory=108592 CPUtime=12.68 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 101247 0 0 0 1261 7 0 0 20 0 1 0 96495119 140406784 27148 33554432000 4194304 4933779 140724857751632 140724857750152 140305101079554 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 34279 27148 604 181 0 27896 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 137116 KiB
Current children cumulated memory: 108592 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21830028/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=137116 memory=108592 CPUtime=25.48 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 139620 0 0 0 2539 9 0 0 20 0 1 0 96495119 140406784 27148 33554432000 4194304 4933779 140724857751632 140724857750152 140305101080103 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 34279 27148 604 181 0 27896 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 137116 KiB
Current children cumulated memory: 108592 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22389
/proc/meminfo: memFree=21824572/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=140712 memory=112304 CPUtime=51.09 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 177887 0 0 0 5098 11 0 0 20 0 1 0 96495119 144089088 28076 33554432000 4194304 4933779 140724857751632 140724857749384 4377379 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 35178 28076 604 181 0 28795 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 140712 KiB
Current children cumulated memory: 112304 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22398
/proc/meminfo: memFree=21812020/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=150728 memory=121988 CPUtime=102.26 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 206779 0 0 0 10213 13 0 0 20 0 1 0 96495119 154345472 30497 33554432000 4194304 4933779 140724857751632 140724857749384 140305100226425 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 37682 30497 604 181 0 31299 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 150728 KiB
Current children cumulated memory: 121988 KiB

[startup+162.3 s]
/proc/loadavg: 1.96 2.00 2.04 3/188 22460
/proc/meminfo: memFree=22021808/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=159664 memory=135416 CPUtime=162.24 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 232242 0 0 0 16209 15 0 0 20 0 1 0 96495119 163495936 33854 33554432000 4194304 4933779 140724857751632 140724857749384 140305101080113 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 39916 33854 604 181 0 33533 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 159664 KiB
Current children cumulated memory: 135416 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/188 22461
/proc/meminfo: memFree=21965512/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=175988 memory=152508 CPUtime=222.23 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 238240 0 0 0 22206 17 0 0 20 0 1 0 96495119 180211712 38127 33554432000 4194304 4933779 140724857751632 140724857749400 140305100209707 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 43997 38127 604 181 0 37614 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 175988 KiB
Current children cumulated memory: 152508 KiB

[startup+282.3 s]
/proc/loadavg: 1.92 1.98 2.03 3/188 22462
/proc/meminfo: memFree=21924396/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=186348 memory=162612 CPUtime=282.21 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 244795 0 0 0 28203 18 0 0 20 0 1 0 96495119 190820352 40653 33554432000 4194304 4933779 140724857751632 140724857749384 140305101082055 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 46587 40653 604 181 0 40204 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 186348 KiB
Current children cumulated memory: 162612 KiB

[startup+342.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/188 22463
/proc/meminfo: memFree=21894364/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=194232 memory=170700 CPUtime=342.21 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 252733 0 0 0 34202 19 0 0 20 0 1 0 96495119 198893568 42675 33554432000 4194304 4933779 140724857751632 140724857749400 140305100209847 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 48558 42675 604 181 0 42175 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 194232 KiB
Current children cumulated memory: 170700 KiB

[startup+402.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/187 22465
/proc/meminfo: memFree=21871156/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=201556 memory=177980 CPUtime=402.21 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 261957 0 0 0 40200 21 0 0 20 0 1 0 96495119 206393344 44495 33554432000 4194304 4933779 140724857751632 140724857749400 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 50389 44495 604 181 0 44006 0
Current children cumulated CPU time: 402.21 s
Current children cumulated vsize: 201556 KiB
Current children cumulated memory: 177980 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 22466
/proc/meminfo: memFree=21849568/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=207988 memory=184432 CPUtime=462.2 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 272048 0 0 0 46198 22 0 0 20 0 1 0 96495119 212979712 46108 33554432000 4194304 4933779 140724857751632 140724857749384 140305101081629 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 51997 46108 604 181 0 45614 0
Current children cumulated CPU time: 462.2 s
Current children cumulated vsize: 207988 KiB
Current children cumulated memory: 184432 KiB


################
# More data... #
################

/proc/22388/statm: 73515 67666 604 181 0 67132 0
Current children cumulated CPU time: 1722.1 s
Current children cumulated vsize: 294060 KiB
Current children cumulated memory: 270664 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 22711
/proc/meminfo: memFree=21636060/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=296060 memory=272520 CPUtime=1782.09 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 369874 0 0 0 178171 38 0 0 20 0 1 0 96495119 303165440 68130 33554432000 4194304 4933779 140724857751632 140724857749384 140305101081629 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 74015 68130 604 181 0 67632 0
Current children cumulated CPU time: 1782.09 s
Current children cumulated vsize: 296060 KiB
Current children cumulated memory: 272520 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/186 22712
/proc/meminfo: memFree=21618972/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=298608 memory=275216 CPUtime=1842.08 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 372465 0 0 0 184170 38 0 0 20 0 1 0 96495119 305774592 68804 33554432000 4194304 4933779 140724857751632 140724857749336 140305100214896 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 74652 68804 604 181 0 68269 0
Current children cumulated CPU time: 1842.08 s
Current children cumulated vsize: 298608 KiB
Current children cumulated memory: 275216 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22722
/proc/meminfo: memFree=21610356/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=299816 memory=276440 CPUtime=1902.08 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 374889 0 0 0 190170 38 0 0 20 0 1 0 96495119 307011584 69110 33554432000 4194304 4933779 140724857751632 140724857749336 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 74954 69110 604 181 0 68571 0
Current children cumulated CPU time: 1902.08 s
Current children cumulated vsize: 299816 KiB
Current children cumulated memory: 276440 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22723
/proc/meminfo: memFree=21605084/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=302048 memory=278648 CPUtime=1962.08 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 377969 0 0 0 196169 39 0 0 20 0 1 0 96495119 309297152 69662 33554432000 4194304 4933779 140724857751632 140724857749384 140305101082055 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 75512 69662 604 181 0 69129 0
Current children cumulated CPU time: 1962.08 s
Current children cumulated vsize: 302048 KiB
Current children cumulated memory: 278648 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22724
/proc/meminfo: memFree=21601496/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=303120 memory=279792 CPUtime=2022.07 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 380810 0 0 0 202168 39 0 0 20 0 1 0 96495119 310394880 69948 33554432000 4194304 4933779 140724857751632 140724857749336 4377619 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 75780 69948 604 181 0 69397 0
Current children cumulated CPU time: 2022.07 s
Current children cumulated vsize: 303120 KiB
Current children cumulated memory: 279792 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22725
/proc/meminfo: memFree=21592692/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=304776 memory=281440 CPUtime=2082.07 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 384011 0 0 0 208167 40 0 0 20 0 1 0 96495119 312090624 70360 33554432000 4194304 4933779 140724857751632 140724857749320 140305100208234 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 76194 70360 604 181 0 69811 0
Current children cumulated CPU time: 2082.07 s
Current children cumulated vsize: 304776 KiB
Current children cumulated memory: 281440 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22726
/proc/meminfo: memFree=21588104/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=308332 memory=284976 CPUtime=2142.07 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 388113 0 0 0 214166 41 0 0 20 0 1 0 96495119 315731968 71244 33554432000 4194304 4933779 140724857751632 140724857749320 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 77083 71244 604 181 0 70700 0
Current children cumulated CPU time: 2142.07 s
Current children cumulated vsize: 308332 KiB
Current children cumulated memory: 284976 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22728
/proc/meminfo: memFree=21581300/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=309136 memory=285748 CPUtime=2202.06 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 390159 0 0 0 220165 41 0 0 20 0 1 0 96495119 316555264 71437 33554432000 4194304 4933779 140724857751632 140724857749336 4377619 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 77284 71437 604 181 0 70901 0
Current children cumulated CPU time: 2202.06 s
Current children cumulated vsize: 309136 KiB
Current children cumulated memory: 285748 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22729
/proc/meminfo: memFree=21578696/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=310488 memory=287120 CPUtime=2262.06 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 391271 0 0 0 226165 41 0 0 20 0 1 0 96495119 317939712 71780 33554432000 4194304 4933779 140724857751632 140724857749336 4377480 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 77622 71780 604 181 0 71239 0
Current children cumulated CPU time: 2262.06 s
Current children cumulated vsize: 310488 KiB
Current children cumulated memory: 287120 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22730
/proc/meminfo: memFree=21573356/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=312972 memory=289412 CPUtime=2322.05 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 392902 0 0 0 232164 41 0 0 20 0 1 0 96495119 320483328 72353 33554432000 4194304 4933779 140724857751632 140724857749336 140305101081649 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 78243 72353 604 181 0 71860 0
Current children cumulated CPU time: 2322.05 s
Current children cumulated vsize: 312972 KiB
Current children cumulated memory: 289412 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22732
/proc/meminfo: memFree=21568032/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=314176 memory=290808 CPUtime=2382.04 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 394904 0 0 0 238163 41 0 0 20 0 1 0 96495119 321716224 72702 33554432000 4194304 4933779 140724857751632 140724857749336 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 78544 72702 604 181 0 72161 0
Current children cumulated CPU time: 2382.04 s
Current children cumulated vsize: 314176 KiB
Current children cumulated memory: 290808 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22733
/proc/meminfo: memFree=21560076/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=316596 memory=293248 CPUtime=2442.04 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 397340 0 0 0 244162 42 0 0 20 0 1 0 96495119 324194304 73312 33554432000 4194304 4933779 140724857751632 140724857749336 140305101082055 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 79149 73312 604 181 0 72766 0
Current children cumulated CPU time: 2442.04 s
Current children cumulated vsize: 316596 KiB
Current children cumulated memory: 293248 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22741
/proc/meminfo: memFree=21548252/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=319128 memory=295676 CPUtime=2502.04 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 399801 0 0 0 250161 43 0 0 20 0 1 0 96495119 326787072 73919 33554432000 4194304 4933779 140724857751632 140724857749336 140305101082055 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 79782 73919 604 181 0 73399 0
Current children cumulated CPU time: 2502.04 s
Current children cumulated vsize: 319128 KiB
Current children cumulated memory: 295676 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 22741
/proc/meminfo: memFree=21547136/32770624 swapFree=67108796/67108860
[pid=22388] ppid=22385 vsize=319532 memory=296192 CPUtime=2519.75 cores=0,2,4,6
/proc/22388/stat : 22388 (nacre_mini_rele) R 22385 22388 24279 0 -1 4202496 401618 0 0 0 251932 43 0 0 20 0 1 0 96495119 327200768 74048 33554432000 4194304 4933779 140724857751632 140724857749336 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 35155968 140724857754776 140724857754876 140724857754876 140724857757634 0
/proc/22388/statm: 79883 74048 604 181 0 73500 0
Current children cumulated CPU time: 2519.75 s
Current children cumulated vsize: 319532 KiB
Current children cumulated memory: 296192 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 22388 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.32 s, system=0.435964 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.76
CPU user time (s): 2519.32
CPU system time (s): 0.435964
CPU usage (%): 99.9899
Max. virtual memory (cumulated for all children) (KiB): 319532
Max. memory (cumulated for all children) (KiB): 296192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.32
system time used= 0.435964
maximum resident set size= 296284
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 401661
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 52
involuntary context switches= 3547


# summary of solver processes directly reported to runsolver:
#   pid: 22388
#   total CPU time (s): 2519.76
#   total CPU user time (s): 2519.32
#   total CPU system time (s): 0.435964

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.5758 second user time and 16.6815 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-28 16:48:40
IDJOB=4299810
IDBENCH=141447
IDSOLVER=2764
FILE ID=node138/4299810-1532789319
RUNJOBID= node138-1532773607-19387
PBS_JOBID= 21022455
Free space on /tmp= 53796 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-15-16_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299810-1532789319/watcher-4299810-1532789319 -o /tmp/evaluation-result-4299810-1532789319/solver-4299810-1532789319 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580  nacre_mini_release HOME/instance-4299810-1532789319.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 57cb1bb20db45191d6ed694399d37744
RANDOM SEED=238586677

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        21937112 kB
MemAvailable:   31602232 kB
Buffers:          211116 kB
Cached:          9657436 kB
SwapCached:           44 kB
Active:          2873916 kB
Inactive:        7376628 kB
Active(anon):     325732 kB
Inactive(anon):    83488 kB
Active(file):    2548184 kB
Inactive(file):  7293140 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:              3032 kB
Writeback:             0 kB
AnonPages:        388248 kB
Mapped:            38272 kB
Shmem:             25164 kB
Slab:             280216 kB
SReclaimable:     252256 kB
SUnreclaim:        27960 kB
KernelStack:        3360 kB
PageTables:         6152 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     673536 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    317440 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53800 MiB
End job on node138 at 2018-07-28 17:30:40