Trace number 4300510

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.63 2520.03

General information on the benchmark

NameEternity/
Eternity-15-15_c18.xml
MD5SUM07f6a500cdb84e44b97e5b2e1697edff
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables705
Number of constraints286
Number of domains2
Minimum domain size22
Maximum domain size225
Distribution of domain sizes[{"size":22,"count":480},{"size":225,"count":225}]
Minimum variable degree1
Maximum variable degree16
Distribution of variable degrees[{"degree":1,"count":14},{"degree":2,"count":690},{"degree":16,"count":1}]
Minimum constraint arity1
Maximum constraint arity225
Distribution of constraint arities[{"arity":1,"count":60},{"arity":5,"count":225},{"arity":225,"count":1}]
Number of extensional constraints225
Number of intensional constraints60
Distribution of constraint types[{"type":"extension","count":225},{"type":"intension","count":60},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.21/0.29	c NACRE 1.0.4
2519.61/2520.01	c
2519.61/2520.01	c # time = 2519.61
2519.61/2520.01	c # Dec = 646895
2519.61/2520.01	c # Propagate Calls = 10653110056
2519.61/2520.01	c # assignAt Calls = 1265798
2519.61/2520.01	c # removeAt Calls = 668230829
2519.61/2520.01	c # Run = 1098
2519.61/2520.01	c # Conflicts = 533658
2519.61/2520.01	c # Memory used = 2210.6 Mb
2519.61/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9590 MiB free)
  memory of node 1: 16384 MiB (10032 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4300510-1532800405/watcher-4300510-1532800405 -o /tmp/evaluation-result-4300510-1532800405/solver-4300510-1532800405 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580 nacre_mini_release HOME/instance-4300510-1532800405.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=30367, runsolver pid=30364

[startup+0.100204 s]*
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20079228/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=41536 memory=17676 CPUtime=0.1 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 5325 0 0 0 9 1 0 0 20 0 1 0 97603651 42532864 4419 33554432000 4194304 4933779 140723766880272 140723766877272 139847741414400 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 10384 4419 570 181 0 4001 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 41536 KiB
Current children cumulated memory: 17676 KiB

[startup+0.209661 s]*
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20073508/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=46832 memory=22956 CPUtime=0.21 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 6636 0 0 0 20 1 0 0 20 0 1 0 97603651 47955968 5739 33554432000 4194304 4933779 140723766880272 140723766877848 139847741414400 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 11708 5739 570 181 0 5325 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 46832 KiB
Current children cumulated memory: 22956 KiB

[startup+0.309746 s]*
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20065768/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=54156 memory=30544 CPUtime=0.3 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 7988 0 0 0 29 1 0 0 20 0 1 0 97603651 55455744 7636 33554432000 4194304 4933779 140723766880272 140723766877848 139847740975190 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 13539 7636 596 181 0 7156 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 54156 KiB
Current children cumulated memory: 30544 KiB

[startup+0.700445 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20065768/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=55296 memory=31600 CPUtime=0.69 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 8274 0 0 0 67 2 0 0 20 0 1 0 97603651 56623104 7900 33554432000 4194304 4933779 140723766880272 140723766877848 4475748 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 13824 7900 613 181 0 7441 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 55296 KiB
Current children cumulated memory: 31600 KiB

[startup+1.50045 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20063288/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=56572 memory=32920 CPUtime=1.49 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 8591 0 0 0 147 2 0 0 20 0 1 0 97603651 57929728 8230 33554432000 4194304 4933779 140723766880272 140723766878040 4377584 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 14143 8230 613 181 0 7760 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 56572 KiB
Current children cumulated memory: 32920 KiB

[startup+3.10969 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20059816/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=60304 memory=36784 CPUtime=3.1 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 15242 0 0 0 308 2 0 0 20 0 1 0 97603651 61751296 9196 33554432000 4194304 4933779 140723766880272 140723766878024 139847740985317 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 15076 9196 613 181 0 8693 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 60304 KiB
Current children cumulated memory: 36784 KiB

[startup+6.30043 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20047216/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=72136 memory=48380 CPUtime=6.29 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 24460 0 0 0 626 3 0 0 20 0 1 0 97603651 73867264 12095 33554432000 4194304 4933779 140723766880272 140723766878040 4388544 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 18034 12095 613 181 0 11651 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 72136 KiB
Current children cumulated memory: 48380 KiB

[startup+12.7004 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 30368
/proc/meminfo: memFree=20025964/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=95200 memory=71548 CPUtime=12.69 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 37567 0 0 0 1264 5 0 0 20 0 1 0 97603651 97484800 17887 33554432000 4194304 4933779 140723766880272 140723766878040 4388432 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 23800 17887 613 181 0 17417 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 95200 KiB
Current children cumulated memory: 71548 KiB

[startup+25.5004 s]
/proc/loadavg: 1.98 2.00 2.04 3/187 30368
/proc/meminfo: memFree=19982564/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=134808 memory=111144 CPUtime=25.49 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 68038 0 0 0 2541 8 0 0 20 0 1 0 97603651 138043392 27786 33554432000 4194304 4933779 140723766880272 140723766878024 4377487 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 33702 27786 613 181 0 27319 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 134808 KiB
Current children cumulated memory: 111144 KiB

[startup+51.1098 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 30368
/proc/meminfo: memFree=19891600/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=222224 memory=198508 CPUtime=51.1 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 106871 0 0 0 5098 12 0 0 20 0 1 0 97603651 227557376 49627 33554432000 4194304 4933779 140723766880272 140723766878024 4388436 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 55556 49627 613 181 0 49173 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 222224 KiB
Current children cumulated memory: 198508 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 30370
/proc/meminfo: memFree=19816896/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=291440 memory=268016 CPUtime=102.28 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 155196 0 0 0 10210 18 0 0 20 0 1 0 97603651 298434560 67004 33554432000 4194304 4933779 140723766880272 140723766878040 139847741841755 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 72860 67004 613 181 0 66477 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 291440 KiB
Current children cumulated memory: 268016 KiB

[startup+162.3 s]
/proc/loadavg: 2.28 2.06 2.06 3/187 30371
/proc/meminfo: memFree=19724516/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=379316 memory=355308 CPUtime=162.25 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 203948 0 0 0 16202 23 0 0 20 0 1 0 97603651 388419584 88827 33554432000 4194304 4933779 140723766880272 140723766877976 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 94829 88827 613 181 0 88446 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 379316 KiB
Current children cumulated memory: 355308 KiB

[startup+222.3 s]
/proc/loadavg: 2.34 2.14 2.09 3/187 30372
/proc/meminfo: memFree=19584920/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=512584 memory=488704 CPUtime=222.22 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 254558 0 0 0 22191 31 0 0 20 0 1 0 97603651 524886016 122176 33554432000 4194304 4933779 140723766880272 140723766878024 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 128146 122176 613 181 0 121763 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 512584 KiB
Current children cumulated memory: 488704 KiB

[startup+282.3 s]
/proc/loadavg: 2.12 2.11 2.08 3/187 30374
/proc/meminfo: memFree=19467560/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=624980 memory=601476 CPUtime=282.2 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 307919 0 0 0 28183 37 0 0 20 0 1 0 97603651 639979520 150369 33554432000 4194304 4933779 140723766880272 140723766877976 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 156245 150369 613 181 0 149862 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 624980 KiB
Current children cumulated memory: 601476 KiB

[startup+342.3 s]
/proc/loadavg: 2.05 2.09 2.08 3/187 30375
/proc/meminfo: memFree=19381276/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=707012 memory=683596 CPUtime=342.18 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 347049 0 0 0 34177 41 0 0 20 0 1 0 97603651 723980288 170899 33554432000 4194304 4933779 140723766880272 140723766878024 4376857 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 176753 170899 613 181 0 170370 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 707012 KiB
Current children cumulated memory: 683596 KiB

[startup+402.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/187 30383
/proc/meminfo: memFree=19247864/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=834788 memory=811228 CPUtime=402.16 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 404784 0 0 0 40166 50 0 0 20 0 1 0 97603651 854822912 202807 33554432000 4194304 4933779 140723766880272 140723766878040 4437764 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 208697 202807 613 181 0 202314 0
Current children cumulated CPU time: 402.16 s
Current children cumulated vsize: 834788 KiB
Current children cumulated memory: 811228 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/188 30407
/proc/meminfo: memFree=19144184/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=933080 memory=909684 CPUtime=462.13 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 456450 0 0 0 46158 55 0 0 20 0 1 0 97603651 955473920 227421 33554432000 4194304 4933779 140723766880272 140723766877976 4377382 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 233270 227421 613 181 0 226887 0
Current children cumulated CPU time: 462.13 s
Current children cumulated vsize: 933080 KiB
Current children cumulated memory: 909684 KiB


################
# More data... #
################

/proc/30367/statm: 459212 453244 613 181 0 452829 0
Current children cumulated CPU time: 1722.03 s
Current children cumulated vsize: 1836848 KiB
Current children cumulated memory: 1812976 KiB

[startup+1782.3 s]
/proc/loadavg: 2.40 2.11 2.08 3/188 30467
/proc/meminfo: memFree=18150456/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=1862336 memory=1838532 CPUtime=1782.01 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1154729 0 0 0 178066 135 0 0 20 0 1 0 97603651 1907032064 459633 33554432000 4194304 4933779 140723766880272 140723766878024 4475916 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 465584 459633 613 181 0 459201 0
Current children cumulated CPU time: 1782.01 s
Current children cumulated vsize: 1862336 KiB
Current children cumulated memory: 1838532 KiB

[startup+1842.3 s]
/proc/loadavg: 2.37 2.17 2.10 3/188 30468
/proc/meminfo: memFree=18123960/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=1884612 memory=1860864 CPUtime=1841.99 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1187796 0 0 0 184060 139 0 0 20 0 1 0 97603651 1929842688 465216 33554432000 4194304 4933779 140723766880272 140723766878024 139847741841750 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 471153 465216 613 181 0 464770 0
Current children cumulated CPU time: 1841.99 s
Current children cumulated vsize: 1884612 KiB
Current children cumulated memory: 1860864 KiB

[startup+1902.3 s]
/proc/loadavg: 2.14 2.14 2.10 3/187 30470
/proc/meminfo: memFree=18083404/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=1923720 memory=1899900 CPUtime=1901.98 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1229650 0 0 0 190054 144 0 0 20 0 1 0 97603651 1969889280 474975 33554432000 4194304 4933779 140723766880272 140723766877976 4377638 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 480930 474975 613 181 0 474547 0
Current children cumulated CPU time: 1901.98 s
Current children cumulated vsize: 1923720 KiB
Current children cumulated memory: 1899900 KiB

[startup+1962.3 s]
/proc/loadavg: 2.05 2.12 2.09 3/187 30471
/proc/meminfo: memFree=18063928/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=1941956 memory=1918144 CPUtime=1961.97 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1257479 0 0 0 196049 148 0 0 20 0 1 0 97603651 1988562944 479536 33554432000 4194304 4933779 140723766880272 140723766878040 4377638 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 485489 479536 613 181 0 479106 0
Current children cumulated CPU time: 1961.97 s
Current children cumulated vsize: 1941956 KiB
Current children cumulated memory: 1918144 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.10 2.08 3/187 30472
/proc/meminfo: memFree=18035300/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=1968952 memory=1945144 CPUtime=2021.96 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1288739 0 0 0 202044 152 0 0 20 0 1 0 97603651 2016206848 486286 33554432000 4194304 4933779 140723766880272 140723766877976 4475930 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 492238 486286 613 181 0 485855 0
Current children cumulated CPU time: 2021.96 s
Current children cumulated vsize: 1968952 KiB
Current children cumulated memory: 1945144 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.08 2.08 3/187 30474
/proc/meminfo: memFree=18000952/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2001232 memory=1977436 CPUtime=2081.94 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1314035 0 0 0 208039 155 0 0 20 0 1 0 97603651 2049261568 494359 33554432000 4194304 4933779 140723766880272 140723766877976 4377445 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 500308 494359 613 181 0 493925 0
Current children cumulated CPU time: 2081.94 s
Current children cumulated vsize: 2001232 KiB
Current children cumulated memory: 1977436 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/187 30475
/proc/meminfo: memFree=17956024/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2045524 memory=2021752 CPUtime=2141.93 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1340226 0 0 0 214034 159 0 0 20 0 1 0 97603651 2094616576 505438 33554432000 4194304 4933779 140723766880272 140723766877960 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 511381 505438 613 181 0 504998 0
Current children cumulated CPU time: 2141.93 s
Current children cumulated vsize: 2045524 KiB
Current children cumulated memory: 2021752 KiB

[startup+2202.3 s]
/proc/loadavg: 1.96 2.04 2.06 3/187 30607
/proc/meminfo: memFree=17970612/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2080108 memory=2056176 CPUtime=2201.92 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1360958 0 0 0 220030 162 0 0 20 0 1 0 97603651 2130030592 514044 33554432000 4194304 4933779 140723766880272 140723766877976 4388626 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 520027 514044 613 181 0 513644 0
Current children cumulated CPU time: 2201.92 s
Current children cumulated vsize: 2080108 KiB
Current children cumulated memory: 2056176 KiB

[startup+2262.3 s]
/proc/loadavg: 1.99 2.03 2.06 3/187 30608
/proc/meminfo: memFree=17789256/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2127148 memory=2103148 CPUtime=2261.92 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1377792 0 0 0 226027 165 0 0 20 0 1 0 97603651 2178199552 525787 33554432000 4194304 4933779 140723766880272 140723766877976 139847747177230 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 531787 525787 613 181 0 525404 0
Current children cumulated CPU time: 2261.92 s
Current children cumulated vsize: 2127148 KiB
Current children cumulated memory: 2103148 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 30609
/proc/meminfo: memFree=17620216/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2171604 memory=2147720 CPUtime=2321.9 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1391098 0 0 0 232024 166 0 0 20 0 1 0 97603651 2223722496 536930 33554432000 4194304 4933779 140723766880272 140723766877976 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 542901 536930 613 181 0 536518 0
Current children cumulated CPU time: 2321.9 s
Current children cumulated vsize: 2171604 KiB
Current children cumulated memory: 2147720 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 30610
/proc/meminfo: memFree=17498476/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2204184 memory=2180392 CPUtime=2381.9 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1403518 0 0 0 238022 168 0 0 20 0 1 0 97603651 2257084416 545098 33554432000 4194304 4933779 140723766880272 140723766878024 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 551046 545098 613 181 0 544663 0
Current children cumulated CPU time: 2381.9 s
Current children cumulated vsize: 2204184 KiB
Current children cumulated memory: 2180392 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 30611
/proc/meminfo: memFree=17416044/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2219924 memory=2196264 CPUtime=2441.9 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1414165 0 0 0 244019 171 0 0 20 0 1 0 97603651 2273202176 549066 33554432000 4194304 4933779 140723766880272 140723766877976 4388436 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 554981 549066 613 181 0 548598 0
Current children cumulated CPU time: 2441.9 s
Current children cumulated vsize: 2219924 KiB
Current children cumulated memory: 2196264 KiB

[startup+2502.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 30612
/proc/meminfo: memFree=17346880/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2230492 memory=2206788 CPUtime=2501.9 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1423678 0 0 0 250018 172 0 0 20 0 1 0 97603651 2284023808 551697 33554432000 4194304 4933779 140723766880272 140723766877976 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 557623 551697 613 181 0 551240 0
Current children cumulated CPU time: 2501.9 s
Current children cumulated vsize: 2230492 KiB
Current children cumulated memory: 2206788 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.05 2.03 2.05 3/187 30613
/proc/meminfo: memFree=17327608/32770624 swapFree=67108860/67108860
[pid=30367] ppid=30364 vsize=2234184 memory=2210552 CPUtime=2519.61 cores=0,2,4,6
/proc/30367/stat : 30367 (nacre_mini_rele) R 30364 30367 26996 0 -1 4202496 1425620 0 0 0 251788 173 0 0 20 0 1 0 97603651 2287804416 552638 33554432000 4194304 4933779 140723766880272 140723766878024 139847741841755 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39878656 140723766887576 140723766887676 140723766887676 140723766890434 0
/proc/30367/statm: 558546 552638 613 181 0 552163 0
Current children cumulated CPU time: 2519.61 s
Current children cumulated vsize: 2234184 KiB
Current children cumulated memory: 2210552 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 30367 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.89 s, system=1.74594 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.03
CPU time (s): 2519.63
CPU user time (s): 2517.89
CPU system time (s): 1.74594
CPU usage (%): 99.9845
Max. virtual memory (cumulated for all children) (KiB): 2234184
Max. memory (cumulated for all children) (KiB): 2210552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.89
system time used= 1.74594
maximum resident set size= 2210608
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1425668
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 543
involuntary context switches= 3151


# summary of solver processes directly reported to runsolver:
#   pid: 30367
#   total CPU time (s): 2519.63
#   total CPU user time (s): 2517.89
#   total CPU system time (s): 1.74594

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0855 second user time and 18.7325 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 19:53:25
IDJOB=4300510
IDBENCH=141653
IDSOLVER=2764
FILE ID=node103/4300510-1532800405
RUNJOBID= node103-1532775163-27027
PBS_JOBID= 21022463
Free space on /tmp= 56532 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Eternity/Eternity-15-15_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4300510-1532800405/watcher-4300510-1532800405 -o /tmp/evaluation-result-4300510-1532800405/solver-4300510-1532800405 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580  nacre_mini_release HOME/instance-4300510-1532800405.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 07f6a500cdb84e44b97e5b2e1697edff
RANDOM SEED=675127523

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20093424 kB
MemAvailable:   31801172 kB
Buffers:          303232 kB
Cached:         11588088 kB
SwapCached:            0 kB
Active:          4048756 kB
Inactive:        8025312 kB
Active(anon):     185300 kB
Inactive(anon):    25184 kB
Active(file):    3863456 kB
Inactive(file):  8000128 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3696 kB
Writeback:             0 kB
AnonPages:        265836 kB
Mapped:            45296 kB
Shmem:             25228 kB
Slab:             300232 kB
SReclaimable:     272624 kB
SUnreclaim:        27608 kB
KernelStack:        3360 kB
PageTables:         5724 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     480888 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    169984 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56532 MiB
End job on node103 at 2018-07-28 20:35:25