Trace number 4300550

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.4 2520.03

General information on the benchmark

NameEternity/
Eternity-10-10_c18.xml
MD5SUMa3eb34d1d913b6993c7392d3f708e375
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables320
Number of constraints141
Number of domains2
Minimum domain size15
Maximum domain size100
Distribution of domain sizes[{"size":15,"count":220},{"size":100,"count":100}]
Minimum variable degree1
Maximum variable degree11
Distribution of variable degrees[{"degree":1,"count":9},{"degree":2,"count":310},{"degree":11,"count":1}]
Minimum constraint arity1
Maximum constraint arity100
Distribution of constraint arities[{"arity":1,"count":40},{"arity":5,"count":100},{"arity":100,"count":1}]
Number of extensional constraints100
Number of intensional constraints40
Distribution of constraint types[{"type":"extension","count":100},{"type":"intension","count":40},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.06	c NACRE 1.0.4
2519.37/2520.01	c
2519.37/2520.01	c # time = 2519.37
2519.37/2520.01	c # Dec = 1863537
2519.37/2520.01	c # Propagate Calls = 7024575727
2519.37/2520.01	c # assignAt Calls = 3775360
2519.37/2520.01	c # removeAt Calls = 776336206
2519.37/2520.01	c # Run = 3278
2519.37/2520.01	c # Conflicts = 1708306
2519.37/2520.01	c # Memory used = 1182.67 Mb
2519.37/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9086 MiB free)
  memory of node 1: 16384 MiB (12434 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4300550-1532801923/watcher-4300550-1532801923 -o /tmp/evaluation-result-4300550-1532801923/solver-4300550-1532801923 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580 nacre_mini_release HOME/instance-4300550-1532801923.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=23841, runsolver pid=23838

[startup+0.100202 s]*
/proc/loadavg: 2.57 2.17 2.09 3/187 23842
/proc/meminfo: memFree=22030776/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=32288 memory=8840 CPUtime=0.1 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 2503 0 0 0 10 0 0 0 20 0 1 0 97755455 33062912 2210 33554432000 4194304 4933779 140720604177120 140720604174120 139689063525349 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 8072 2210 598 181 0 1689 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32288 KiB
Current children cumulated memory: 8840 KiB

[startup+0.209578 s]*
/proc/loadavg: 2.57 2.17 2.09 3/187 23842
/proc/meminfo: memFree=22029660/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=33380 memory=9896 CPUtime=0.21 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 2778 0 0 0 21 0 0 0 20 0 1 0 97755455 34181120 2474 33554432000 4194304 4933779 140720604177120 140720604174120 139689063534513 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 8345 2474 613 181 0 1962 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 33380 KiB
Current children cumulated memory: 9896 KiB

[startup+0.309482 s]*
/proc/loadavg: 2.57 2.17 2.09 3/187 23842
/proc/meminfo: memFree=22028916/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=34328 memory=10688 CPUtime=0.31 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 2989 0 0 0 31 0 0 0 20 0 1 0 97755455 35151872 2672 33554432000 4194304 4933779 140720604177120 140720604174120 139689069724560 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 8582 2672 613 181 0 2199 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 34328 KiB
Current children cumulated memory: 10688 KiB

[startup+0.700384 s]
/proc/loadavg: 2.57 2.17 2.09 3/187 23842
/proc/meminfo: memFree=22026808/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=38268 memory=14648 CPUtime=0.69 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 3975 0 0 0 69 0 0 0 20 0 1 0 97755455 39186432 3662 33554432000 4194304 4933779 140720604177120 140720604174120 4377360 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 9567 3662 613 181 0 3184 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38268 KiB
Current children cumulated memory: 14648 KiB

[startup+1.50038 s]
/proc/loadavg: 2.68 2.20 2.10 3/187 23842
/proc/meminfo: memFree=22022172/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=45436 memory=21776 CPUtime=1.49 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 5761 0 0 0 149 0 0 0 20 0 1 0 97755455 46526464 5444 33554432000 4194304 4933779 140720604177120 140720604174888 4377445 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 11359 5444 613 181 0 4976 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 45436 KiB
Current children cumulated memory: 21776 KiB

[startup+3.10946 s]
/proc/loadavg: 2.68 2.20 2.10 3/187 23842
/proc/meminfo: memFree=22004492/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=59460 memory=35680 CPUtime=3.09 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 13621 0 0 0 308 1 0 0 20 0 1 0 97755455 60887040 8920 33554432000 4194304 4933779 140720604177120 140720604174872 4434641 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 14865 8920 613 181 0 8482 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 59460 KiB
Current children cumulated memory: 35680 KiB

[startup+6.3004 s]
/proc/loadavg: 2.63 2.19 2.10 3/187 23842
/proc/meminfo: memFree=21980884/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=84528 memory=60688 CPUtime=6.29 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 26997 0 0 0 626 3 0 0 20 0 1 0 97755455 86556672 15172 33554432000 4194304 4933779 140720604177120 140720604174888 4437558 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 21132 15172 613 181 0 14749 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 84528 KiB
Current children cumulated memory: 60688 KiB

[startup+12.7004 s]
/proc/loadavg: 2.58 2.19 2.10 3/187 23842
/proc/meminfo: memFree=21946876/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=118984 memory=95416 CPUtime=12.69 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 49237 0 0 0 1264 5 0 0 20 0 1 0 97755455 121839616 23854 33554432000 4194304 4933779 140720604177120 140720604174872 139689069724560 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 29746 23854 613 181 0 23363 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 118984 KiB
Current children cumulated memory: 95416 KiB

[startup+25.5004 s]
/proc/loadavg: 2.49 2.18 2.10 3/187 23842
/proc/meminfo: memFree=21900484/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=163628 memory=139684 CPUtime=25.48 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 98284 0 0 0 2538 10 0 0 20 0 1 0 97755455 167555072 34921 33554432000 4194304 4933779 140720604177120 140720604174824 4363672 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 40907 34921 613 181 0 34524 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 163628 KiB
Current children cumulated memory: 139684 KiB

[startup+51.1096 s]
/proc/loadavg: 2.30 2.17 2.10 3/187 23842
/proc/meminfo: memFree=21832484/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=228020 memory=204264 CPUtime=51.07 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 142480 0 0 0 5092 15 0 0 20 0 1 0 97755455 233492480 51066 33554432000 4194304 4933779 140720604177120 140720604174824 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 57005 51066 613 181 0 50622 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 228020 KiB
Current children cumulated memory: 204264 KiB

[startup+102.3 s]
/proc/loadavg: 2.13 2.14 2.10 3/187 23850
/proc/meminfo: memFree=21759300/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=298756 memory=275260 CPUtime=102.21 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 186111 0 0 0 10201 20 0 0 20 0 1 0 97755455 305926144 68815 33554432000 4194304 4933779 140720604177120 140720604174872 4335587 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 74689 68815 613 181 0 68306 0
Current children cumulated CPU time: 102.21 s
Current children cumulated vsize: 298756 KiB
Current children cumulated memory: 275260 KiB

[startup+162.3 s]
/proc/loadavg: 2.05 2.12 2.09 3/187 23851
/proc/meminfo: memFree=21688980/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=368184 memory=343432 CPUtime=162.17 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 218217 0 0 0 16190 27 0 0 20 0 1 0 97755455 377020416 85858 33554432000 4194304 4933779 140720604177120 140720604174872 4377480 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 92046 85858 613 181 0 85663 0
Current children cumulated CPU time: 162.17 s
Current children cumulated vsize: 368184 KiB
Current children cumulated memory: 343432 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/187 23852
/proc/meminfo: memFree=21630056/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=424028 memory=399448 CPUtime=222.11 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 246936 0 0 0 22179 32 0 0 20 0 1 0 97755455 434204672 99862 33554432000 4194304 4933779 140720604177120 140720604174872 4377483 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 106007 99862 613 181 0 99624 0
Current children cumulated CPU time: 222.11 s
Current children cumulated vsize: 424028 KiB
Current children cumulated memory: 399448 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.08 2.08 3/187 23853
/proc/meminfo: memFree=21585764/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=466140 memory=441840 CPUtime=282.07 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 261228 0 0 0 28171 36 0 0 20 0 1 0 97755455 477327360 110460 33554432000 4194304 4933779 140720604177120 140720604174824 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 116535 110460 613 181 0 110152 0
Current children cumulated CPU time: 282.07 s
Current children cumulated vsize: 466140 KiB
Current children cumulated memory: 441840 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/187 23854
/proc/meminfo: memFree=21539976/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=510088 memory=485892 CPUtime=342.07 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 277809 0 0 0 34169 38 0 0 20 0 1 0 97755455 522330112 121473 33554432000 4194304 4933779 140720604177120 140720604174824 139689064380795 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 127522 121473 613 181 0 121139 0
Current children cumulated CPU time: 342.07 s
Current children cumulated vsize: 510088 KiB
Current children cumulated memory: 485892 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.05 2.07 3/187 23856
/proc/meminfo: memFree=21488156/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=560324 memory=536344 CPUtime=402.06 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 302646 0 0 0 40164 42 0 0 20 0 1 0 97755455 573771776 134086 33554432000 4194304 4933779 140720604177120 140720604174824 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 140081 134086 613 181 0 133698 0
Current children cumulated CPU time: 402.06 s
Current children cumulated vsize: 560324 KiB
Current children cumulated memory: 536344 KiB

[startup+462.3 s]
/proc/loadavg: 2.41 2.18 2.11 3/187 23857
/proc/meminfo: memFree=21451080/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=596064 memory=572060 CPUtime=462.06 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 326915 0 0 0 46159 47 0 0 20 0 1 0 97755455 610369536 143015 33554432000 4194304 4933779 140720604177120 140720604174824 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 149016 143015 613 181 0 142633 0
Current children cumulated CPU time: 462.06 s
Current children cumulated vsize: 596064 KiB
Current children cumulated memory: 572060 KiB


################
# More data... #
################

/proc/23841/statm: 258640 252428 613 181 0 252257 0
Current children cumulated CPU time: 1721.8 s
Current children cumulated vsize: 1034560 KiB
Current children cumulated memory: 1009712 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 23957
/proc/meminfo: memFree=20790896/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1047292 memory=1022388 CPUtime=1781.76 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 913091 0 0 0 178051 125 0 0 20 0 1 0 97755455 1072427008 255597 33554432000 4194304 4933779 140720604177120 140720604174872 4388388 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 261823 255597 613 181 0 255440 0
Current children cumulated CPU time: 1781.76 s
Current children cumulated vsize: 1047292 KiB
Current children cumulated memory: 1022388 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 23958
/proc/meminfo: memFree=20773688/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1057012 memory=1032588 CPUtime=1841.72 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 922632 0 0 0 184045 127 0 0 20 0 1 0 97755455 1082380288 258147 33554432000 4194304 4933779 140720604177120 140720604174872 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 264253 258147 613 181 0 257870 0
Current children cumulated CPU time: 1841.72 s
Current children cumulated vsize: 1057012 KiB
Current children cumulated memory: 1032588 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23966
/proc/meminfo: memFree=20759636/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1062820 memory=1038400 CPUtime=1901.71 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 925863 0 0 0 190043 128 0 0 20 0 1 0 97755455 1088327680 259600 33554432000 4194304 4933779 140720604177120 140720604174872 4377379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 265705 259600 613 181 0 259322 0
Current children cumulated CPU time: 1901.71 s
Current children cumulated vsize: 1062820 KiB
Current children cumulated memory: 1038400 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23967
/proc/meminfo: memFree=20745252/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1071152 memory=1046632 CPUtime=1961.7 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 930725 0 0 0 196042 128 0 0 20 0 1 0 97755455 1096859648 261658 33554432000 4194304 4933779 140720604177120 140720604174872 139689064391012 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 267788 261658 613 181 0 261405 0
Current children cumulated CPU time: 1961.7 s
Current children cumulated vsize: 1071152 KiB
Current children cumulated memory: 1046632 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23968
/proc/meminfo: memFree=20728636/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1082156 memory=1057736 CPUtime=2021.7 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 937871 0 0 0 202041 129 0 0 20 0 1 0 97755455 1108127744 264434 33554432000 4194304 4933779 140720604177120 140720604174808 139689063534532 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 270539 264434 613 181 0 264156 0
Current children cumulated CPU time: 2021.7 s
Current children cumulated vsize: 1082156 KiB
Current children cumulated memory: 1057736 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23969
/proc/meminfo: memFree=20706672/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1097040 memory=1072640 CPUtime=2081.69 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 945168 0 0 0 208039 130 0 0 20 0 1 0 97755455 1123368960 268160 33554432000 4194304 4933779 140720604177120 140720604174824 4379049 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 274260 268160 613 181 0 267877 0
Current children cumulated CPU time: 2081.69 s
Current children cumulated vsize: 1097040 KiB
Current children cumulated memory: 1072640 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23970
/proc/meminfo: memFree=20686520/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1107800 memory=1083324 CPUtime=2141.7 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 955670 0 0 0 214037 133 0 0 20 0 1 0 97755455 1134387200 270831 33554432000 4194304 4933779 140720604177120 140720604174872 4472608 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 276950 270831 613 181 0 270567 0
Current children cumulated CPU time: 2141.7 s
Current children cumulated vsize: 1107800 KiB
Current children cumulated memory: 1083324 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23972
/proc/meminfo: memFree=20658456/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1127068 memory=1102612 CPUtime=2201.69 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 970965 0 0 0 220034 135 0 0 20 0 1 0 97755455 1154117632 275653 33554432000 4194304 4933779 140720604177120 140720604174872 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 281767 275653 613 181 0 275384 0
Current children cumulated CPU time: 2201.69 s
Current children cumulated vsize: 1127068 KiB
Current children cumulated memory: 1102612 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23973
/proc/meminfo: memFree=20630556/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1145504 memory=1121020 CPUtime=2261.69 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 988062 0 0 0 226031 138 0 0 20 0 1 0 97755455 1172996096 280255 33554432000 4194304 4933779 140720604177120 140720604174872 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 286376 280255 613 181 0 279993 0
Current children cumulated CPU time: 2261.69 s
Current children cumulated vsize: 1145504 KiB
Current children cumulated memory: 1121020 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23974
/proc/meminfo: memFree=20609352/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1156896 memory=1132420 CPUtime=2321.68 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 1006539 0 0 0 232028 140 0 0 20 0 1 0 97755455 1184661504 283105 33554432000 4194304 4933779 140720604177120 140720604174824 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 289224 283105 613 181 0 282841 0
Current children cumulated CPU time: 2321.68 s
Current children cumulated vsize: 1156896 KiB
Current children cumulated memory: 1132420 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23976
/proc/meminfo: memFree=20569812/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1186516 memory=1162164 CPUtime=2381.68 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 1030906 0 0 0 238024 144 0 0 20 0 1 0 97755455 1214992384 290541 33554432000 4194304 4933779 140720604177120 140720604174872 4437400 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 296629 290541 613 181 0 290246 0
Current children cumulated CPU time: 2381.68 s
Current children cumulated vsize: 1186516 KiB
Current children cumulated memory: 1162164 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23977
/proc/meminfo: memFree=20554064/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1196160 memory=1171868 CPUtime=2441.67 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 1053588 0 0 0 244020 147 0 0 20 0 1 0 97755455 1224867840 292967 33554432000 4194304 4933779 140720604177120 140720604174872 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 299040 292967 613 181 0 292657 0
Current children cumulated CPU time: 2441.67 s
Current children cumulated vsize: 1196160 KiB
Current children cumulated memory: 1171868 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23986
/proc/meminfo: memFree=20538524/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1205752 memory=1181500 CPUtime=2501.67 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 1077556 0 0 0 250017 150 0 0 20 0 1 0 97755455 1234690048 295375 33554432000 4194304 4933779 140720604177120 140720604174872 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 301438 295375 613 181 0 295055 0
Current children cumulated CPU time: 2501.67 s
Current children cumulated vsize: 1205752 KiB
Current children cumulated memory: 1181500 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 23986
/proc/meminfo: memFree=20536284/32770624 swapFree=67108796/67108860
[pid=23841] ppid=23838 vsize=1207024 memory=1182668 CPUtime=2519.37 cores=0,2,4,6
/proc/23841/stat : 23841 (nacre_mini_rele) R 23838 23841 24279 0 -1 4202496 1082566 0 0 0 251787 150 0 0 20 0 1 0 97755455 1235992576 295667 33554432000 4194304 4933779 140720604177120 140720604174824 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 10121216 140720604185752 140720604185852 140720604185852 140720604188610 0
/proc/23841/statm: 301756 295667 613 181 0 295373 0
Current children cumulated CPU time: 2519.37 s
Current children cumulated vsize: 1207024 KiB
Current children cumulated memory: 1182668 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 23841 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.88 s, system=1.52688 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.03
CPU time (s): 2519.4
CPU user time (s): 2517.88
CPU system time (s): 1.52688
CPU usage (%): 99.9752
Max. virtual memory (cumulated for all children) (KiB): 1207024
Max. memory (cumulated for all children) (KiB): 1182668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.88
system time used= 1.52688
maximum resident set size= 1182724
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1082609
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 505
involuntary context switches= 3150


# summary of solver processes directly reported to runsolver:
#   pid: 23841
#   total CPU time (s): 2519.4
#   total CPU user time (s): 2517.88
#   total CPU system time (s): 1.52688

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.82954 second user time and 18.7473 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-28 20:18:43
IDJOB=4300550
IDBENCH=141658
IDSOLVER=2764
FILE ID=node138/4300550-1532801923
RUNJOBID= node138-1532773607-19387
PBS_JOBID= 21022455
Free space on /tmp= 53800 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Eternity/Eternity-10-10_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4300550-1532801923/watcher-4300550-1532801923 -o /tmp/evaluation-result-4300550-1532801923/solver-4300550-1532801923 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580  nacre_mini_release HOME/instance-4300550-1532801923.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a3eb34d1d913b6993c7392d3f708e375
RANDOM SEED=789467535

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22037392 kB
MemAvailable:   31702680 kB
Buffers:          212092 kB
Cached:          9657168 kB
SwapCached:           44 kB
Active:          2771316 kB
Inactive:        7379420 kB
Active(anon):     225848 kB
Inactive(anon):    83488 kB
Active(file):    2545468 kB
Inactive(file):  7295932 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:              1192 kB
Writeback:             0 kB
AnonPages:        288808 kB
Mapped:            38440 kB
Shmem:             25164 kB
Slab:             280748 kB
SReclaimable:     252348 kB
SUnreclaim:        28400 kB
KernelStack:        3344 kB
PageTables:         5680 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     574392 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    217088 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53800 MiB
End job on node138 at 2018-07-28 21:00:43