Trace number 4391432

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5-Hybrid? (TO) 2400.08 2400.3

General information on the benchmark

NameGracefulGraph/GracefulGraph-m1-s1/
GracefulGraph-K05-P02.xml
MD5SUM803795f7a37fd3a40686e408980b1bff
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark15.5004
Satisfiable
(Un)Satisfiability was proved
Number of variables65
Number of constraints27
Number of domains2
Minimum domain size25
Maximum domain size26
Distribution of domain sizes[{"size":25,"count":25},{"size":26,"count":10}]
Minimum variable degree0
Maximum variable degree6
Distribution of variable degrees[{"degree":0,"count":30},{"degree":2,"count":25},{"degree":6,"count":10}]
Minimum constraint arity3
Maximum constraint arity25
Distribution of constraint arities[{"arity":3,"count":25},{"arity":10,"count":1},{"arity":25,"count":1}]
Number of extensional constraints0
Number of intensional constraints25
Distribution of constraint types[{"type":"intension","count":25},{"type":"allDifferent","count":2}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c NACRE 1.0.5
2400.07/2400.30	c
2400.07/2400.30	c # time = 2400.07
2400.07/2400.30	c # Dec = 1969256
2400.07/2400.30	c # Propagate Calls = 808396188
2400.07/2400.30	c # assignAt Calls = 2407798
2400.07/2400.30	c # removeAt Calls = 219963224
2400.07/2400.30	c # Run = 3834
2400.07/2400.30	c # Conflicts = 1950435
2400.07/2400.30	c # Memory used = 179.096 Mb
2400.07/2400.30	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15232 MiB free)
  memory of node 1: 16384 MiB (15121 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391432-1568306280/watcher-4391432-1568306280 -o /tmp/evaluation-result-4391432-1568306280/solver-4391432-1568306280 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568306240-27781 --watchdog 2560 nacre_mini_release HOME/instance-4391432-1568306280.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=27805, runsolver pid=27798

[startup+0.10054 s]*
/proc/loadavg: 1.06 1.60 1.86 3/202 27812
/proc/meminfo: memFree=31038272/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=26960 memory=3724 CPUtime=0.1 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 1105 0 0 0 10 0 0 0 20 0 1 0 406877535 27607040 931 33554432000 4194304 4935366 140729034178560 140729034175800 4383547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 6740 931 606 181 0 357 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 26960 KiB
Current children cumulated memory: 3724 KiB

[startup+0.209875 s]*
/proc/loadavg: 1.06 1.60 1.86 3/202 27812
/proc/meminfo: memFree=31006332/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=26960 memory=3724 CPUtime=0.21 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 1111 0 0 0 21 0 0 0 20 0 1 0 406877535 27607040 931 33554432000 4194304 4935366 140729034178560 140729034175800 4513809 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 6740 931 606 181 0 357 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 26960 KiB
Current children cumulated memory: 3724 KiB

[startup+0.309378 s]*
/proc/loadavg: 1.06 1.60 1.86 3/202 27812
/proc/meminfo: memFree=31006044/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=27092 memory=3724 CPUtime=0.31 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 1126 0 0 0 31 0 0 0 20 0 1 0 406877535 27742208 931 33554432000 4194304 4935366 140729034178560 140729034175800 140168493657622 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 6773 931 606 181 0 390 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27092 KiB
Current children cumulated memory: 3724 KiB

[startup+0.700332 s]
/proc/loadavg: 1.06 1.60 1.86 3/202 27812
/proc/meminfo: memFree=31005924/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=27356 memory=3988 CPUtime=0.69 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 1204 0 0 0 69 0 0 0 20 0 1 0 406877535 28012544 997 33554432000 4194304 4935366 140729034178560 140729034176120 140168493674357 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 6839 997 612 181 0 456 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27356 KiB
Current children cumulated memory: 3988 KiB

[startup+1.50034 s]
/proc/loadavg: 1.06 1.60 1.86 3/202 27812
/proc/meminfo: memFree=31005180/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=28140 memory=4744 CPUtime=1.49 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 1409 0 0 0 149 0 0 0 20 0 1 0 406877535 28815360 1186 33554432000 4194304 4935366 140729034178560 140729034176712 140168493657622 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 7035 1186 613 181 0 652 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 28140 KiB
Current children cumulated memory: 4744 KiB

[startup+3.10943 s]
/proc/loadavg: 1.06 1.60 1.86 3/202 27812
/proc/meminfo: memFree=30998500/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=30148 memory=6864 CPUtime=3.1 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 2849 0 0 0 310 0 0 0 20 0 1 0 406877535 30871552 1716 33554432000 4194304 4935366 140729034178560 140729034176312 140168493674371 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 7537 1716 613 181 0 1154 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 30148 KiB
Current children cumulated memory: 6864 KiB

[startup+6.30033 s]
/proc/loadavg: 1.06 1.59 1.86 3/202 27812
/proc/meminfo: memFree=30989188/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=34184 memory=10712 CPUtime=6.28 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 5536 0 0 0 628 0 0 0 20 0 1 0 406877535 35004416 2678 33554432000 4194304 4935366 140729034178560 140729034176312 4383450 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 8546 2678 613 181 0 2163 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 34184 KiB
Current children cumulated memory: 10712 KiB

[startup+12.7003 s]
/proc/loadavg: 1.13 1.60 1.86 3/202 27812
/proc/meminfo: memFree=30970216/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=42048 memory=18512 CPUtime=12.69 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 10294 0 0 0 1268 1 0 0 20 0 1 0 406877535 43057152 4628 33554432000 4194304 4935366 140729034178560 140729034176312 4211168 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 10512 4628 613 181 0 4129 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 42048 KiB
Current children cumulated memory: 18512 KiB

[startup+25.5004 s]
/proc/loadavg: 1.33 1.62 1.86 3/203 27814
/proc/meminfo: memFree=30950076/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=50460 memory=26572 CPUtime=25.49 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 22374 0 0 0 2547 2 0 0 20 0 1 0 406877535 51671040 6643 33554432000 4194304 4935366 140729034178560 140729034176248 140168494591402 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 12615 6643 613 181 0 6232 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 50460 KiB
Current children cumulated memory: 26572 KiB

[startup+51.1098 s]
/proc/loadavg: 1.56 1.65 1.86 3/202 27814
/proc/meminfo: memFree=30925168/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=60676 memory=36752 CPUtime=51.09 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 32729 0 0 0 5106 3 0 0 20 0 1 0 406877535 62132224 9188 33554432000 4194304 4935366 140729034178560 140729034176264 4384117 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 15169 9188 613 181 0 8786 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 60676 KiB
Current children cumulated memory: 36752 KiB

[startup+102.3 s]
/proc/loadavg: 1.81 1.70 1.87 3/202 27818
/proc/meminfo: memFree=30890156/32770624 swapFree=66965796/67108860
[pid=27805] ppid=27798 vsize=73640 memory=50064 CPUtime=102.28 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 45726 0 0 0 10223 5 0 0 20 0 1 0 406877535 75407360 12516 33554432000 4194304 4935366 140729034178560 140729034176264 140168493674380 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 18410 12516 613 181 0 12027 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 73640 KiB
Current children cumulated memory: 50064 KiB

[startup+162.3 s]
/proc/loadavg: 1.93 1.76 1.88 3/203 27832
/proc/meminfo: memFree=30861996/32770624 swapFree=66965804/67108860
[pid=27805] ppid=27798 vsize=82308 memory=59008 CPUtime=162.28 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 60554 0 0 0 16222 6 0 0 20 0 1 0 406877535 84283392 14752 33554432000 4194304 4935366 140729034178560 140729034176328 140168493662974 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 20577 14752 613 181 0 14194 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 82308 KiB
Current children cumulated memory: 59008 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.80 1.88 3/205 27838
/proc/meminfo: memFree=30844232/32770624 swapFree=66965804/67108860
[pid=27805] ppid=27798 vsize=90964 memory=66400 CPUtime=222.26 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 77420 0 0 0 22218 8 0 0 20 0 1 0 406877535 93147136 16600 33554432000 4194304 4935366 140729034178560 140729034176248 4382354 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 22741 16600 613 181 0 16358 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 90964 KiB
Current children cumulated memory: 66400 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.84 1.89 3/205 27842
/proc/meminfo: memFree=30822248/32770624 swapFree=66965804/67108860
[pid=27805] ppid=27798 vsize=100300 memory=76052 CPUtime=282.24 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 80920 0 0 0 28216 8 0 0 20 0 1 0 406877535 102707200 19013 33554432000 4194304 4935366 140729034178560 140729034176264 140168493657805 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 25075 19013 613 181 0 18692 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 100300 KiB
Current children cumulated memory: 76052 KiB

[startup+342.3 s]
/proc/loadavg: 2.05 1.88 1.90 3/205 27848
/proc/meminfo: memFree=30807564/32770624 swapFree=66965804/67108860
[pid=27805] ppid=27798 vsize=106328 memory=82152 CPUtime=342.24 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 85698 0 0 0 34215 9 0 0 20 0 1 0 406877535 108879872 20538 33554432000 4194304 4935366 140729034178560 140729034176264 4384126 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 26582 20538 613 181 0 20199 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 106328 KiB
Current children cumulated memory: 82152 KiB

[startup+402.3 s]
/proc/loadavg: 2.02 1.90 1.90 3/205 27852
/proc/meminfo: memFree=30789500/32770624 swapFree=66965804/67108860
[pid=27805] ppid=27798 vsize=111936 memory=87856 CPUtime=402.24 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 91772 0 0 0 40215 9 0 0 20 0 1 0 406877535 114622464 21964 33554432000 4194304 4935366 140729034178560 140729034176312 4483712 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 27984 21964 613 181 0 21601 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 111936 KiB
Current children cumulated memory: 87856 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 1.92 1.91 3/205 27856
/proc/meminfo: memFree=30774784/32770624 swapFree=66965804/67108860
[pid=27805] ppid=27798 vsize=116688 memory=92668 CPUtime=462.23 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 99365 0 0 0 46213 10 0 0 20 0 1 0 406877535 119488512 23167 33554432000 4194304 4935366 140729034178560 140729034176248 140168493674436 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 29172 23167 613 181 0 22789 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 116688 KiB
Current children cumulated memory: 92668 KiB


################
# More data... #
################

/proc/27805/statm: 44951 38958 613 181 0 38568 0
Current children cumulated CPU time: 1662.13 s
Current children cumulated vsize: 179804 KiB
Current children cumulated memory: 155832 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/203 27998
/proc/meminfo: memFree=30543908/32770624 swapFree=66965836/67108860
[pid=27805] ppid=27798 vsize=182920 memory=158988 CPUtime=1722.12 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 199961 0 0 0 172192 20 0 0 20 0 1 0 406877535 187310080 39747 33554432000 4194304 4935366 140729034178560 140729034176264 140168499958750 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 45730 39747 613 181 0 39347 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 182920 KiB
Current children cumulated memory: 158988 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/203 28004
/proc/meminfo: memFree=30534300/32770624 swapFree=66965836/67108860
[pid=27805] ppid=27798 vsize=184704 memory=160596 CPUtime=1782.12 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 202221 0 0 0 178192 20 0 0 20 0 1 0 406877535 189136896 40149 33554432000 4194304 4935366 140729034178560 140729034176264 140168493662815 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 46176 40149 613 181 0 39793 0
Current children cumulated CPU time: 1782.12 s
Current children cumulated vsize: 184704 KiB
Current children cumulated memory: 160596 KiB

[startup+1842.3 s]
/proc/loadavg: 2.06 2.02 1.97 3/203 28008
/proc/meminfo: memFree=30525624/32770624 swapFree=66965836/67108860
[pid=27805] ppid=27798 vsize=187548 memory=163356 CPUtime=1842.12 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 205257 0 0 0 184191 21 0 0 20 0 1 0 406877535 192049152 40839 33554432000 4194304 4935366 140729034178560 140729034176248 4461519 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 46887 40839 613 181 0 40504 0
Current children cumulated CPU time: 1842.12 s
Current children cumulated vsize: 187548 KiB
Current children cumulated memory: 163356 KiB

[startup+1902.3 s]
/proc/loadavg: 2.02 2.02 1.97 3/203 28012
/proc/meminfo: memFree=30509988/32770624 swapFree=66965836/67108860
[pid=27805] ppid=27798 vsize=187944 memory=163744 CPUtime=1902.11 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 208232 0 0 0 190190 21 0 0 20 0 1 0 406877535 192454656 40936 33554432000 4194304 4935366 140729034178560 140729034176248 4461216 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 46986 40936 613 181 0 40603 0
Current children cumulated CPU time: 1902.11 s
Current children cumulated vsize: 187944 KiB
Current children cumulated memory: 163744 KiB

[startup+1962.3 s]
/proc/loadavg: 2.14 2.06 1.98 3/203 28025
/proc/meminfo: memFree=30482076/32770624 swapFree=66965836/67108860
[pid=27805] ppid=27798 vsize=187944 memory=163932 CPUtime=1962.11 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 211207 0 0 0 196190 21 0 0 20 0 1 0 406877535 192454656 40983 33554432000 4194304 4935366 140729034178560 140729034176248 4461066 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 46986 40983 613 181 0 40603 0
Current children cumulated CPU time: 1962.11 s
Current children cumulated vsize: 187944 KiB
Current children cumulated memory: 163932 KiB

[startup+2022.3 s]
/proc/loadavg: 2.05 2.05 1.98 3/202 28029
/proc/meminfo: memFree=30472028/32770624 swapFree=66965836/67108860
[pid=27805] ppid=27798 vsize=189328 memory=165128 CPUtime=2022.1 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 214521 0 0 0 202189 21 0 0 20 0 1 0 406877535 193871872 41282 33554432000 4194304 4935366 140729034178560 140729034176248 4461252 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 47332 41282 613 181 0 40949 0
Current children cumulated CPU time: 2022.1 s
Current children cumulated vsize: 189328 KiB
Current children cumulated memory: 165128 KiB

[startup+2082.3 s]
/proc/loadavg: 2.02 2.04 1.98 3/202 28033
/proc/meminfo: memFree=30456812/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=192056 memory=167936 CPUtime=2082.09 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 218578 0 0 0 208187 22 0 0 20 0 1 0 406877535 196665344 41984 33554432000 4194304 4935366 140729034178560 140729034176264 4461069 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 48014 41984 613 181 0 41631 0
Current children cumulated CPU time: 2082.09 s
Current children cumulated vsize: 192056 KiB
Current children cumulated memory: 167936 KiB

[startup+2142.3 s]
/proc/loadavg: 2.09 2.05 1.99 3/202 28039
/proc/meminfo: memFree=30445628/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=195708 memory=171460 CPUtime=2142.09 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 223514 0 0 0 214186 23 0 0 20 0 1 0 406877535 200404992 42865 33554432000 4194304 4935366 140729034178560 140729034176264 4383051 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 48927 42865 613 181 0 42544 0
Current children cumulated CPU time: 2142.09 s
Current children cumulated vsize: 195708 KiB
Current children cumulated memory: 171460 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.04 1.99 3/202 28043
/proc/meminfo: memFree=30440396/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=197596 memory=173524 CPUtime=2202.08 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 225522 0 0 0 220185 23 0 0 20 0 1 0 406877535 202338304 43381 33554432000 4194304 4935366 140729034178560 140729034176264 4483720 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 49399 43381 613 181 0 43016 0
Current children cumulated CPU time: 2202.08 s
Current children cumulated vsize: 197596 KiB
Current children cumulated memory: 173524 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.04 1.99 3/203 28048
/proc/meminfo: memFree=30436084/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=198996 memory=174936 CPUtime=2262.08 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 227815 0 0 0 226185 23 0 0 20 0 1 0 406877535 203771904 43734 33554432000 4194304 4935366 140729034178560 140729034176248 140168493674436 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 49749 43734 613 181 0 43366 0
Current children cumulated CPU time: 2262.08 s
Current children cumulated vsize: 198996 KiB
Current children cumulated memory: 174936 KiB

[startup+2322.3 s]
/proc/loadavg: 2.08 2.05 1.99 3/203 28054
/proc/meminfo: memFree=30429644/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=199656 memory=175628 CPUtime=2322.08 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 230144 0 0 0 232184 24 0 0 20 0 1 0 406877535 204447744 43907 33554432000 4194304 4935366 140729034178560 140729034176312 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 49914 43907 613 181 0 43531 0
Current children cumulated CPU time: 2322.08 s
Current children cumulated vsize: 199656 KiB
Current children cumulated memory: 175628 KiB

[startup+2382.3 s]
/proc/loadavg: 2.03 2.04 1.99 3/203 28058
/proc/meminfo: memFree=30420604/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=202268 memory=178296 CPUtime=2382.07 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 233222 0 0 0 238183 24 0 0 20 0 1 0 406877535 207122432 44574 33554432000 4194304 4935366 140729034178560 140729034176264 4483720 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 50567 44574 613 181 0 44184 0
Current children cumulated CPU time: 2382.07 s
Current children cumulated vsize: 202268 KiB
Current children cumulated memory: 178296 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.3 s]
/proc/loadavg: 2.02 2.04 1.99 3/203 28058
/proc/meminfo: memFree=30419040/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=203060 memory=179096 CPUtime=2400.07 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 236528 0 0 0 239983 24 0 0 20 0 1 0 406877535 207933440 44774 33554432000 4194304 4935366 140729034178560 140729034176264 4461261 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 50765 44774 613 181 0 44382 0
Current children cumulated CPU time: 2400.07 s
Current children cumulated vsize: 203060 KiB
Current children cumulated memory: 179096 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.3 s]
# the end of solver process 27805 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.83 s, system=0.249982 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.3 s]
/proc/loadavg: 2.02 2.04 1.99 3/203 28058
/proc/meminfo: memFree=30419040/32770624 swapFree=66965840/67108860
[pid=27805] ppid=27798 vsize=203060 memory=179096 CPUtime=2400.07 cores=0,2,4,6
/proc/27805/stat : 27805 (nacre_mini_rele) R 27798 27805 25882 0 -1 4202496 236528 0 0 0 239983 24 0 0 20 0 1 0 406877535 207933440 44774 33554432000 4194304 4935366 140729034178560 140729034176264 4461261 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38899712 140729034179585 140729034179685 140729034179685 140729034182594 0
/proc/27805/statm: 50765 44774 613 181 0 44382 0
Current children cumulated CPU time: 2400.07 s
Current children cumulated vsize: 203060 KiB
Current children cumulated memory: 179096 KiB

Child status: 0
Real time (s): 2400.3
CPU time (s): 2400.08
CPU user time (s): 2399.83
CPU system time (s): 0.249982
CPU usage (%): 99.9908
Max. virtual memory (cumulated for all children) (KiB): 203060
Max. memory (cumulated for all children) (KiB): 179096

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.83
system time used= 0.249982
maximum resident set size= 179176
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 236573
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 83
involuntary context switches= 3028


# summary of solver processes directly reported to runsolver:
#   pid: 27805
#   total CPU time (s): 2400.08
#   total CPU user time (s): 2399.83
#   total CPU system time (s): 0.249982

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.2819 second user time and 17.421 second system time

The end

Launcher Data 

Begin job on node135 at 2019-09-12 18:37:20
IDJOB=4391432
IDBENCH=120720
IDSOLVER=2834
FILE ID=node135/4391432-1568306280
RUNJOBID= node135-1568306240-27781
PBS_JOBID= 21701112
Free space on /tmp= 59128 MiB

SOLVER NAME= NACRE 1.0.5-Hybrid
BENCH NAME= XCSP17/GracefulGraph/GracefulGraph-m1-s1/GracefulGraph-K05-P02.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391432-1568306280/watcher-4391432-1568306280 -o /tmp/evaluation-result-4391432-1568306280/solver-4391432-1568306280 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568306240-27781 --watchdog 2560  nacre_mini_release HOME/instance-4391432-1568306280.xml -ca -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 803795f7a37fd3a40686e408980b1bff
RANDOM SEED=1601190568

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31084412 kB
MemAvailable:   31869624 kB
Buffers:          110060 kB
Cached:           942304 kB
SwapCached:        36184 kB
Active:           417868 kB
Inactive:         673804 kB
Active(anon):      10520 kB
Inactive(anon):    59648 kB
Active(file):     407348 kB
Inactive(file):   614156 kB
Unevictable:      109772 kB
Mlocked:          109772 kB
SwapTotal:      67108860 kB
SwapFree:       66965796 kB
Dirty:               804 kB
Writeback:             0 kB
AnonPages:        113752 kB
Mapped:            33092 kB
Shmem:             22236 kB
Slab:             189364 kB
SReclaimable:     159084 kB
SUnreclaim:        30280 kB
KernelStack:        3488 kB
PageTables:         5316 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     501648 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 59124 MiB
End job on node135 at 2019-09-12 19:17:20