Trace number 4299858

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.63 2520.02

General information on the benchmark

NameSubisomorphism/
Subisomorphism-g19-g45_c18.xml
MD5SUMd9c49275b9746ea736e23f2bca190f13
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables64
Number of constraints233
Number of domains1
Minimum domain size128
Maximum domain size128
Distribution of domain sizes[{"size":128,"count":64}]
Minimum variable degree4
Maximum variable degree10
Distribution of variable degrees[{"degree":4,"count":4},{"degree":5,"count":8},{"degree":6,"count":20},{"degree":8,"count":16},{"degree":10,"count":16}]
Minimum constraint arity1
Maximum constraint arity64
Distribution of constraint arities[{"arity":1,"count":64},{"arity":2,"count":168},{"arity":64,"count":1}]
Number of extensional constraints232
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":232},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.08	c NACRE 1.0.4
2519.61/2520.01	c
2519.61/2520.01	c # time = 2519.61
2519.61/2520.01	c # Dec = 1598650
2519.61/2520.01	c # Propagate Calls = 4757089911
2519.61/2520.01	c # assignAt Calls = 2581951
2519.61/2520.01	c # removeAt Calls = 1184008122
2519.61/2520.01	c # Run = 3069
2519.61/2520.01	c # Conflicts = 1571703
2519.61/2520.01	c # Memory used = 891.58 Mb
2519.61/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9593 MiB free)
  memory of node 1: 16384 MiB (9716 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299858-1532790292/watcher-4299858-1532790292 -o /tmp/evaluation-result-4299858-1532790292/solver-4299858-1532790292 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580 nacre_mini_release HOME/instance-4299858-1532790292.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29216, runsolver pid=29213

[startup+0.100122 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19753780/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=45892 memory=22472 CPUtime=0.1 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 5811 0 0 0 10 0 0 0 20 0 1 0 96592417 46993408 5618 33554432000 4194304 4933779 140723699062416 140723699059416 4388352 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 11473 5618 583 181 0 5090 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 45892 KiB
Current children cumulated memory: 22472 KiB

[startup+0.209767 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19752664/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=47092 memory=23792 CPUtime=0.21 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 6128 0 0 0 21 0 0 0 20 0 1 0 96592417 48222208 5948 33554432000 4194304 4933779 140723699062416 140723699059416 140109726263683 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 11773 5948 607 181 0 5390 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 47092 KiB
Current children cumulated memory: 23792 KiB

[startup+0.309283 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19751176/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=48432 memory=25124 CPUtime=0.31 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 6450 0 0 0 31 0 0 0 20 0 1 0 96592417 49594368 6281 33554432000 4194304 4933779 140723699062416 140723699059416 140109726263723 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 12108 6281 607 181 0 5725 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 48432 KiB
Current children cumulated memory: 25124 KiB

[startup+0.700245 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19748728/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=53116 memory=29708 CPUtime=0.69 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 7634 0 0 0 69 0 0 0 20 0 1 0 96592417 54390784 7427 33554432000 4194304 4933779 140723699062416 140723699059976 140109731701913 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 13279 7427 607 181 0 6896 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 53116 KiB
Current children cumulated memory: 29708 KiB

[startup+1.50026 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19742792/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=62352 memory=39044 CPUtime=1.49 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 9942 0 0 0 149 0 0 0 20 0 1 0 96592417 63848448 9761 33554432000 4194304 4933779 140723699062416 140723699060184 4475561 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 15588 9761 607 181 0 9205 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 62352 KiB
Current children cumulated memory: 39044 KiB

[startup+3.10956 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19721084/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=79276 memory=55816 CPUtime=3.1 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 19459 0 0 0 308 2 0 0 20 0 1 0 96592417 81178624 13954 33554432000 4194304 4933779 140723699062416 140723699060168 4437547 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 19819 13954 607 181 0 13436 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 79276 KiB
Current children cumulated memory: 55816 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29217
/proc/meminfo: memFree=19697772/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=102284 memory=78780 CPUtime=6.29 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 34633 0 0 0 626 3 0 0 20 0 1 0 96592417 104738816 19695 33554432000 4194304 4933779 140723699062416 140723699060120 140109726263699 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 25571 19695 607 181 0 19188 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 102284 KiB
Current children cumulated memory: 78780 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29217
/proc/meminfo: memFree=19674448/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=127572 memory=104316 CPUtime=12.68 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 55280 0 0 0 1264 4 0 0 20 0 1 0 96592417 130633728 26079 33554432000 4194304 4933779 140723699062416 140723699060184 140109731599614 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 31893 26079 607 181 0 25510 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 127572 KiB
Current children cumulated memory: 104316 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29217
/proc/meminfo: memFree=19636132/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=162196 memory=138472 CPUtime=25.48 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 103991 0 0 0 2540 8 0 0 20 0 1 0 96592417 166088704 34618 33554432000 4194304 4933779 140723699062416 140723699060104 4475748 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 40549 34618 607 181 0 34166 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 162196 KiB
Current children cumulated memory: 138472 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29217
/proc/meminfo: memFree=19586284/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=207832 memory=184184 CPUtime=51.09 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 148187 0 0 0 5095 14 0 0 20 0 1 0 96592417 212819968 46046 33554432000 4194304 4933779 140723699062416 140723699060184 4380431 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 51958 46046 607 181 0 45575 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 207832 KiB
Current children cumulated memory: 184184 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29218
/proc/meminfo: memFree=19517684/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=274884 memory=251376 CPUtime=102.28 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 205472 0 0 0 10207 21 0 0 20 0 1 0 96592417 281481216 62844 33554432000 4194304 4933779 140723699062416 140723699060104 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 68721 62844 607 181 0 62338 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 274884 KiB
Current children cumulated memory: 251376 KiB

[startup+162.3 s]
/proc/loadavg: 2.16 2.05 2.06 3/187 29219
/proc/meminfo: memFree=19466844/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=325684 memory=301184 CPUtime=162.28 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 267981 0 0 0 16199 29 0 0 20 0 1 0 96592417 333500416 75296 33554432000 4194304 4933779 140723699062416 140723699060104 140109731599602 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 81421 75296 607 181 0 75038 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 325684 KiB
Current children cumulated memory: 301184 KiB

[startup+222.3 s]
/proc/loadavg: 2.46 2.17 2.10 3/187 29281
/proc/meminfo: memFree=19792228/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=363848 memory=339228 CPUtime=222.26 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 280901 0 0 0 22193 33 0 0 20 0 1 0 96592417 372580352 84807 33554432000 4194304 4933779 140723699062416 140723699060168 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 90962 84807 607 181 0 84579 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 363848 KiB
Current children cumulated memory: 339228 KiB

[startup+282.3 s]
/proc/loadavg: 2.17 2.14 2.09 3/187 29282
/proc/meminfo: memFree=19700420/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=398384 memory=374032 CPUtime=282.21 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 341055 0 0 0 28182 39 0 0 20 0 1 0 96592417 407945216 93508 33554432000 4194304 4933779 140723699062416 140723699060120 4437311 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 99596 93508 607 181 0 93213 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 398384 KiB
Current children cumulated memory: 374032 KiB

[startup+342.3 s]
/proc/loadavg: 2.16 2.14 2.10 3/187 29290
/proc/meminfo: memFree=19636672/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=423516 memory=399160 CPUtime=342.17 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 385808 0 0 0 34173 44 0 0 20 0 1 0 96592417 433680384 99790 33554432000 4194304 4933779 140723699062416 140723699060120 4437581 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 105879 99790 607 181 0 99496 0
Current children cumulated CPU time: 342.17 s
Current children cumulated vsize: 423516 KiB
Current children cumulated memory: 399160 KiB

[startup+402.3 s]
/proc/loadavg: 2.06 2.12 2.09 3/187 29291
/proc/meminfo: memFree=19579908/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=453448 memory=429280 CPUtime=402.13 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 410656 0 0 0 40164 49 0 0 20 0 1 0 96592417 464330752 107320 33554432000 4194304 4933779 140723699062416 140723699060120 4437843 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 113362 107320 607 181 0 106979 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 453448 KiB
Current children cumulated memory: 429280 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.10 2.09 3/187 29292
/proc/meminfo: memFree=19532840/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=479884 memory=455872 CPUtime=462.09 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 422444 0 0 0 46157 52 0 0 20 0 1 0 96592417 491401216 113968 33554432000 4194304 4933779 140723699062416 140723699060168 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 119971 113968 607 181 0 113588 0
Current children cumulated CPU time: 462.09 s
Current children cumulated vsize: 479884 KiB
Current children cumulated memory: 455872 KiB


################
# More data... #
################

/proc/29216/statm: 199552 193162 607 181 0 193169 0
Current children cumulated CPU time: 1721.98 s
Current children cumulated vsize: 798208 KiB
Current children cumulated memory: 772648 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29331
/proc/meminfo: memFree=19000688/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=807820 memory=782200 CPUtime=1781.96 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 794545 0 0 0 178092 104 0 0 20 0 1 0 96592417 827207680 195550 33554432000 4194304 4933779 140723699062416 140723699060168 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 201955 195550 607 181 0 195572 0
Current children cumulated CPU time: 1781.96 s
Current children cumulated vsize: 807820 KiB
Current children cumulated memory: 782200 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29332
/proc/meminfo: memFree=18982892/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=819136 memory=794456 CPUtime=1841.92 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 806577 0 0 0 184087 105 0 0 20 0 1 0 96592417 838795264 198614 33554432000 4194304 4933779 140723699062416 140723699060120 4331905 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 204784 198614 607 181 0 198401 0
Current children cumulated CPU time: 1841.92 s
Current children cumulated vsize: 819136 KiB
Current children cumulated memory: 794456 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29333
/proc/meminfo: memFree=18967008/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=829284 memory=804744 CPUtime=1901.92 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 810901 0 0 0 190086 106 0 0 20 0 1 0 96592417 849186816 201186 33554432000 4194304 4933779 140723699062416 140723699060120 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 207321 201186 607 181 0 200938 0
Current children cumulated CPU time: 1901.92 s
Current children cumulated vsize: 829284 KiB
Current children cumulated memory: 804744 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29334
/proc/meminfo: memFree=18955080/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=839584 memory=814876 CPUtime=1961.92 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 816394 0 0 0 196085 107 0 0 20 0 1 0 96592417 859734016 203719 33554432000 4194304 4933779 140723699062416 140723699060168 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 209896 203719 607 181 0 203513 0
Current children cumulated CPU time: 1961.92 s
Current children cumulated vsize: 839584 KiB
Current children cumulated memory: 814876 KiB

[startup+2022.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 29335
/proc/meminfo: memFree=18944416/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=847608 memory=822988 CPUtime=2021.92 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 823206 0 0 0 202084 108 0 0 20 0 1 0 96592417 867950592 205747 33554432000 4194304 4933779 140723699062416 140723699060104 4380661 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 211902 205747 607 181 0 205519 0
Current children cumulated CPU time: 2021.92 s
Current children cumulated vsize: 847608 KiB
Current children cumulated memory: 822988 KiB

[startup+2082.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 29336
/proc/meminfo: memFree=18928908/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=860044 memory=835444 CPUtime=2081.92 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 832337 0 0 0 208082 110 0 0 20 0 1 0 96592417 880685056 208861 33554432000 4194304 4933779 140723699062416 140723699060120 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 215011 208861 607 181 0 208628 0
Current children cumulated CPU time: 2081.92 s
Current children cumulated vsize: 860044 KiB
Current children cumulated memory: 835444 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 29344
/proc/meminfo: memFree=18914812/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=865872 memory=841148 CPUtime=2141.91 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 840487 0 0 0 214080 111 0 0 20 0 1 0 96592417 886652928 210287 33554432000 4194304 4933779 140723699062416 140723699060120 4437538 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 216468 210287 607 181 0 210085 0
Current children cumulated CPU time: 2141.91 s
Current children cumulated vsize: 865872 KiB
Current children cumulated memory: 841148 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29528
/proc/meminfo: memFree=19264772/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=873248 memory=848640 CPUtime=2201.91 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 850677 0 0 0 220078 113 0 0 20 0 1 0 96592417 894205952 212160 33554432000 4194304 4933779 140723699062416 140723699060120 140109726263675 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 218312 212160 607 181 0 211929 0
Current children cumulated CPU time: 2201.91 s
Current children cumulated vsize: 873248 KiB
Current children cumulated memory: 848640 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29529
/proc/meminfo: memFree=19192872/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=881916 memory=857236 CPUtime=2261.91 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 862560 0 0 0 226076 115 0 0 20 0 1 0 96592417 903081984 214309 33554432000 4194304 4933779 140723699062416 140723699060120 4380801 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 220479 214309 607 181 0 214096 0
Current children cumulated CPU time: 2261.91 s
Current children cumulated vsize: 881916 KiB
Current children cumulated memory: 857236 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29530
/proc/meminfo: memFree=19149448/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=889716 memory=864980 CPUtime=2321.91 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 875697 0 0 0 232074 117 0 0 20 0 1 0 96592417 911069184 216245 33554432000 4194304 4933779 140723699062416 140723699060104 4364088 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 222429 216245 607 181 0 216046 0
Current children cumulated CPU time: 2321.91 s
Current children cumulated vsize: 889716 KiB
Current children cumulated memory: 864980 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29531
/proc/meminfo: memFree=19112548/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=898480 memory=873608 CPUtime=2381.91 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 889444 0 0 0 238072 119 0 0 20 0 1 0 96592417 920043520 218402 33554432000 4194304 4933779 140723699062416 140723699060168 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 224620 218402 607 181 0 218237 0
Current children cumulated CPU time: 2381.91 s
Current children cumulated vsize: 898480 KiB
Current children cumulated memory: 873608 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29532
/proc/meminfo: memFree=19079568/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=908348 memory=883580 CPUtime=2441.91 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 905224 0 0 0 244070 121 0 0 20 0 1 0 96592417 930148352 220895 33554432000 4194304 4933779 140723699062416 140723699060168 4437558 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 227087 220895 607 181 0 220704 0
Current children cumulated CPU time: 2441.91 s
Current children cumulated vsize: 908348 KiB
Current children cumulated memory: 883580 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29533
/proc/meminfo: memFree=19052292/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=915300 memory=890440 CPUtime=2501.9 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 920789 0 0 0 250068 122 0 0 20 0 1 0 96592417 937267200 222610 33554432000 4194304 4933779 140723699062416 140723699060120 4437572 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 228825 222610 607 181 0 222442 0
Current children cumulated CPU time: 2501.9 s
Current children cumulated vsize: 915300 KiB
Current children cumulated memory: 890440 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 29533
/proc/meminfo: memFree=19045352/32770624 swapFree=67108860/67108860
[pid=29216] ppid=29213 vsize=916380 memory=891532 CPUtime=2519.61 cores=0,2,4,6
/proc/29216/stat : 29216 (nacre_mini_rele) R 29213 29216 26996 0 -1 4202496 922610 0 0 0 251838 123 0 0 20 0 1 0 96592417 938373120 222883 33554432000 4194304 4933779 140723699062416 140723699060120 4437572 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 38866944 140723699070104 140723699070204 140723699070204 140723699072962 0
/proc/29216/statm: 229095 222883 607 181 0 222712 0
Current children cumulated CPU time: 2519.61 s
Current children cumulated vsize: 916380 KiB
Current children cumulated memory: 891532 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 29216 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2518.39 s, system=1.24495 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.02
CPU time (s): 2519.63
CPU user time (s): 2518.39
CPU system time (s): 1.24495
CPU usage (%): 99.9846
Max. virtual memory (cumulated for all children) (KiB): 916380
Max. memory (cumulated for all children) (KiB): 891532

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2518.39
system time used= 1.24495
maximum resident set size= 891636
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 922653
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 391
involuntary context switches= 3184


# summary of solver processes directly reported to runsolver:
#   pid: 29216
#   total CPU time (s): 2519.63
#   total CPU user time (s): 2518.39
#   total CPU system time (s): 1.24495

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.96854 second user time and 18.7639 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 17:04:52
IDJOB=4299858
IDBENCH=141500
IDSOLVER=2764
FILE ID=node103/4299858-1532790292
RUNJOBID= node103-1532775163-27027
PBS_JOBID= 21022463
Free space on /tmp= 56532 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Subisomorphism/Subisomorphism-g19-g45_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299858-1532790292/watcher-4299858-1532790292 -o /tmp/evaluation-result-4299858-1532790292/solver-4299858-1532790292 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580  nacre_mini_release HOME/instance-4299858-1532790292.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d9c49275b9746ea736e23f2bca190f13
RANDOM SEED=1069567421

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        19773796 kB
MemAvailable:   31479472 kB
Buffers:          302752 kB
Cached:         11586624 kB
SwapCached:            0 kB
Active:          4369876 kB
Inactive:        8023312 kB
Active(anon):     506460 kB
Inactive(anon):    25184 kB
Active(file):    3863416 kB
Inactive(file):  7998128 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:               804 kB
Writeback:             0 kB
AnonPages:        510216 kB
Mapped:            44808 kB
Shmem:             25228 kB
Slab:             300632 kB
SReclaimable:     272592 kB
SUnreclaim:        28040 kB
KernelStack:        3360 kB
PageTables:         6040 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     801248 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    432128 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56536 MiB
End job on node103 at 2018-07-28 17:46:52