Trace number 4391461

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5-Hybrid? (TO) 2400.09 2400.3

General information on the benchmark

NameSubisomorphism/Subisomorphism-m1-LV/
Subisomorphism-g19-g25.xml
MD5SUM6a0b9ff28537b74082311c97fcf8fc06
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.015492
Satisfiable
(Un)Satisfiability was proved
Number of variables64
Number of constraints233
Number of domains1
Minimum domain size75
Maximum domain size75
Distribution of domain sizes[{"size":75,"count":64}]
Minimum variable degree4
Maximum variable degree10
Distribution of variable degrees[{"degree":4,"count":4},{"degree":5,"count":8},{"degree":6,"count":20},{"degree":8,"count":16},{"degree":10,"count":16}]
Minimum constraint arity1
Maximum constraint arity64
Distribution of constraint arities[{"arity":1,"count":64},{"arity":2,"count":168},{"arity":64,"count":1}]
Number of extensional constraints232
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":232},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.5
2400.08/2400.30	c
2400.08/2400.30	c # time = 2400.08
2400.08/2400.30	c # Dec = 1770382
2400.08/2400.30	c # Propagate Calls = 7529477530
2400.08/2400.30	c # assignAt Calls = 6180540
2400.08/2400.30	c # removeAt Calls = 375224403
2400.08/2400.30	c # Run = 3371
2400.08/2400.30	c # Conflicts = 1752870
2400.08/2400.30	c # Memory used = 241.98 Mb
2400.08/2400.30	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15228 MiB free)
  memory of node 1: 16384 MiB (14884 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391461-1568310451/watcher-4391461-1568310451 -o /tmp/evaluation-result-4391461-1568310451/solver-4391461-1568310451 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568306240-27781 --watchdog 2560 nacre_mini_release HOME/instance-4391461-1568310451.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28841, runsolver pid=28838

[startup+0.100199 s]*
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30830928/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=31200 memory=7688 CPUtime=0.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 2134 0 0 0 10 0 0 0 20 0 1 0 407294699 31948800 1922 33554432000 4194304 4935366 140737093717952 140737093714952 4450992 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 7800 1922 614 181 0 1417 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31200 KiB
Current children cumulated memory: 7688 KiB

[startup+0.209829 s]*
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30830556/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=31728 memory=8216 CPUtime=0.21 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 2262 0 0 0 21 0 0 0 20 0 1 0 407294699 32489472 2054 33554432000 4194304 4935366 140737093717952 140737093714952 139624408886245 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 7932 2054 614 181 0 1549 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31728 KiB
Current children cumulated memory: 8216 KiB

[startup+0.309229 s]*
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30830184/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=32124 memory=8744 CPUtime=0.31 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 2364 0 0 0 31 0 0 0 20 0 1 0 407294699 32894976 2186 33554432000 4194304 4935366 140737093717952 140737093714952 139624408886245 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 8031 2186 614 181 0 1648 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32124 KiB
Current children cumulated memory: 8744 KiB

[startup+0.70034 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30829316/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=33728 memory=10328 CPUtime=0.69 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 2747 0 0 0 69 0 0 0 20 0 1 0 407294699 34537472 2582 33554432000 4194304 4935366 140737093717952 140737093714952 4390357 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 8432 2582 614 181 0 2049 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33728 KiB
Current children cumulated memory: 10328 KiB

[startup+1.50035 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30827484/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=36456 memory=12876 CPUtime=1.49 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 3440 0 0 0 149 0 0 0 20 0 1 0 407294699 37330944 3219 33554432000 4194304 4935366 140737093717952 140737093715720 4420601 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 9114 3219 614 181 0 2731 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 36456 KiB
Current children cumulated memory: 12876 KiB

[startup+3.10981 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30821824/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=40636 memory=17108 CPUtime=3.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 7076 0 0 0 310 0 0 0 20 0 1 0 407294699 41611264 4277 33554432000 4194304 4935366 140737093717952 140737093715720 139624408886245 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 10159 4277 614 181 0 3776 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 40636 KiB
Current children cumulated memory: 17108 KiB

[startup+6.30036 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30817484/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=45076 memory=21444 CPUtime=6.29 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 11800 0 0 0 628 1 0 0 20 0 1 0 407294699 46157824 5361 33554432000 4194304 4935366 140737093717952 140737093715704 4418767 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 11269 5361 614 181 0 4886 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 45076 KiB
Current children cumulated memory: 21444 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30810632/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=52980 memory=28888 CPUtime=12.69 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 18389 0 0 0 1267 2 0 0 20 0 1 0 407294699 54251520 7222 33554432000 4194304 4935366 140737093717952 140737093715656 4461133 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 13245 7222 614 181 0 6862 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 52980 KiB
Current children cumulated memory: 28888 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28842
/proc/meminfo: memFree=30797176/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=65084 memory=41280 CPUtime=25.49 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 36856 0 0 0 2546 3 0 0 20 0 1 0 407294699 66646016 10320 33554432000 4194304 4935366 140737093717952 140737093715640 4461247 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 16271 10320 614 181 0 9888 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 65084 KiB
Current children cumulated memory: 41280 KiB

[startup+51.1099 s]
/proc/loadavg: 2.00 2.00 1.99 3/202 28845
/proc/meminfo: memFree=30782168/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=79256 memory=55520 CPUtime=51.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 51724 0 0 0 5105 5 0 0 20 0 1 0 407294699 81158144 13880 33554432000 4194304 4935366 140737093717952 140737093715640 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 19814 13880 614 181 0 13431 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 79256 KiB
Current children cumulated memory: 55520 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 1.99 3/203 28850
/proc/meminfo: memFree=30764672/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=97748 memory=73092 CPUtime=102.28 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 71096 0 0 0 10222 6 0 0 20 0 1 0 407294699 100093952 18273 33554432000 4194304 4935366 140737093717952 140737093715640 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 24437 18273 614 181 0 18054 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 97748 KiB
Current children cumulated memory: 73092 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 1.99 3/203 28854
/proc/meminfo: memFree=30746940/32770624 swapFree=66965856/67108860
[pid=28841] ppid=28838 vsize=112320 memory=88044 CPUtime=162.25 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 92826 0 0 0 16217 8 0 0 20 0 1 0 407294699 115015680 22011 33554432000 4194304 4935366 140737093717952 140737093715464 4461250 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 28080 22011 614 181 0 21697 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 112320 KiB
Current children cumulated memory: 88044 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 1.99 3/204 28868
/proc/meminfo: memFree=30733656/32770624 swapFree=66965860/67108860
[pid=28841] ppid=28838 vsize=125720 memory=101492 CPUtime=222.24 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 97453 0 0 0 22215 9 0 0 20 0 1 0 407294699 128737280 25373 33554432000 4194304 4935366 140737093717952 140737093715704 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 31430 25373 614 181 0 25047 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 125720 KiB
Current children cumulated memory: 101492 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 1.99 3/204 28872
/proc/meminfo: memFree=30722548/32770624 swapFree=66965860/67108860
[pid=28841] ppid=28838 vsize=136408 memory=112352 CPUtime=282.24 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 104431 0 0 0 28213 11 0 0 20 0 1 0 407294699 139681792 28088 33554432000 4194304 4935366 140737093717952 140737093715704 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 34102 28088 614 181 0 27719 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 136408 KiB
Current children cumulated memory: 112352 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 1.99 3/204 28876
/proc/meminfo: memFree=30714264/32770624 swapFree=66965860/67108860
[pid=28841] ppid=28838 vsize=144544 memory=120316 CPUtime=342.23 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 113224 0 0 0 34211 12 0 0 20 0 1 0 407294699 148013056 30079 33554432000 4194304 4935366 140737093717952 140737093715704 4332508 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 36136 30079 614 181 0 29753 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 144544 KiB
Current children cumulated memory: 120316 KiB

[startup+402.3 s]
/proc/loadavg: 1.95 1.98 1.99 3/203 29007
/proc/meminfo: memFree=30879236/32770624 swapFree=66965860/67108860
[pid=28841] ppid=28838 vsize=152628 memory=128528 CPUtime=402.23 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 124029 0 0 0 40209 14 0 0 20 0 1 0 407294699 156291072 32132 33554432000 4194304 4935366 140737093717952 140737093715640 4461250 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 38157 32132 614 181 0 31774 0
Current children cumulated CPU time: 402.23 s
Current children cumulated vsize: 152628 KiB
Current children cumulated memory: 128528 KiB

[startup+462.3 s]
/proc/loadavg: 1.98 1.99 1.99 3/203 29011
/proc/meminfo: memFree=30834724/32770624 swapFree=66965860/67108860
[pid=28841] ppid=28838 vsize=159188 memory=135176 CPUtime=462.21 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 132803 0 0 0 46206 15 0 0 20 0 1 0 407294699 163008512 33794 33554432000 4194304 4935366 140737093717952 140737093715704 4461084 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 39797 33794 614 181 0 33414 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 159188 KiB
Current children cumulated memory: 135176 KiB


################
# More data... #
################

/proc/28841/statm: 60096 53737 614 181 0 53713 0
Current children cumulated CPU time: 1662.13 s
Current children cumulated vsize: 240384 KiB
Current children cumulated memory: 214948 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.04 2.03 3/203 29217
/proc/meminfo: memFree=30008696/32770624 swapFree=66965892/67108860
[pid=28841] ppid=28838 vsize=242604 memory=217116 CPUtime=1722.12 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 250307 0 0 0 172180 32 0 0 20 0 1 0 407294699 248426496 54279 33554432000 4194304 4935366 140737093717952 140737093715704 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 60651 54279 614 181 0 54268 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 242604 KiB
Current children cumulated memory: 217116 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 2.03 3/203 29221
/proc/meminfo: memFree=29986724/32770624 swapFree=66965892/67108860
[pid=28841] ppid=28838 vsize=245272 memory=220460 CPUtime=1782.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 257409 0 0 0 178177 33 0 0 20 0 1 0 407294699 251158528 55115 33554432000 4194304 4935366 140737093717952 140737093715640 4461476 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 61318 55115 614 181 0 54935 0
Current children cumulated CPU time: 1782.1 s
Current children cumulated vsize: 245272 KiB
Current children cumulated memory: 220460 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.03 3/203 29227
/proc/meminfo: memFree=29972244/32770624 swapFree=66965892/67108860
[pid=28841] ppid=28838 vsize=247044 memory=222132 CPUtime=1842.11 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 259152 0 0 0 184177 34 0 0 20 0 1 0 407294699 252973056 55533 33554432000 4194304 4935366 140737093717952 140737093715656 4450196 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 61761 55533 614 181 0 55378 0
Current children cumulated CPU time: 1842.11 s
Current children cumulated vsize: 247044 KiB
Current children cumulated memory: 222132 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/203 29231
/proc/meminfo: memFree=29945480/32770624 swapFree=66965892/67108860
[pid=28841] ppid=28838 vsize=249448 memory=224528 CPUtime=1902.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 261580 0 0 0 190176 34 0 0 20 0 1 0 407294699 255434752 56132 33554432000 4194304 4935366 140737093717952 140737093715656 4461472 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 62362 56132 614 181 0 55979 0
Current children cumulated CPU time: 1902.1 s
Current children cumulated vsize: 249448 KiB
Current children cumulated memory: 224528 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/202 29235
/proc/meminfo: memFree=29901060/32770624 swapFree=66965892/67108860
[pid=28841] ppid=28838 vsize=252008 memory=227236 CPUtime=1962.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 264587 0 0 0 196176 34 0 0 20 0 1 0 407294699 258056192 56809 33554432000 4194304 4935366 140737093717952 140737093715640 4461504 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 63002 56809 614 181 0 56619 0
Current children cumulated CPU time: 1962.1 s
Current children cumulated vsize: 252008 KiB
Current children cumulated memory: 227236 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/203 29249
/proc/meminfo: memFree=29895884/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=254244 memory=229472 CPUtime=2022.1 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 268142 0 0 0 202175 35 0 0 20 0 1 0 407294699 260345856 57368 33554432000 4194304 4935366 140737093717952 140737093715656 4450339 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 63561 57368 614 181 0 57178 0
Current children cumulated CPU time: 2022.1 s
Current children cumulated vsize: 254244 KiB
Current children cumulated memory: 229472 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/203 29253
/proc/meminfo: memFree=29892432/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=256640 memory=231888 CPUtime=2082.09 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 272308 0 0 0 208174 35 0 0 20 0 1 0 407294699 262799360 57972 33554432000 4194304 4935366 140737093717952 140737093715704 4461146 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 64160 57972 614 181 0 57777 0
Current children cumulated CPU time: 2082.09 s
Current children cumulated vsize: 256640 KiB
Current children cumulated memory: 231888 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/204 29258
/proc/meminfo: memFree=29872584/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=258872 memory=233916 CPUtime=2142.09 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 277028 0 0 0 214173 36 0 0 20 0 1 0 407294699 265084928 58479 33554432000 4194304 4935366 140737093717952 140737093715640 4461519 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 64718 58479 614 181 0 58335 0
Current children cumulated CPU time: 2142.09 s
Current children cumulated vsize: 258872 KiB
Current children cumulated memory: 233916 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/204 29264
/proc/meminfo: memFree=29853528/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=260624 memory=235712 CPUtime=2202.09 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 282030 0 0 0 220173 36 0 0 20 0 1 0 407294699 266878976 58928 33554432000 4194304 4935366 140737093717952 140737093715640 4461227 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 65156 58928 614 181 0 58773 0
Current children cumulated CPU time: 2202.09 s
Current children cumulated vsize: 260624 KiB
Current children cumulated memory: 235712 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/204 29268
/proc/meminfo: memFree=29842448/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=261992 memory=237020 CPUtime=2262.09 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 287387 0 0 0 226172 37 0 0 20 0 1 0 407294699 268279808 59255 33554432000 4194304 4935366 140737093717952 140737093715656 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 65498 59255 614 181 0 59115 0
Current children cumulated CPU time: 2262.09 s
Current children cumulated vsize: 261992 KiB
Current children cumulated memory: 237020 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/203 29273
/proc/meminfo: memFree=29829536/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=263836 memory=238940 CPUtime=2322.08 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 293221 0 0 0 232171 37 0 0 20 0 1 0 407294699 270168064 59735 33554432000 4194304 4935366 140737093717952 140737093715704 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 65959 59735 614 181 0 59576 0
Current children cumulated CPU time: 2322.08 s
Current children cumulated vsize: 263836 KiB
Current children cumulated memory: 238940 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/203 29279
/proc/meminfo: memFree=29823484/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=266784 memory=241796 CPUtime=2382.07 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 300034 0 0 0 238169 38 0 0 20 0 1 0 407294699 273186816 60449 33554432000 4194304 4935366 140737093717952 140737093715704 4461227 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 66696 60449 614 181 0 60313 0
Current children cumulated CPU time: 2382.07 s
Current children cumulated vsize: 266784 KiB
Current children cumulated memory: 241796 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/203 29279
/proc/meminfo: memFree=29822028/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=266784 memory=241980 CPUtime=2400.08 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 305505 0 0 0 239969 39 0 0 20 0 1 0 407294699 273186816 60495 33554432000 4194304 4935366 140737093717952 140737093715640 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 66696 60495 614 181 0 60313 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 266784 KiB
Current children cumulated memory: 241980 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.3 s]
# the end of solver process 28841 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.69 s, system=0.397978 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/203 29279
/proc/meminfo: memFree=29822028/32770624 swapFree=66965900/67108860
[pid=28841] ppid=28838 vsize=266784 memory=241980 CPUtime=2400.08 cores=0,2,4,6
/proc/28841/stat : 28841 (nacre_mini_rele) R 28838 28841 25882 0 -1 4202496 305505 0 0 0 239969 39 0 0 20 0 1 0 407294699 273186816 60495 33554432000 4194304 4935366 140737093717952 140737093715640 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33869824 140737093723137 140737093723237 140737093723237 140737093726146 0
/proc/28841/statm: 66696 60495 614 181 0 60313 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 266784 KiB
Current children cumulated memory: 241980 KiB

Child status: 0
Real time (s): 2400.3
CPU time (s): 2400.09
CPU user time (s): 2399.69
CPU system time (s): 0.397978
CPU usage (%): 99.9912
Max. virtual memory (cumulated for all children) (KiB): 266784
Max. memory (cumulated for all children) (KiB): 241980

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.69
system time used= 0.397978
maximum resident set size= 242040
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 305554
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 109
involuntary context switches= 3025


# summary of solver processes directly reported to runsolver:
#   pid: 28841
#   total CPU time (s): 2400.09
#   total CPU user time (s): 2399.69
#   total CPU system time (s): 0.397978

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0938 second user time and 17.9187 second system time

The end

Launcher Data 

Begin job on node135 at 2019-09-12 19:46:51
IDJOB=4391461
IDBENCH=132068
IDSOLVER=2834
FILE ID=node135/4391461-1568310451
RUNJOBID= node135-1568306240-27781
PBS_JOBID= 21701112
Free space on /tmp= 59096 MiB

SOLVER NAME= NACRE 1.0.5-Hybrid
BENCH NAME= XCSP17/Subisomorphism/Subisomorphism-m1-LV/Subisomorphism-g19-g25.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391461-1568310451/watcher-4391461-1568310451 -o /tmp/evaluation-result-4391461-1568310451/solver-4391461-1568310451 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568306240-27781 --watchdog 2560  nacre_mini_release HOME/instance-4391461-1568310451.xml -ca -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6a0b9ff28537b74082311c97fcf8fc06
RANDOM SEED=1326420684

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30835720 kB
MemAvailable:   31660972 kB
Buffers:          111344 kB
Cached:           980856 kB
SwapCached:        36128 kB
Active:           659532 kB
Inactive:         678396 kB
Active(anon):     216984 kB
Inactive(anon):    59652 kB
Active(file):     442548 kB
Inactive(file):   618744 kB
Unevictable:      109772 kB
Mlocked:          109772 kB
SwapTotal:      67108860 kB
SwapFree:       66965856 kB
Dirty:               996 kB
Writeback:             0 kB
AnonPages:        336292 kB
Mapped:            34384 kB
Shmem:             22292 kB
Slab:             190256 kB
SReclaimable:     159592 kB
SUnreclaim:        30664 kB
KernelStack:        3808 kB
PageTables:         6012 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     734164 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    288768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 59124 MiB
End job on node135 at 2019-09-12 20:26:52