Trace number 4391470

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5-Hybrid? (TO) 2400.09 2400.12

General information on the benchmark

NameSubisomorphism/Subisomorphism-m1-LV/
Subisomorphism-g10-g15.xml
MD5SUMc61674a03ec016e027955a3fd45acfb3
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.009808
Satisfiable
(Un)Satisfiability was proved
Number of variables41
Number of constraints122
Number of domains1
Minimum domain size50
Maximum domain size50
Distribution of domain sizes[{"size":50,"count":41}]
Minimum variable degree3
Maximum variable degree11
Distribution of variable degrees[{"degree":3,"count":1},{"degree":4,"count":6},{"degree":5,"count":10},{"degree":6,"count":14},{"degree":7,"count":4},{"degree":8,"count":4},{"degree":10,"count":1},{"degree":11,"count":1}]
Minimum constraint arity1
Maximum constraint arity41
Distribution of constraint arities[{"arity":1,"count":41},{"arity":2,"count":80},{"arity":41,"count":1}]
Number of extensional constraints121
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":121},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.5
2400.06/2400.11	c
2400.06/2400.11	c # time = 2400.07
2400.06/2400.11	c # Dec = 1872748
2400.06/2400.11	c # Propagate Calls = 3564386451
2400.06/2400.11	c # assignAt Calls = 5556081
2400.06/2400.11	c # removeAt Calls = 335300927
2400.06/2400.11	c # Run = 3580
2400.06/2400.11	c # Conflicts = 1840014
2400.06/2400.11	c # Memory used = 231.9 Mb
2400.06/2400.11	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9796 MiB free)
  memory of node 1: 16384 MiB (7852 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391470-1568310232/watcher-4391470-1568310232 -o /tmp/evaluation-result-4391470-1568310232/solver-4391470-1568310232 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node140-1568307582-20541 --watchdog 2560 nacre_mini_release HOME/instance-4391470-1568310232.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22205, runsolver pid=22202
Current StackSize limit: 8192 KiB


[startup+0.100197 s]*
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18070024/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=29272 memory=5844 CPUtime=0.1 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1646 0 0 0 10 0 0 0 20 0 1 0 406961664 29974528 1461 33554432000 4194304 4935366 140722769493648 140722769490648 140119552003045 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 7318 1461 613 181 0 935 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29272 KiB
Current children cumulated memory: 5844 KiB

[startup+0.209925 s]*
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18069052/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=30064 memory=6636 CPUtime=0.21 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1863 0 0 0 21 0 0 0 20 0 1 0 406961664 30785536 1659 33554432000 4194304 4935366 140722769493648 140722769491416 140119552003045 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 7516 1659 613 181 0 1133 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30064 KiB
Current children cumulated memory: 6636 KiB

[startup+0.309209 s]*
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18068308/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=30900 memory=7392 CPUtime=0.31 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 2061 0 0 0 31 0 0 0 20 0 1 0 406961664 31641600 1848 33554432000 4194304 4935366 140722769493648 140722769491416 4331470 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 7725 1848 613 181 0 1342 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30900 KiB
Current children cumulated memory: 7392 KiB

[startup+0.700344 s]
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18066820/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=33728 memory=10196 CPUtime=0.69 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 2750 0 0 0 69 0 0 0 20 0 1 0 406961664 34537472 2549 33554432000 4194304 4935366 140722769493648 140722769491416 140119552003045 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 8432 2549 613 181 0 2049 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33728 KiB
Current children cumulated memory: 10196 KiB

[startup+1.50036 s]
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18063968/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=38300 memory=14508 CPUtime=1.49 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 3902 0 0 0 149 0 0 0 20 0 1 0 406961664 39219200 3627 33554432000 4194304 4935366 140722769493648 140722769491416 140119552003045 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 9575 3627 613 181 0 3192 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 38300 KiB
Current children cumulated memory: 14508 KiB

[startup+3.10966 s]
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18055164/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=44168 memory=20692 CPUtime=3.1 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 8824 0 0 0 309 1 0 0 20 0 1 0 406961664 45228032 5173 33554432000 4194304 4935366 140722769493648 140722769491352 4450177 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 11042 5173 613 181 0 4659 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 44168 KiB
Current children cumulated memory: 20692 KiB

[startup+6.30035 s]
/proc/loadavg: 2.07 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18047852/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=51896 memory=27944 CPUtime=6.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 15537 0 0 0 628 2 0 0 20 0 1 0 406961664 53141504 6986 33554432000 4194304 4935366 140722769493648 140722769491400 4461120 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 12974 6986 613 181 0 6591 0
Current children cumulated CPU time: 6.3 s
Current children cumulated vsize: 51896 KiB
Current children cumulated memory: 27944 KiB

[startup+12.7004 s]
/proc/loadavg: 2.06 2.03 1.96 3/200 22206
/proc/meminfo: memFree=18037436/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=60556 memory=36636 CPUtime=12.69 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 24323 0 0 0 1267 2 0 0 20 0 1 0 406961664 62009344 9159 33554432000 4194304 4935366 140722769493648 140722769491400 4461080 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 15139 9159 613 181 0 8756 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 60556 KiB
Current children cumulated memory: 36636 KiB

[startup+25.5004 s]
/proc/loadavg: 2.05 2.03 1.96 3/200 22208
/proc/meminfo: memFree=18022844/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=71416 memory=47816 CPUtime=25.49 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 46130 0 0 0 2546 3 0 0 20 0 1 0 406961664 73129984 11954 33554432000 4194304 4935366 140722769493648 140722769491336 4461069 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 17854 11954 613 181 0 11471 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 71416 KiB
Current children cumulated memory: 47816 KiB

[startup+51.1098 s]
/proc/loadavg: 2.03 2.03 1.96 3/200 22208
/proc/meminfo: memFree=18004388/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=85348 memory=61760 CPUtime=51.1 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 62790 0 0 0 5105 5 0 0 20 0 1 0 406961664 87396352 15440 33554432000 4194304 4935366 140722769493648 140722769491336 4461133 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 21337 15440 613 181 0 14954 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 85348 KiB
Current children cumulated memory: 61760 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 1.96 3/200 22212
/proc/meminfo: memFree=17977956/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=102816 memory=78048 CPUtime=102.29 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 83144 0 0 0 10221 8 0 0 20 0 1 0 406961664 105283584 19512 33554432000 4194304 4935366 140722769493648 140722769491352 4461250 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 25704 19512 613 181 0 19321 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 102816 KiB
Current children cumulated memory: 78048 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.01 1.96 3/200 22218
/proc/meminfo: memFree=17954036/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=116172 memory=91816 CPUtime=162.28 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 106185 0 0 0 16219 9 0 0 20 0 1 0 406961664 118960128 22954 33554432000 4194304 4935366 140722769493648 140722769491336 4461069 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 29043 22954 613 181 0 22660 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 116172 KiB
Current children cumulated memory: 91816 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/200 22222
/proc/meminfo: memFree=17932456/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=127004 memory=102688 CPUtime=222.29 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 131671 0 0 0 22217 12 0 0 20 0 1 0 406961664 130052096 25672 33554432000 4194304 4935366 140722769493648 140722769491336 140119552746914 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 31751 25672 613 181 0 25368 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 127004 KiB
Current children cumulated memory: 102688 KiB

[startup+282.3 s]
/proc/loadavg: 1.96 2.00 1.96 3/200 22226
/proc/meminfo: memFree=17914892/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=135784 memory=111440 CPUtime=282.29 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 159076 0 0 0 28216 13 0 0 20 0 1 0 406961664 139042816 27860 33554432000 4194304 4935366 140722769493648 140722769491352 4461069 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 33946 27860 613 181 0 27563 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 135784 KiB
Current children cumulated memory: 111440 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 1.96 3/199 22232
/proc/meminfo: memFree=17898692/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=144008 memory=119696 CPUtime=342.29 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 188513 0 0 0 34214 15 0 0 20 0 1 0 406961664 147464192 29924 33554432000 4194304 4935366 140722769493648 140722769491160 4450992 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 36002 29924 613 181 0 29619 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 144008 KiB
Current children cumulated memory: 119696 KiB

[startup+402.3 s]
/proc/loadavg: 1.99 2.00 1.96 3/199 22236
/proc/meminfo: memFree=17882392/32770624 swapFree=66999144/67108860
[pid=22205] ppid=22202 vsize=150136 memory=125980 CPUtime=402.29 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 219372 0 0 0 40212 17 0 0 20 0 1 0 406961664 153739264 31495 33554432000 4194304 4935366 140722769493648 140722769491160 4420649 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 37534 31495 613 181 0 31151 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 150136 KiB
Current children cumulated memory: 125980 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.96 3/200 22248
/proc/meminfo: memFree=17872556/32770624 swapFree=66999148/67108860
[pid=22205] ppid=22202 vsize=156536 memory=132300 CPUtime=462.29 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 251818 0 0 0 46210 19 0 0 20 0 1 0 406961664 160292864 33075 33554432000 4194304 4935366 140722769493648 140722769491336 4461218 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 39134 33075 613 181 0 32751 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 156536 KiB
Current children cumulated memory: 132300 KiB


################
# More data... #
################

/proc/22205/statm: 58543 51976 613 181 0 52160 0
Current children cumulated CPU time: 1662.3 s
Current children cumulated vsize: 234172 KiB
Current children cumulated memory: 207904 KiB

[startup+1722.3 s]
/proc/loadavg: 2.07 2.05 2.02 3/200 22387
/proc/meminfo: memFree=17698792/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=236632 memory=210412 CPUtime=1722.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1183889 0 0 0 172151 79 0 0 20 0 1 0 406961664 242311168 52603 33554432000 4194304 4935366 140722769493648 140722769491336 4461250 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 59158 52603 613 181 0 52775 0
Current children cumulated CPU time: 1722.3 s
Current children cumulated vsize: 236632 KiB
Current children cumulated memory: 210412 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.04 2.02 3/200 22393
/proc/meminfo: memFree=17691136/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=238232 memory=212092 CPUtime=1782.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1235561 0 0 0 178149 81 0 0 20 0 1 0 406961664 243949568 53023 33554432000 4194304 4935366 140722769493648 140722769491400 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 59558 53023 613 181 0 53175 0
Current children cumulated CPU time: 1782.3 s
Current children cumulated vsize: 238232 KiB
Current children cumulated memory: 212092 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.04 2.02 3/200 22397
/proc/meminfo: memFree=17685144/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=240844 memory=214648 CPUtime=1842.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1288032 0 0 0 184147 83 0 0 20 0 1 0 406961664 246624256 53662 33554432000 4194304 4935366 140722769493648 140722769491336 4461069 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 60211 53662 613 181 0 53828 0
Current children cumulated CPU time: 1842.3 s
Current children cumulated vsize: 240844 KiB
Current children cumulated memory: 214648 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.02 3/200 22401
/proc/meminfo: memFree=17679004/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=242388 memory=216108 CPUtime=1902.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1340754 0 0 0 190142 88 0 0 20 0 1 0 406961664 248205312 54027 33554432000 4194304 4935366 140722769493648 140722769491336 4389978 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 60597 54027 613 181 0 54214 0
Current children cumulated CPU time: 1902.3 s
Current children cumulated vsize: 242388 KiB
Current children cumulated memory: 216108 KiB

[startup+1962.3 s]
/proc/loadavg: 2.05 2.04 2.03 3/199 22407
/proc/meminfo: memFree=17660912/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=244528 memory=218332 CPUtime=1962.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1393999 0 0 0 196140 90 0 0 20 0 1 0 406961664 250396672 54583 33554432000 4194304 4935366 140722769493648 140722769491160 4461261 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 61132 54583 613 181 0 54749 0
Current children cumulated CPU time: 1962.3 s
Current children cumulated vsize: 244528 KiB
Current children cumulated memory: 218332 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.03 2.03 3/199 22411
/proc/meminfo: memFree=17648948/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=247464 memory=221320 CPUtime=2022.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1447936 0 0 0 202136 94 0 0 20 0 1 0 406961664 253403136 55330 33554432000 4194304 4935366 140722769493648 140722769491336 4420612 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 61866 55330 613 181 0 55483 0
Current children cumulated CPU time: 2022.3 s
Current children cumulated vsize: 247464 KiB
Current children cumulated memory: 221320 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.03 2.03 3/199 22415
/proc/meminfo: memFree=17638900/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=248988 memory=222924 CPUtime=2082.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1502327 0 0 0 208133 97 0 0 20 0 1 0 406961664 254963712 55731 33554432000 4194304 4935366 140722769493648 140722769491400 4461146 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 62247 55731 613 181 0 55864 0
Current children cumulated CPU time: 2082.3 s
Current children cumulated vsize: 248988 KiB
Current children cumulated memory: 222924 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/199 22421
/proc/meminfo: memFree=17634964/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=250536 memory=224400 CPUtime=2142.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1557129 0 0 0 214131 99 0 0 20 0 1 0 406961664 256548864 56100 33554432000 4194304 4935366 140722769493648 140722769491352 4461252 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 62634 56100 613 181 0 56251 0
Current children cumulated CPU time: 2142.3 s
Current children cumulated vsize: 250536 KiB
Current children cumulated memory: 224400 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/199 22425
/proc/meminfo: memFree=17628356/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=252064 memory=225956 CPUtime=2202.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1612333 0 0 0 220127 103 0 0 20 0 1 0 406961664 258113536 56489 33554432000 4194304 4935366 140722769493648 140722769491160 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 63016 56489 613 181 0 56633 0
Current children cumulated CPU time: 2202.3 s
Current children cumulated vsize: 252064 KiB
Current children cumulated memory: 225956 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 22437
/proc/meminfo: memFree=17625388/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=253796 memory=227712 CPUtime=2262.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1667873 0 0 0 226123 107 0 0 20 0 1 0 406961664 259887104 56928 33554432000 4194304 4935366 140722769493648 140722769491336 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 63449 56928 613 181 0 57066 0
Current children cumulated CPU time: 2262.3 s
Current children cumulated vsize: 253796 KiB
Current children cumulated memory: 227712 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 22443
/proc/meminfo: memFree=17616592/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=255200 memory=229128 CPUtime=2322.3 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1723703 0 0 0 232120 110 0 0 20 0 1 0 406961664 261324800 57282 33554432000 4194304 4935366 140722769493648 140722769491336 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 63800 57282 613 181 0 57417 0
Current children cumulated CPU time: 2322.3 s
Current children cumulated vsize: 255200 KiB
Current children cumulated memory: 229128 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 22507
/proc/meminfo: memFree=21722412/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=257352 memory=231376 CPUtime=2382.27 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1780120 0 0 0 238113 114 0 0 20 0 1 0 406961664 263528448 57844 33554432000 4194304 4935366 140722769493648 140722769491336 4461483 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 64338 57844 613 181 0 57955 0
Current children cumulated CPU time: 2382.27 s
Current children cumulated vsize: 257352 KiB
Current children cumulated memory: 231376 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 22508
/proc/meminfo: memFree=21717328/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=257880 memory=231896 CPUtime=2400.06 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1810731 0 0 0 239891 115 0 0 20 0 1 0 406961664 264069120 57974 33554432000 4194304 4935366 140722769493648 140722769491352 4461174 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 64470 57974 613 181 0 58087 0
Current children cumulated CPU time: 2400.06 s
Current children cumulated vsize: 257880 KiB
Current children cumulated memory: 231896 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.12 s]
# the end of solver process 22205 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2398.92 s, system=1.166 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 22508
/proc/meminfo: memFree=21717328/32770624 swapFree=66999156/67108860
[pid=22205] ppid=22202 vsize=257880 memory=231896 CPUtime=2400.06 cores=0,2,4,6
/proc/22205/stat : 22205 (nacre_mini_rele) R 22202 22205 20510 0 -1 4202496 1810731 0 0 0 239891 115 0 0 20 0 1 0 406961664 264069120 57974 33554432000 4194304 4935366 140722769493648 140722769491352 4461174 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 30453760 140722769499137 140722769499237 140722769499237 140722769502146 0
/proc/22205/statm: 64470 57974 613 181 0 58087 0
Current children cumulated CPU time: 2400.06 s
Current children cumulated vsize: 257880 KiB
Current children cumulated memory: 231896 KiB

Child status: 0
Real time (s): 2400.12
CPU time (s): 2400.09
CPU user time (s): 2398.92
CPU system time (s): 1.166
CPU usage (%): 99.9986
Max. virtual memory (cumulated for all children) (KiB): 257880
Max. memory (cumulated for all children) (KiB): 231896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.92
system time used= 1.166
maximum resident set size= 231972
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1810779
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54
involuntary context switches= 1810


# summary of solver processes directly reported to runsolver:
#   pid: 22205
#   total CPU time (s): 2400.09
#   total CPU user time (s): 2398.92
#   total CPU system time (s): 1.166

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.98829 second user time and 17.8363 second system time

The end

Launcher Data 

Begin job on node140 at 2019-09-12 19:43:12
IDJOB=4391470
IDBENCH=131768
IDSOLVER=2834
FILE ID=node140/4391470-1568310232
RUNJOBID= node140-1568307582-20541
PBS_JOBID= 21701122
Free space on /tmp= 56868 MiB

SOLVER NAME= NACRE 1.0.5-Hybrid
BENCH NAME= XCSP17/Subisomorphism/Subisomorphism-m1-LV/Subisomorphism-g10-g15.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391470-1568310232/watcher-4391470-1568310232 -o /tmp/evaluation-result-4391470-1568310232/solver-4391470-1568310232 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node140-1568307582-20541 --watchdog 2560  nacre_mini_release HOME/instance-4391470-1568310232.xml -ca -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c61674a03ec016e027955a3fd45acfb3
RANDOM SEED=120948784

node140.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18074184 kB
MemAvailable:   27931564 kB
Buffers:          145332 kB
Cached:          9887700 kB
SwapCached:         2876 kB
Active:          5478552 kB
Inactive:        8484324 kB
Active(anon):    3926920 kB
Inactive(anon):    43924 kB
Active(file):    1551632 kB
Inactive(file):  8440400 kB
Unevictable:      107728 kB
Mlocked:          107728 kB
SwapTotal:      67108860 kB
SwapFree:       66999144 kB
Dirty:               924 kB
Writeback:             0 kB
AnonPages:       4033856 kB
Mapped:            43360 kB
Shmem:             32120 kB
Slab:             323848 kB
SReclaimable:     293808 kB
SUnreclaim:        30040 kB
KernelStack:        3552 kB
PageTables:        13416 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    4475404 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 56868 MiB
End job on node140 at 2019-09-12 20:23:12