crawler.cache.DNSCache_max_size

Background

This is the maximum size of the DNS cache used during the crawl. When this limit is reached the least recently used elements in the cache will be dropped. The DNS cache is used to store DNS (domain name system) information on hostnames encountered during the crawl e.g. hostname and IP address.

Unless you are doing very large crawls you will not normally need to increase this value.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.cache.DNSCache_max_size key, and set the value. This can be set to any valid Integer value.

Default value

crawler.cache.DNSCache_max_size=200000

See also