crawler.cache.DNSCache_max_size
Maximum size of internal DNS cache. Upon reaching this size the cache will drop old elements.
Key: crawler.cache.DNSCache_max_size
Type: Integer
Can be set in: collection.cfg
Table of Contents
Description
This is the maximum size of the DNS cache used during the crawl. When this limit is reached the least recently used elements in the cache will be dropped. The DNS cache is used to store DNS (domain name system) information on hostnames encountered during the crawl e.g. hostname and IP address.
Unless you are doing very large crawls you will not normally need to increase this value.