crawler.cache.URLCache_max_size
Specifies the maximum size of URLCache.
Key: crawler.cache.URLCache_max_size
Type: Integer
Can be set in: collection.cfg
Description
This is the maximum size of the URL cache which records all URLs seen during the crawl (whether downloaded or not). This directive may be ignored by some cache implementations.