crawler.max_files_per_server
Specifies the maximum number of files that will be crawled per server.
Key: crawler.max_files_per_server
Type: Integer
Can be set in: collection.cfg
Table of Contents
Description
This option sets a limit on the maximum number of files downloaded from any single server during a crawl.
Default Value
The default setting for this parameter is empty i.e. no explicit limit set.
crawler.max_files_per_server=