crawler.max_files_per_server

Background

This option sets a limit on the maximum number of files downloaded from any single server during a crawl.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.max_files_per_server key, and set the value. This can be set to any valid Integer value.

Default value

The default setting for this parameter is empty i.e. no explicit limit set.

crawler.max_files_per_server=

Examples

Limit to 50,000 files:

crawler.max_files_per_server=50000

See also