Help Center

Menu

gatherer.max_files_stored

Background

This parameter is used to specify an optional value for the maximum number of files the gatherer should download during the gatherer. If this limit is specified and reached then the gatherer will halt cleanly at that point, even if there are more URLs in the frontier. the gatherer will not download any more content from the max_timeout_retries relevant site or domain.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the gatherer.max_files_stored key, and set the value. This can be set to any valid Integer value.

Default value

By default, the value for this is empty i.e. no limit specified.

gatherer.max_files_stored=

Examples

Limit gatherer to 50,000 files:

gatherer.max_files_stored=50000

See also