Help Center

Menu

gatherer.overall_gatherer_timeout

Background

This option specifies how many minutes, or hours, the gatherer is allowed to run. The option gatherer.overall_gatherer_units specifies the unit of measure.

This parameter can be left empty, in which case the gatherer will keep going until there are no URLs left in its frontier, or it reaches another limit e.g. gatherer.max_files_stored

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the gatherer.overall_gatherer_timeout key, and set the value. This can be set to any valid Integer value.

Default value

gatherer.overall_gatherer_timeout=24

Examples

If you are testing a new web data source, then it can be useful to run a short gather, say 10 minutes:

gatherer.overall_gatherer_timeout=10
gatherer.overall_gatherer_units=min

See also