crawler.monitor_delay_type

Background

This parameter specifies what type of delay the webcrawler will use between each request to a web server. There are two types of delay supported:

  • dynamic: (default) Calculate delay based on time taken for previous request to this server.

  • fixed: Use the same fixed delay after each request.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.monitor_delay_type key, and set the value. This can be set to any valid MonitorDelayTypes allowed values: dynamic or fixed value.

Default value

crawler.monitor_delay_type=dynamic

Examples

Change to a fixed delay:

crawler.monitor_delay_type=fixed