crawler.request_timeout

Background

This is the maximum number of milliseconds that the crawler will wait for a HTTP GET request to return. If the web server does not start to return the page in question before this timeout, the crawler assumes the page was unavailable.

This value is multiplied by 4 to give the parser (link extraction) timeout.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.request_timeout key, and set the value. This can be set to any valid Integer value.

Default value

crawler.request_timeout=15000