crawler.max_timeout_retries
Maximum number of times to retry after a network timeout.
Key: crawler.max_timeout_retries
Type: Integer
Can be set in: collection.cfg
Table of Contents
Description
This is the maximum number of times the crawler will retry connecting to a given URL if it experiences a network timeout while trying to connect.
The crawler will wait for the value of crawler.request_timeout in between
each request to avoid overloading the server.
Examples
Increase value so that three attempts will be made to contact the URL.
crawler.max_timeout_retries=3