crawler.check_alias_exists

This parameter controls whether to check if an aliased URL exists. During the course of a crawl we may detect a server as an alias of another e.g. home.example.com is an alias of www.example.com.

If this parameter is set to true then we will use a HTTP HEAD request to check if the aliased URL is there before making a full request. If the aliased URL does not exist we will then revert to the original URL.

This results in extra HTTP requests so the default setting is false i.e. we do not normally run this check as it is usually not required.

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.check_alias_exists key, and set the value. This can be set to any valid Boolean value.