crawler.send-http-basic-credentials-without-challenge
Background
| Historically, the Funnelback web crawler has sent configured HTTP basic credentials to websites without requiring a 401 challenge from the website first. This behavior is higher performance, and avoids issues with sites that do not issue challenges as expected, but risks unnecessarily sending HTTP Basic credentials to URLs which do not require them. |
This option allows this behavior to be switched between waiting for a challenge or blindly sending credentials.
Setting the key
Set this configuration key in the search package or data source configuration.
Use the configuration key editor to add or edit the crawler.send-http-basic-credentials-without-challenge key, and set the value. This can be set to any valid Boolean value.