crawler.request_header_url_prefix

This parameter can be used to specify an optional URL prefix to be applied to the crawler.request_header parameter.

If defined and non-empty then only URLs which start with this prefix will be requested with the additional request header. Otherwise, the request header will be sent with all outgoing requests if defined.

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.request_header_url_prefix key, and set the value. This can be set to any valid String value.

Specify that the defined crawler.request_header should only be sent in requests to URLs which start with http://example.com/forums/