crawler.follow_links_in_comments

Background

This parameter controls whether the webcrawler should follow links found inside HTML comments.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.follow_links_in_comments key, and set the value. This can be set to any valid Boolean value.

Default value

crawler.follow_links_in_comments=false

The default behaviour is false i.e. do not follow commented-out links.

Notes

This parameter does not apply to links extracted from Javascript code - please see the separate crawler.extract_links_from_javascript parameter to control the behaviour of following links in Javascript (which sometimes appears in HTML comments).

See also