crawler.accept_cookies

Background

Cookies are small text files which ar normally stored by a user’s web browser to save their preferences and other information when browsing a website.

In some cases e.g. crawling dynamic websites having cookie support turned on may be useful.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.accept_cookies key, and set the value. This can be set to any valid Boolean value.

Default value

Cookie policy. Default is false i.e. do not accept cookies. Requires HTTPClient if true.

crawler.accept_cookies=true

Examples

To disable this feature set it to "false" e.g.

crawler.accept_cookies=false

See also