crawler.form_interaction.pre_crawl.cookies

Background

This parameter specifies which pre-crawl form interaction rule should be used to authenticate external web crawler for websites where JavaScript generates the form.

Cookies obtained from logging into the form will be passed with each request done by a crawler.

The value is a [GROUP_ID] used to define the pre-crawl form interaction rule.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.form_interaction.pre_crawl.cookies key, and set the value. This can be set to any valid Integer value.

Default value

None.

Examples

To use pre-crawl form interaction configuration keys grouped using a GROUP_ID=1 (i.e. crawler.form_interaction.pre_crawl.1.*) set value to 1:

crawler.form_interaction.pre_crawl.cookies=1