crawler.form_interaction.pre_crawl.cookies
Background
This parameter specifies which pre-crawl form interaction rule should be used to authenticate external web crawler for websites where JavaScript generates the form.
Cookies obtained from logging into the form will be passed with each request done by a crawler.
The value is a [GROUP_ID]
used to define the pre-crawl form interaction rule.
Examples
To use pre-crawl form interaction configuration keys grouped using a GROUP_ID=1
(i.e. crawler.form_interaction.pre_crawl.1.*
)
set value to 1
:
crawler.form_interaction.pre_crawl.cookies=1