crawler.form_interaction.pre_crawl.[groupId].url

Specifies a URL of the page containing the HTML web form for a pre-crawl form interaction rule.

Key: crawler.form_interaction.pre_crawl.[groupId].url
Type: String
Can be set in: collection.cfg

Description

This parameter specifies the URL of a page which contains a HTML web form when using pre-crawl form interaction.

A groupID must be set when configuring this setting to link this to the other options for this rule.

In the pre crawl mode, the webcrawler logs in once at the start of the crawl in order to get a set of authentication cookie(s). These can then be used during the crawl in order to get access to authenticated content.

Configuration parameters for a rule are grouped using a groupId value common across all settings that make up the rule.

Default Value

None.

Examples

Configure a form interaction rule that applies to https://www.example.com/login.

crawler.form_interaction.pre_crawl.1.url=https://www.example.com/login

© 2015- Squiz Pty Ltd