crawler.form_interaction.pre_crawl.[groupId].encrypted.[urlParameterKey]
Background
Specifies a form parameter for pre-crawl authentication. Form parameters set using this option will be stored within the collection configuration in an encrypted form and also be obfuscated when viewing the parameter in the administration dashboard, or by viewing the configuration file on disk.
This setting should be used to pass any sensitive form parameters such as passwords and API keys.
crawler.form_interaction.pre_crawl.[groupId].cleartext.[urlParameterKey]
can be used to
specify the non-sensitive form parameters.
Encrypted values can also be generated using the admin API.
Once the value has been encrypted it is not possible to view the original value and any changes will require you to set the value again (rather than edit it).
The web crawler decrypts the values before passing them to the specified form.
Configuration parameters for a rule are grouped using a [GROUP_ID]
value common across all settings that make up the rule (group ID must be a number).
This setting is used in conjunction with the crawler.form_interaction.pre_crawl.[groupId].url
and crawler.form_interaction.pre_crawl.[groupId].form_number
keys.
Examples
Specify the crawler to process the 2nd form of the https://www.example.com/login
page
with an encrypted password
parameter.
crawler.form_interaction.pre_crawl.1.url=https://www.example.com/login
crawler.form_interaction.pre_crawl.1.form_number=2
crawler.form_interaction.pre_crawl.1.encrypted.password=ENCRYPTED:AV/mN4XBeymvW1yXi/Xu5tPoznug3zk98qDyYIPbGM0x93ZrFA==