crawler.monitor_authentication_cookie_renewal_interval

Specifies the time interval at which to renew crawl authentication cookies.

Key: crawler.monitor_authentication_cookie_renewal_interval
Type: Integer
Can be set in: collection.cfg

Description

This optional parameter specifies the time interval at which to renew authentication cookies in a web crawl, in seconds. For example, a value of 1800 would mean the webcrawler would renew the cookies every 30 minutes. This would normally be done by using the information in a [form_interaction_file.cfg]crawler.form_interaction.pre_crawl.[groupId].url to generate the cookies.

: You should only use this parameter if using [pre-crawl authentication]crawler.form_interaction.pre_crawl.[groupId].url.

Default Value

Empty

The default behaviour is not to renew the cookies.

Examples

If you know that your site’s authentication cookies expire every 3 hours then you might specify that the crawler should renew the cookies every 2.5 hours (4500 seconds) e.g.

crawler.monitor_authentication_cookie_renewal_interval=4500

© 2015- Squiz Pty Ltd