crawler.monitor_checkpoint_interval

This parameter specifies the time interval at which to checkpoint, in seconds. For example, a value of 1800 would mean the webcrawler would checkpoint every 30 minutes. Checkpointing involves writing critical data structures out to disk so that the webcrawler can be restarted from that point if required.

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the crawler.monitor_checkpoint_interval key, and set the value. This can be set to any valid Integer value.