Crawler Secondary Store Root (collection.cfg)
This parameter is used to specify the location of a secondary storage area e.g. data stored from previous crawls. This data can then be used in incremental crawling, where the webcrawler will check the secondary store and not download content from the web which hasn't changed.
For example, this can be pointed at a "live" data directory and the crawler will make use of this data when crawling into the offline data area.
NB: Path should not include protocol or server names e.g. use something like
/opt/cache/data and NOT
When a web collection is created the Funnelback administration interface will insert the correct location for this parameter.
For example, location of live data area for a given collection: