indexing.use_manifest
Specifies if a manifest file should be used for indexing.
Key: indexing.use_manifest
Type: Boolean
Can be set in: collection.cfg
Table of Contents
Description
This parameter is used to control the use of a manifest file during indexing.
If set to true the indexer will look for a manifest.txt
file in the log directory. This file should
contain a list of file paths, one per line. The indexer will index this list of files rather than scanning
over the data directory.
The manifest.txt
file is produced by the Funnelback web crawler.
this option should not be used if you are using a WARCStore. |