indexing.use_manifest

Specifies if a manifest file should be used for indexing.

Key: indexing.use_manifest
Type: Boolean
Can be set in: collection.cfg

Description

This parameter is used to control the use of a manifest file during indexing.

If set to true the indexer will look for a manifest.txt file in the log directory. This file should contain a list of file paths, one per line. The indexer will index this list of files rather than scanning over the data directory.

The manifest.txt file is produced by the Funnelback web crawler.

this option should not be used if you are using a WARCStore.

Default Value

indexing.use_manifest=false

Examples

Turn on the use of the manifest:

indexing.use_manifest=true