Help Center

Menu

warc.compression

Background

This option controls how content will be compressed in a WARC file. Allowed values are none and contentonly (the default).

WARC files are used to store gathered content for indexing.

Setting the key

Set this configuration key in the search package or data source configuration.

Use the configuration key editor to add or edit the warc.compression key, and set the value. This can be set to any valid WarcCompressionTypes allowed values: contentonly or none value.

Default value

warc.compression=contentonly

The default is to compress content only but not the WARC headers.

Examples

To turn off all compression (e.g. for debugging purposes):

warc.compression=none