Configure the higher education data sources

This guide applies to the Squiz Experience Cloud version of Funnelback for higher education. See the v15.x Funnelback for higher education documentation for earlier releases.

Configuration of each data source involves a number of steps and is dependent on the type of data source.

Generally, for each data source:

  • Review the data source gather settings such as the seed URL, include and exclude rules.

  • Add any required API keys and tokens.

  • Review the data source metadata class mappings.

Data source gather settings

Ensure that all of the settings relating to gathering are correctly updated.

For web type data sources this includes setting:

  • The start URL

  • include and exclude patterns

  • other web crawler settings

For social media type data sources this includes:

  • Configuring the channel/feed/source IDs.

  • Configuring the API keys and tokens.

  • Setting other data source specific settings.

For custom type data sources this includes:

  • Enabling and configuring the appropriate custom gather plugins.

  • Setting other data source specific settings.

Metadata class mappings

Each data source included as part of Funnelback for higher education has a corresponding set of pre-defined metadata class mappings. These metadata class names should be used, where possible, as they are already configured within the results page templates.

For each of the data sources:

  • Identify what metadata can be mapped to the pre-defined metadata classes and update the metadata class mappings to include these metadata fields.

  • Identify what additional metadata is required for the search and add these as additional metadata class mappings.

As an example, some of the pre-defined metadata fields for different content sources include:

  • Courses: courseSubject, courseNumber, courseDesc, courseTerm, etc.

  • People: peopleFirstName, peopleLastName, peoplePosition, peopleEmail, etc.

  • Events: eventStartTime, eventLocation, eventCategory, etc.