Flickr data source

The Flickr data source is used to index content from the Flickr social media platform.

Funnelback can gather content from user and groups on Flickr. Funnelback gathers the textual data available for each photo and providing information such as the name and the link for each photo.

Please note that your usage of Funnelback to gather content from Flickr must comply with Flickr’s terms of service.

Getting API keys and tokens

Gathering Flickr content requires an API key, API secret and user authentication tokens.

The following keys are required and can be obtained from https://apps.twitter.com/:

  • OAUTH consumer key

  • Consumer secret

  • Access token

  • Access token secret

Visit https://dev.twitter.com/apps/new to create a new app and retrieve these values.

Configuration options

Flickr data sources support the following configuration options:

Standard options

Option Description

Advanced options

Option Description

Filter options

Option Description

User mentions and hash-tags

User mentions and hash-tags within Flickr content can be made searchable by enabling the social tags plugin.

Metadata mappings

Flickr data sources include a number of Flickr specific metadata mappings:

Class ID Type Behaviour Explanation Metadata fields included

author

text

content

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoOwnerFullName, /com.funnelback.socialmedia.flickr.FlickrXmlRecordPhotoset/ownwer/realName

c

text

content

Description

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoDescription, /com.funnelback.socialmedia.flickr.FlickrXmlRecordPhotoset/description

d

date

date

Date

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhotoset/dateUpdated

imageSmall

text

display

Image URL - small

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoSmallImageUrl

imageMedium

text

display

Image URL - medium

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoMediumImageUrl

imageLarge

text

display

Image URL - large

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoLargeImageUrl

imageSquare

text

display

Image URL - small (square)

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoSmallImageSquareUrl

image320Pixels

text

display

Image URL - small (320px)

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoSmallImage320Url

image640Pixels

text

display

Image URL - medium (640px)

`/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoMediumImage640Url `

image800Pixels

text

display

Image URL - medium (800px)

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoMediumImage800Url

imageId

text

display

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoId

imageThumbnail

text

display

Thumbnail URL

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoThumbNailUrl

latLong

geospatial x/y co-ordinate

N/A

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhotoset/photoLatLong

t

text

content

Title

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoTitle, /com.funnelback.socialmedia.flickr.FlickrXmlRecordPhotoset/title

username

text

display

/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoOwnerUserName, /com.funnelback.socialmedia.flickr.FlickrXmlRecordPhotoset/ownwer/username

Use the -SF query processor option to access these metadata fields on the search response and in the templates (i.e. `-SF=[author,username]).

Limits

Please note that Flickr applies limits to the volume of content which can be retrieved from their APIs, and so in the case of large photo streams Funnelback may be unable to gather all historical content.

Working with the fetched data

Funnelback will crawl Flickr and convert responses into XML. You can use the metadata customization tool to map elements to metadata classes.

To preview the crawled records please enable debug mode by setting flickr.debug=true in the data source configuration.

The XML that Funnelback generates for a Flickr data source is as follows:

<com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto>
  <photoId>photo_id</photoId>
  <url>url to photo in flickr, do not use this url to get the actual image</url>
  <photoTitle>some title</photoTitle>
  <photoThumbNailUrl>https://farm4.static.flickr.com/x/photo_id_qwert_t.jpg</photoThumbNailUrl>
  <photoSmallImageUrl>https://farm4.static.flickr.com/x/photo_id_qwert_m.jpg</photoSmallImageUrl>
  <photoSmallImage320Url>https://farm4.static.flickr.com/x/photo_id_qwert_n.jpg</photoSmallImage320Url>
  <photoSmallImageSquareUrl>https://farm4.static.flickr.com/x/photo_id_qwert_s.jpg</photoSmallImageSquareUrl>
  <photoMediumImageUrl>https://farm4.static.flickr.com/x/photo_id_qwert.jpg</photoMediumImageUrl>
  <photoMediumImage640Url>https://farm4.static.flickr.com/x/photo_id_qwert_z.jpg</photoMediumImage640Url>
  <photoMediumImage800Url>https://farm4.static.flickr.com/x/photo_id_qwert_c.jpg</photoMediumImage800Url>
  <photoLargeImageUrl>https://farm4.static.flickr.com/x/photo_id_qwert_b.jpg</photoLargeImageUrl>
  <photoOwnerFullName>some username</photoOwnerFullName>
  <photoOwnerUserName>username</photoOwnerUserName>
</com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto>

The <url> element will not give the image URL, it gives the URL of the photo inside a Flickr page. If you want to get the actual picture URL, ie something ending in .jpg, then you need to use a element whose name is <*Url>. For example <photoLargeImageUrl> will give you a URL to a large version of the picture and this could be included in a <img> HTML tag.

See also