Flickr data source
The Flickr data source is used to index content from the Flickr social media platform.
Funnelback can gather content from user and groups on Flickr. Funnelback gathers the textual data available for each photo and providing information such as the name and the link for each photo.
Please note that your usage of Funnelback to gather content from Flickr must comply with Flickr’s terms of service.
Getting API keys and tokens
Gathering Flickr content requires an API key, API secret and user authentication tokens.
The following keys are required and can be obtained from https://apps.twitter.com/:
-
OAUTH consumer key
-
Consumer secret
-
Access token
-
Access token secret
Visit https://dev.twitter.com/apps/new to create a new app and retrieve these values.
User mentions and hash-tags
User mentions and hash-tags within Flickr content can be made searchable by enabling the social tags plugin.
Metadata mappings
Flickr data sources include a number of Flickr specific metadata mappings:
| Class ID | Type | Behaviour | Explanation | Metadata fields included |
|---|---|---|---|---|
|
text |
content |
|
|
|
text |
content |
Description |
|
|
date |
date |
Date |
|
|
text |
display |
Image URL - small |
|
|
text |
display |
Image URL - medium |
|
|
text |
display |
Image URL - large |
|
|
text |
display |
Image URL - small (square) |
|
|
text |
display |
Image URL - small (320px) |
|
|
text |
display |
Image URL - medium (640px) |
`/com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto/photoMediumImage640Url ` |
|
text |
display |
Image URL - medium (800px) |
|
|
text |
display |
|
|
|
text |
display |
Thumbnail URL |
|
|
geospatial x/y co-ordinate |
N/A |
|
|
|
text |
content |
Title |
|
|
text |
display |
|
Use the -SF query processor option to access these metadata fields on the
search response and in the templates (i.e. `-SF=[author,username]).
Limits
Please note that Flickr applies limits to the volume of content which can be retrieved from their APIs, and so in the case of large photo streams Funnelback may be unable to gather all historical content.
Working with the fetched data
Funnelback will crawl Flickr and convert responses into XML. You can use the metadata customization tool to map elements to metadata classes.
To preview the crawled records please enable debug mode by setting flickr.debug=true in the data source configuration.
|
The XML that Funnelback generates for a Flickr data source is as follows:
<com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto>
<photoId>photo_id</photoId>
<url>url to photo in flickr, do not use this url to get the actual image</url>
<photoTitle>some title</photoTitle>
<photoThumbNailUrl>https://farm4.static.flickr.com/x/photo_id_qwert_t.jpg</photoThumbNailUrl>
<photoSmallImageUrl>https://farm4.static.flickr.com/x/photo_id_qwert_m.jpg</photoSmallImageUrl>
<photoSmallImage320Url>https://farm4.static.flickr.com/x/photo_id_qwert_n.jpg</photoSmallImage320Url>
<photoSmallImageSquareUrl>https://farm4.static.flickr.com/x/photo_id_qwert_s.jpg</photoSmallImageSquareUrl>
<photoMediumImageUrl>https://farm4.static.flickr.com/x/photo_id_qwert.jpg</photoMediumImageUrl>
<photoMediumImage640Url>https://farm4.static.flickr.com/x/photo_id_qwert_z.jpg</photoMediumImage640Url>
<photoMediumImage800Url>https://farm4.static.flickr.com/x/photo_id_qwert_c.jpg</photoMediumImage800Url>
<photoLargeImageUrl>https://farm4.static.flickr.com/x/photo_id_qwert_b.jpg</photoLargeImageUrl>
<photoOwnerFullName>some username</photoOwnerFullName>
<photoOwnerUserName>username</photoOwnerUserName>
</com.funnelback.socialmedia.flickr.FlickrXmlRecordPhoto>The <url> element will not give the image URL, it gives the URL of the photo inside a Flickr page. If you want to get the actual picture URL, ie something ending in .jpg, then you need to use a element whose name is <*Url>. For example <photoLargeImageUrl> will give you a URL to a large version of the picture and this could be included in a <img> HTML tag.