The volumes of multimedia content and users have increased on social multimedia sites due to the prevalence of smart mobile devices and digital cameras. It is common for users to take pictures and upload them to image-sharing websites using their smartphones. However, the tag characteristics deteriorate the quality of tag-based image retrieval and decrease the reliability of social multimedia sites. In this article, we propose a semantic tag recommendation technique exploiting associated words that are semantically similar or related to each other using the interwiki links of Wikipedia. First, we generate a word relationship graph after extracting meaningful words from each article in Wikipedia. The candidate words are then rearranged according to importance by applying a link-based ranking algorithm and then the top-k words are defined as the associated words for the article. When a user uploads an image, we collect visually similar images from a social image database. After propagating the proper tags from the collected images, we recommend associated words related to the candidate tags. Our experimental results show that the proposed method can improve the accuracy by up to 14% compared with other works and that exploiting associated words makes it possible to perform semantic tag recommendation.
WagnerCSingerPStrohmaierM. Semantic stability and implicit consensus in social tagging streams. IEEE T Comput Soc Syst2014; 1(1): 108–120.
2.
LiuXQianXLuD. Personalized tag recommendation for Flickr users. In: Proceedings of the 2014 IEEE international conference on multimedia and expo, Chengdu, China, 14–18 July 2014, pp. 1–6. New York: IEEE.
3.
WangSLoDVasilescuB. EnTagRec: an enhanced tag recommendation system for software information sites. In: Proceedings of the IEEE international conference on software maintenance and evolution, Victoria, BC, Canada, 29 September–3 October 2014, pp. 291–300. New York: IEEE.
4.
FontFSerràJSerraX. Analysis of the impact of a tag recommendation system in a real-world folksonomy. ACM T Intell Syst Technol (TIST)2015; 7(1): 1–27.
5.
IvanovIVajdaPKorshunovP. Comparative study of trust modeling for automatic landmark tagging. IEEE T Inf Forensic Secur2013; 8(6): 911–923.
6.
LindstaedtSMörzingerRSorschagR. Automatic image annotation using visual content and folksonomies. Multimed Tool Appl2009; 42(1): 97–113.
7.
MishraDSinghUPRichhariyaV. Tag relevance for social image retrieval in accordance with neighbor voting algorithm. Int J Comput Sci Netw Secur2014; 14(7): 50–57.
8.
LiXSnoekCGMWorringM. Unsupervised multi-feature tag relevance learning for social image retrieval. In: Proceedings of the ACM international conference on image and video retrieval, Xi’an, China, 5–7 July 2010, pp. 10–17. New York: ACM.
9.
XuBZhuH. Tags recommending based on social graph. In: LuWCaiGLiuW (eds) Proceedings of the 2012 international conference on information technology and software engineering. Berlin, Heidelberg: Springer, 2013, pp. 403–411.
10.
BarmpoutisPKotropoulosCPliakosK. Image tag recommendation based on novel tensor structures and their decompositions. In: Proceedings of the 9th international symposium on image and signal processing and analysis, Zagreb, 7–9 September 2015, pp. 7–12.
11.
JeongJ-WHongH-KLeeD-H. i-TagRanker: an efficient tag ranking system for image sharing and retrieval using the semantic relationships between tags. Multimed Tool Appl2013; 62(2): 451–478.
12.
ImD-HParkG-D. Linked tag: image annotation using semantic relationships between image tags. Multimed Tool Appl2015; 74(7): 2273–2287.
13.
ShapiraBOfekNMakarenkovV. Exploiting Wikipedia for information retrieval tasks. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, Santiago, Chile, 9–13 August 2015, pp. 1137–1140. New York: ACM.
14.
LiuDHuaX-SYangL. Tag ranking. In: Proceedings of the 18th international conference on world wide web, Madrid, 20–24 April 2009, pp. 351–360. New York: ACM.
15.
CantadorISzomszorMAlaniH. Enriching ontological user profiles with tagging history for multi-domain recommendations. In: Proceedings of 1st international workshop on collective semantics: collective intelligence & the semantic web (CISWeb 2008), Tenerife, 1–5 June 2008, pp. 5–19. Aachen: CEUR-WS.
16.
MovahedianHKhayyambashiMR. Folksonomy-based user interest and disinterest profiling for improved recommendations: an ontological approach. J Inf Sci2014; 40(5): 594–610.
17.
LeeJ-wLeeS-gKimH-j. A probabilistic approach to semantic collaborative filtering using world knowledge. J Inf Sci2011; 37(1): 49–66.
18.
CantadorIKonstasIJoseJM. Categorising social tags to improve folksonomy-based recommendations. Web Semant2011; 9(1): 1–15.
19.
SubramaniyaswamyVChenthur PandianS. Effective tag recommendation system based on topic ontology using Wikipedia and WordNet. Int J Intell Syst2012; 27(12): 1034–1048.
20.
AllahyariMKochutK. Semantic tagging using topic models exploiting Wikipedia category network. In: Proceedings of 2016 IEEE tenth international conference on semantic computing (ICSC), Laguna Hills, CA, 4–6 February 2016, pp. 63–70. New York: IEEE.
21.
LuCLamWZhangY. Twitter user modeling and tweets recommendation based on Wikipedia concept graph. In: Proceedings of workshops at the twenty-sixth AAAI conference on artificial intelligence, Toronto, ON, Canada, 22–26 July 2012, pp. 33–38. Palo Alto: AAAI.
22.
SabetzadehFTsuiE. An effective knowledge quality framework based on knowledge resources interdependencies. VINE2015; 45(3): 360–375.
23.
ALMasriMBerrutCChevalletJP. Wikipedia-based semantic query enrichment. In: Proceedings of the sixth international workshop on exploiting semantic annotations in information retrieval, San Francisco, CA, 27 October–1 November 2013, pp. 5–8. New York: ACM.
24.
HuYJanowiczKPrasadS. Improving Wikipedia-based place name disambiguation in short texts using structured data from DBpedia. In: Proceedings of the 8th workshop on geographic information retrieval, New York, 4–7 November 2014, pp. 1–8. New York: ACM.
25.
JabeenSGaoXAndreaeP. Using Wikipedia as an external knowledge source for supporting contextual disambiguation. J Softw Eng Appl2013; 5(12): 175–180.
26.
ManjunathBSOhmJRVasudevanVV. Color and texture descriptors. IEEE T Circuit Syst Video Technol2001; 11(6): 703–715.
27.
YoungITVan VlietLJVan GinkelM. Recursive Gabor filtering. IEEE T Signal Process2002; 50(11): 2798–2805.
28.
DalalNTriggsB. Histograms of oriented gradients for human detection. In: Proceedings of 2005 IEEE Computer Society conference on computer vision and pattern recognition (CVPR’05), San Diego, CA, 20–25 June 2005, pp. 886–893. New York: IEEE.
BudanitskyAHirstG. Semantic distance in WordNet: an experimental, application-oriented evaluation of five measures. In: Proceedings of international workshop on WordNet and other lexical resources, second meeting of the North American chapter of the Association for Computational Linguistics, Pittsburgh, PA, 2–7 June 2001, pp. 29–34. Stroudsburg: ACL.
KleinbergJM. Authoritative sources in a hyperlinked environment. JACM1999; 46(5): 604–632.
37.
BrinSPageL. Reprint of: the anatomy of a large-scale hypertextual web search engine. Comput Netw2012; 56(18): 3825–3833.
38.
ChatzichristofisSABoutalisYS. FCTH: Fuzzy Color and Texture Histogram: a low level feature for accurate image retrieval. In: Proceedings of 2008 ninth international workshop on image analysis for multimedia interactive services, Klagenfurt, 7–9 May 2008, pp.191–196. New York: IEEE.
39.
ChatzichristofisSAZagorisKBoutalisYS. Accurate image retrieval based on compact composite descriptors and relevance feedback information. Int J Pattern Recognit Artif Intell2010; 24(2): 207–244.
40.
RieglerMPogorelovKLuxM. Explorative hyperbolic-tree-based clustering tool for unsupervised knowledge discovery. In: Proceedings of the 14th international workshop on content-based multimedia indexing (CBMI), Bucharest, 15–17 June 2016, pp. 1–4. New York: IEEE.
41.
ChiZYanHPhamT. Fuzzy algorithms: with applications to image processing and pattern recognition. Singapore: World Scientific, 1996.
42.
Van RijsbergenCJRobertsonSEPorterMF. New models in probabilistic information retrieval. London: Research and Development Department, British Library, 1980.
43.
JärvelinKKekäläinenJ. Cumulated gain-based evaluation of IR techniques. ACM T Inf Syst (TOIS)2002; 20(4): 422–446.
