This paper examines a large number of failed queries submitted to a web image search engine, including real users' search terms and written requests. The results show that failed image queries have a much higher specificity than successful queries because users often employ various refined types to specify their queries. The study explores the refined types further, and finds that failed queries consist of far more conceptual than perceptual refined types. The widely used content-based image retrieval technique, CBIR, can only deal with a small proportion of failed queries; hence, appropriate integration of concept-based techniques is desirable. Based on using the concepts of uniqueness and refinement for categorization, the study also provides a useful discussion on the gaps between image queries and retrieval techniques. The initial results enhance the understanding of failed queries and suggest possible ways to improve image retrieval systems.
E. Rasmussen , Indexing images, Annual Review of Information Science and Technology32 (1997) 169-96.
2.
N.G. Tomaiuolo , When image is everything, Searcher10(1) ( 2002). Available at: www.infotoday.com/searcher/jan02/tomaiuolo.htm (accessed September 2006).
3.
TASI (Technical Advisory Service for Images) , A Review of Image Search Engines (2006 ). Available at: www.tasi.ac.uk/resources/searchengines.html (accessed September 2006).
4.
J. Smith and S. Chang, An image and video search engine for the world wide web. In: I.K. Sethi and R.C. Jain (eds), Storage and Retrieval for Image and Video Databases: Proceedings of SPIE, Volume 3022 ( 1997) 84-95.
5.
Y. Choi and E. Rasmussen, Searching for images: the analysis of users' queries for image retrieval in American history, Journal of the American Society for Information Science and Technology54(6) (2003) 498-511.
6.
C. Silverstein , M. Henzinger, H. Marais and M. Moricz, Analysis of a very large Web search engine query log, SIGIR Forum33(1) (1999) 6-12.
7.
B.J. Jansen , A. Spink and T. Saracevic, Real life, real users, and real needs: a study and analysis of user queries on the web, Information Processing and Management36(2) (2002) 207-27.
8.
Hsiao-Tieh Pu , Shui-Lung Chuang and Chyan Yang, Subject categorization of query terms for exploring Web users' search interests, Journal of the American Society for Information Science and Technology53(8) (2002) 617-30.
9.
Hsiao-Tieh Pu , An analysis of web image queries for search . In: R.J. Todd (ed.), Proceedings of 66th Annual Meeting of the American Society for Information Science and Technology (ASIST 2003), 2003, Long Beach, CA (Information Today, Medford, NJ, 2003) 340-48.
10.
Hsiao-Tieh Pu , A comparative analysis of web image and textual queries, Online Information Review25(5) (2005) 457-67.
11.
P.G.B. Enser and C. McGregor, Analysis of Visual Information Retrieval Queries, British Library Research and Development Report 6104 (British Library, London, 1993).
12.
R.S. Taylor , Question-negotiation and information seeking in libraries: the process of asking questions, College and Research Libraries29 (1968) 178-94.
13.
H.P. Jespersen and J.K. Jespersen, The problem of subject access to visual materials, Journal of Educational Media and Library Science42(1) ( 2004) 37-48.
14.
P.G.B. Enser and C.J. Sandom, Towards a comprehensive survey of the semantic gap in visual image retrieval. In: E.M. Bakker et al. (eds), Proceedings of the 2nd International Conference on Image and Video Retrieval (CIVR2003), Urbana-Champaign, IL (Springer, Berlin, 2003) 279-87. [Lecture Notes in Computer Science, 2728.]
15.
J.S. Hare , P.H. Lewis, P.G.B. Enser and C.J. Sandom, Mind the gap: another look at the problem of the semantic gap in image retrieval. In: E.Y. Chang et al. (eds), Multimedia Content Analysis, Management and Retrieval: Proceedings of SPIE6073 (2006) 75-86.
16.
L. Hollink, A. Schreiber, A.T.G. Wielemaker and B. Wielinga, Semantic annotation of image collections. In: R. Dieng-Kuntz and F. Gandon (eds), Proceedings of KCAP'2003 Workshop on Knowledge Management and the Semantic Web, 2003, Sanibel, FL. Available at: www.cs.vu.nl/~laurah/1/papers/Hollink03_saic.pdf (accessed September 2006)
17.
J. Jeon, V. Lavrenko and R. Manmatha, Automatic image annotation and retrieval using cross-media relevance models . In: J. Challan et al. (eds), Proceedings of 26th Annual International ACM SIGIR Conference , 2003, Toronto, Canada ( ACM, New York, 2003) 119-26.
18.
M. Srikanth , J. Varner, M. Bowden and D. Moldovan, Exploiting ontologies for automatic image annotation. In: G. Marchionini et al. (eds), Proceedings of 28th Annual International ACM SIGIR Conference, 2005, Salvador, Brazil (ACM, New York, 2005) 552-8.
19.
K. Markey, Access to iconographical research collections, Library Trends37(2) ( 1988) 154-74.
20.
S. Hastings , Query categories in a study of intellectual access to digitised art images . In: T. Kinney (ed.), Proceedings of the ASIS 58th Annual Meeting, 1995, Chicago, IL (Information Today , Medford, NJ, 1995) 3-8.
21.
H. Chen, An analysis of image queries in the field of art history, Journal of the American Society for Information Science and Technology52(3) ( 2001) 260-73.
22.
S. Ornager, Image retrieval: theoretical and empirical user studies on accessing information in images. In: C.Schwartz (ed.), Proceedings of the ASIS 60th Annual Meeting, 1997, Washington, DC (Information Today, Medford, NJ, 1997) 202-11.
23.
M. Markkula and E. Sormunen, End-user searching challenges indexing practices in the digital newspaper photo archive, Information Retrieval1(4) (2000) 259-85.
24.
L.H. Keister , User types and queries: impact on image access systems. In R. Fidel et al. (eds), Challenges in Indexing Electronic Text and Images ( Learned Information, Medford, NJ, 1994) 7-22.
25.
L. Hollink , A. Schreiber, B. Wielinga and M. Worring, Classification of user image descriptions , International Journal of Human-Computer Studies61(5) (2004) 601-26.
26.
C. Jörgensen and P. Jörgensen, Image querying by image professionals , Journal of the American Society for Information Science and Technology56(12) (2005) 1346-59.
27.
P.G.B. Enser , Progress in documentation: pictorial information retrieval, Journal of Documentation51(2) (1995) 126-70.
28.
C. Jörgensen , Attributes of images in describing tasks, Information Processing and Management34(2/3) ( 1998) 161-74.
29.
R. Fidel , The image retrieval task: implications for the design and evaluation of image databases, The New Review of Hypermedia and Multimedia3 ( 1997 ) 181-99.
30.
M.L. Kherfi , D. Ziou and A. Bernardi, Image retrieval from the world wide web: issues, techniques, and systems, ACM Computing Surveys36(1) ( 2004) 35-67.
31.
B.J. Jansen and U. Pooch, A review of web searching studies and a framework for future research, Journal of the American Society for Information Science52(3) (2001) 235-46.
32.
A. Goodrum and A. Spink, Image searching on the Excite web search engine, Information Processing and Management37(2) (2001) 295-312.
33.
D.T. Covey, Usage and Usability Assessment: Library Practices and Concerns ( Digital Library Federation, Council on Library and Information Resources, Washington, DC, 2002 ). Available at: www.clir.org/pubs/reports/pub105/pub105.pdf (accessed September 2006).
34.
P. Brown , R. Hidderley, H. Griffin and S. Rollason, The democratic indexing of images, The New Review of Hypermedia and Multimedia2 (1996) 107-21.
35.
B. Glaser and A. Strauss, The Discovery of Grounded Theory (Aldine, Chicago, 1967).
36.
L.H. Armitage and P.G.B. Enser, Analysis of user need in image archives , Journal of Information Science23(4) (1997) 287-99.
37.
S. Westman and P. Oittinen, Image retrieval by end-users and intermediaries in a journalistic work context . In: I. Ruthven (ed.), Proceedings of the 1st International Conference on Information Interaction in Context, Copenhagen, Denmark, 2006 (ACM, New York, 2006) 102-10.
38.
K. Roddy , Subject access to visual resources: what the 90s might portend, Library Hi Tech9(1) (1991) 45-9.
39.
J.M. Turner , Subject access to pictures: considerations in the surrogation and indexing of visual documents for storage and retrieval , Visual Resources9(3) (1993) 241-71.
40.
E. Panofsky , Studies in Iconology: Humanistic Themes in the Art of the Renaissance (HarperCollins, London/ Glasgow, 1972).
41.
S. Shatford , Analysing the subject of a picture: a theoretical approach, Cataloguing and Classification Quarterly6(3) (1986) 39-62.
42.
J. Eakins , Techniques for Image Retrieval, Library and Information Briefings85 ( 1998) 1-15.
43.
A. Jaimes and S.-F. Chang, A conceptual framework for indexing visual information at multiple levels . In: G.B. Beretta and R. Schettini (eds), Internet Imaging: Proceedings of SPIE 3964 (2000).
44.
P.G.B. Enser , Visual image retrieval: seeking the alliance of concept-based and content-based paradigms, Journal of Information Science26(4) (2000) 199-210.
45.
E. Rosch , Natural categories, Cognitive Psychology4(3) (1973) 328-50.
