Using document classification for displaying search results lists

Abstract

In this paper, four self-developed user interfaces that display document search results using different methods were compared. In order to create the four interfaces, two information elements: document categories and lines from the document were used. A user study compared the four interfaces. It was found that the category addition to the interface was beneficial in both measurable and subjective measures. It was also found that displaying the relevant lines from the document increased the effectiveness and shortened the search time in all cases and tasks. It was found that the participants preferred the interface containing categories and relevant lines to all other interfaces checked. It was also the fastest in the objective time measurement. Another sub-research that was conducted showed that the most important parameter for the users was the confidence level that the answer was accurate, and the least important parameter was the feeling of comfort while conducting a search.

Get full access to this article

View all access options for this article.

References

[1] S. Kirsch , The future of Internet search . In: W.B. Croft , A. Moffat , C. J. van Rijsbergen , R. Wilkinson and J. Zobel (eds), Proceedings, 21st Annual International Conference Research and Development in Information Retrieval, Melbourne, 1998 (ACM Press, New York, 1998).

[2] T. Landauer , D. Egan , J. Remde , M. Lesk , C. Lochbaum and D. Ketchum , Enhancing the usability of text through computer delivery and formative evaluation: the SuperBook project. In: Hypertext - a Psychological Perspective ( Ellis Horwood, New York , 1993), pp. 71-136.

[3] H. Chen and S. Dumais , Bringing order to the web: automatically categorizing search results . In: T. Turner and G. Szwillus (eds), Proceedings, Conference on Human Factors and Computing Systems, The Hague, April 2000 (ACM Press, New York, 2000).

[4] O. Zamir and O. Etzioni , Grouper: a dynamic clustering interface to web search results . In: A. Mendelzon (ed.), Proceedings, Eighth International World Wide Web Conference, Toronto, May 1999 (Elsevier Science, New York, 1999).

[5] S. Chakrabarti , B. Dom , R. Agrawal and P. Raghavan , Scalable feature selection, classification and signature generation for organizing large text databases into hierarchical topic taxonomies , The VLDB Journal 7(3) (1998) 163-178 .

[6] D. Mladenic , Turning Yahoo into an automatic web page classifier . In: Proceedings, 13th European Conference on Artificial Intelligence (ECCAI 1998), Brighton, August 1998 (ECCAI Press, Linkoping, 1998).

[7] O. Drori , The benefits of displaying additional internal document information on textual database search result lists . In: J. Borbinha and T. Baker (eds), Proceedings, Fourth European Conference on Research and Advanced Technology for Digital Libraries (ECDL2000), Lisbon, September 2000 (Springer, New York, 2000).

[8] O. Drori, Refinement of search in information systems and improving presentation of results for end users, as efficient tools for decision making process, Ph.D. thesis (The Hebrew University of Jerusalem, Jerusalem, 2000).

[9] B. Shneiderman , D. Feldman , A. Rose and X. Ferre Grau, Visualizing digital library search results with categorical and hierarchical axes . In: P. Nürnberg , D.L. Hicks and R. Furuta (eds), Proceedings, 5th ACM International Conference on Digital Libraries, San Antonio, CA, June 2000 (ACM Press, New York, 2000).

10.

[10] M. Hearst and C. Karadi , Cat-a-Cone: an interactive interface for specifying searches and viewing retrieval results using a large category hierarchy . In: S. Pemberton (ed.), Proceedings, Conference on Human Factors and Computing Systems, Atlanta, GA, March 1997 (ACM Press, New York, 1997).

11.

[11] L.T. Su, An investigation to find appropriate measures for evaluating interactive information retrieval, unpublished Ph.D. Dissertation (Rutgers, the State University of New Jersey, New Brunswick, NJ, 1991).

12.

[12] N. Chervany , and G. Dickson , An experimental evaluation of information overload in a production environment . Management Science 20(10) (1974) 1335-1344 .

13.

[13] O. Drori , Using text elements by context to display search results in information retrieval systems . In: E. Amitay (ed.), Proceedings, Hypertext 2000 and Digital Libraries 2000 Workshop on Information Doors, San Antonio, CA, May 2000 (ACM Press, New York, NY, 2000). Available at: http://shum.huji.ac.il/%7Eofferd/papers/utecdsr/drori052000.htm

14.

[14] O. Drori , Improving display of search results in information retrieval systems - user’s study . In: P. Isaias (ed.), Proceedings 1st International Workshop on New Development in Digital Libraries (NDDL 2001), Setubal, July 2001 (ICEIS Press, Setubal, Portugal, 2001), pp. 20-23 . Available at: http://shum.huji.ac.il/%7Eofferd/papers/drori072001.htm

15.

[15] B. Shneiderman and R. Chimera , An exploratory evaluation of three interfaces for browsing large hierarchical tables of contents , ACM Transactions on Information Systems 12(4) (1994) 383-406 .

16.

[16] O. Drori , Algorithm for documents ranking - idea and simulation results . In: Proceedings Fourteenth International Conference on Software Engineering and Knowledge Engineering (SEKE 2002), Ischia (2002). Available at: http://shum.huji.ac.il/%7Eofferd/papers/drori072002.htm