Design and Evaluation of Categorical Search Results Interfaces

Abstract

This research investigates the design and evaluation of interfaces for the presentation of search results using categorization. Card sorting study was conducted to design categorized search results interfaces. Eye-tracking technology was utilized to evaluate the designed category interfaces, comparing them with a conventional list interface. Two factors of category interfaces, the approach used to order categories and the number of abstracts initially displayed within each category, are investigated. Forty participants performed two types of tasks, navigation and information search, using a PC integrated with a non-intrusive Tobii 1750 binocular eye tracking system. Performance measures such as time for search and percentage of tasks completed did not reveal significant differences among the category and list interfaces. Process measures such as overall number of fixations, mean fixation durations, and relative change from the baseline pupil diameter also did not show significant differences among the category and list interfaces. Although no significant differences are found, there is a consistent positive trend in the performance, process, and subjective measures that supports design of categorical search results interfaces.

Get full access to this article

View all access options for this article.

References

Brin

Page

(1998). The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems, 1–20.

Card

S. K.

Pirolli

Van Der Wege

(2001). Information scent as a driver of web behavior graphs: Results of a protocol analysis method for web usability. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 498–505). Seattle, WA.

Duchowski

A. T.

(2002). A breadth-first survey of eye tracking applications. Behavior Research Methods, Instruments, & Computers (BRMIC), 34(4), 455–470.

Dumais

Cutrell

Chen

(2001). Optimizing search by showing results in context. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 277–284). Seattle, WA.

Dwork

Kumar

Naor

Sivakumar

(2001). Rank aggregation methods for the web. In Proceedings of the 10th International World Wide Web Conference (pp. 613–622). Hong Kong.

Fallow

(2005). Internet searchers are confident, satisfied and trusting but they are also unaware and naïve. Pew / Internet and American Life Project. Retrieved February 2005, from http://www.pewinternet.org/pdfs/PIP_Searchengine_users.pdf.

Goldberg

J. H.

Kotval

X. P.

(1999). Computer interface evaluation using eye movements: Methods and constructs. International Journal of Industrial Ergonomics, 24, 631–645.

Jacob

Karn

(2000). Eye tracking in human computer interaction and usability research: Ready to deliver the promises. Retrieved February 2005, from http://www.cs.tufts.edu/∼jacob/papers/ecem.pdf.

Jansen

B. J.

Spink

(2002). An analysis of Web documents retrieved and viewed. In Proceedings of the 4th International Conference on Internet Computing (pp. 65–69). Las Vegas, NV.

10.

Iqbal

S. T.

Adamczyk

Zheng

X. S.

Bailey

B. P.

(2005). Towards an index of opportunity: Understanding changes in mental workload during task execution. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 311–320). Portland, OR.