Novice and experienced users’ search performance and satisfaction with Web of Science and Scopus

Abstract

This paper aims to determine novice and experienced users’ search performance and satisfaction with the interfaces of the Web of Science and Scopus. This is a descriptive-analytical study. Snowball sampling was used. Given queries were searched by 15 experienced and 15 novice users and their search performance was recorded using Camtasia. Their satisfaction was determined by the QUIS questionnaire. The experienced users were more satisfied with both databases than the novices but the difference was not significant. The results imply that even a limited amount of search experience provides search performance benefits in using databases to locate information. If a user interface is designed in a proper manner and considering users’ needs, users get better results.

Keywords

Search performance Satisfaction Novice and Experienced users User interface Web of Science Scopus

Get full access to this article

View all access options for this article.

References

Ahmed

(2006) A comparison of novices initial performance, learnability and memorability with a web-based IR interface. Malaysian Journal of Library and Information Science 11(2): 75–85.

Ahmed

McKnight

Oppenheim

(2004) A study of users’ performance and satisfaction with the Web of Science IR interface. Journal of Information Science 30(5): 459–468.

Ahmed

McKnight

Oppenheim

(2006a) A user-centered design and evaluation of IR interfaces. Journal of Librarianship and Information Science 38(2): 157–172.

Ahmed

McKnight

Oppenheim

(2006b) The use of a heuristic process to evaluate an information retrieval interface. Library and Information Research 30(95): 3–9.

Allen

(1991) Cognitive research in information science: Implications for design. Annual Review of Information Science and Technology 26: 3–37.

Al-Maskari

Sanderson

(2010) A review of factors influencing user satisfaction in information retrieval. Journal of the American Society for Information Science and Technology 61(5): 859–868.

Al-Maskari

Sanderson

(2011) The effect of user characteristics on search effectiveness in information retrieval. Information Processing and Management: An International Journal 47(5): 719–729.

Chen

Macredie

(2010) Web-based interaction: A review of three important human factors. International Journal of Information Management 30(5): 379–387.

Fenichel

C H

(1981) Online searching: Measures that discriminate among users with different types of experiences. Journal of the American Society for Information Science 32(1): 23–32.

10.

Guz

Rushchitsky

(2009) Scopus: A system for the evaluation of scientific journals. International Applied Mechanics 45(4): 351–362.

11.

Hsieh-Yee

(1993) Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the American Society for Information Science 44(3): 161–174.

12.

Jacobson

Fusani

(1992) Computer, system, and subject knowledge in novice searching of a full-text, multi file database. Library & Information Science Research 14(1): 97–106.

13.

Lazonder

Biemans

Wopereis

(2000) Differences between novice and experienced users in searching information on the World Wide Web. Journal of the American Society for Information Science 51(6): 576–581.

14.

Liu

Belkin

(2013) Examining the effects of task topic familiarity on searchers’ behaviors in different task types. Proceedings of the American Society for Information Science and Technology 50(1): 1–10.

15.

Marchionini

(1989) Information-seeking strategies of novices using a full-text electronic encyclopedia. Journal of the American Society for Information Science 40(1): 54–66.

16.

Mead

Fisk

(1998) Measuring skill acquisition and retention with an ATM simulator: The need for age specific training. Human Factors 40(3): 516–523.

17.

Mead

Sit

Rogers

et al . (2000) Influences of general computer experience and age on library database search performance. Behaviour and Information Technology 19(2): 107–123.

18.

Nielsen

(1993) Iterative user-interface design. IEEE Computer 26(11): 32–41.

19.

Palmquist

Kim

(2000) Cognitive style and on-line database search experience as predictors of Web search performance. Journal of the American Society for Information Science 51(6): 558–566.

20.

Pollock

Hockley

(1997) What’s wrong with Internet searching. D-Lib Magazine 3 Article 1. Available at: http://www.dlib.org/dlib/march97/bt/03pollock.html (accessed 18 March 2007).

21.

Qiu

(1993) Markov models of search state patterns in a hypertext information retrieval system. Journal of the American Society for Information Science 44(7): 413–427.

22.

Sullivan

Borgman

Wippern

(1990) End-users, mediated searches, and front-end assistance programs on Dialog: A comparison of learning, performance, and satisfaction. Journal of the American Society for Information Science 41(1): 27–42.

23.

Sutcliffe

Ennis

Watkinson

(2000) Empirical studies of end-user information searching. Journal of the American Society for Information Science 51(13): 1211–1231.

24.

Theng

Y L

Lee

E A

Chu

SKW

et al . (2015) Scaffolding in information search: Effects on less experienced searchers. Journal of Librarianship and Information Science 0961000615595455.

25.

Vakkari

Pennanen

Serola

(2003) Changes of search terms and tactics while writing a research proposal. Information Processing and Management 39(3): 445–463.

26.

Vassileva

(1996) A task-centered approach for user modeling in a hypermedia office documentation system. User Modeling and User Adapted Interaction 6(2/3): 185–223.

27.

Wang

Erdelez

Allen

et al . (2012) Role of domain knowledge in developing user-centered medical-image indexing. Journal of the American Society for Information Science and Technology 63(2): 225–241.

28.

Wolfram

Dimitroff

(1998) Hypertext vs Boolean-based searching in a bibliographic database environment: A direct comparison of searcher performance. Information Processing and Management 34(6): 669–679.

29.

Yoo

Mosa

ASM

(2015) Analysis of PubMed User Sessions Using a Full-Day PubMed Query Log: A Comparison of Experienced and Non-experienced PubMed Users. JMIR medical informatics 3(3): e25.

30.

Young

Shneiderman

(1993) A graphical filter/flow model for boolean queries: An implementation and experiment. Journal of the American Society for Information Science 44 (6): 327–339.

31.

Young

Shneiderman

(1993) A graphical filter/flow model for Boolean queries: An implementation and experiment. Journal of the American Society for Information Science 44(6): 327–339.

32.

Zerehsaz

Fattahi

Davarpanah

(2005) Investigation and analysis of the characteristics mentioned in the user interface of Simorgh software and the satisfaction of the Faculty of Education and Psychology Ferdowsi University of Mashhad students to interact with the software. Journal of Library and Information Science 4(9): 127–150. (Persian) Available at: http://profdoc.um.ac.ir/articles/a/203373.pdf (accessed 18 August 2015).

33.

Zhang

Chignell

(2001) Assessment of the effects of user characteristics on mental models of information retrieval systems. Journal of the American Society for Information Science and Technology 52(6): 445–459.

34.

Zhang

Liu

Cole

et al (2015). Predicting users’ domain knowledge in information retrieval using multiple regression analysis of search behaviors. Journal of the Association for Information Science and Technology 66(5): 980–1000.