The relevance of retrieved documents or document descrip tions has been a central measurement in the evaluation of information retrieval (IR) systems. Online public access cata logues (OPACs) are sirrular in many ways and so relevance should be an appropnate evaluation tool in measuring their performance. The development of relevance in evaluating IR systems is described and also the important differences be tween such systems and OPACs. Characteristics of the end- users of both systems are discussed with the conclusion that end-users' motivation and behaviour are as yet not fully under stood. The implication of this is that relevance is a central feature, but only one, of an OPAC user's overall information need.
Get full access to this article
View all access options for this article.
References
1.
J.R. Matthews , G.S. Lawrence and D.K. Ferguson, Using Online Catalogs: a Nationwide Survey (Neal Schuman, New York , 1983).
2.
S. Walker, The Okapi online catalogue research projects. In: C.R. Hildreth (Editor), The Online Catalogue. Developments and Directions ( Library Association, London, 1989 ) 84-106.
3.
W.G. Potter , Expanding the online catalog, Information Technology and Libraries8(2) (1989) 99-104.
4.
M.B. Eisenberg , Measunng relevance judgements, Information Processing and Management24(4) (1988) 373-389.
5.
T. Saracevic , Relevance: a review of and a framework for the thinking on the notion in information science, Journal of the American Society for Information Science26(6) (1975) 321-343.
6.
D.A. Kemp , Relevance, pertinence and information system development, Information Storage and Retrieval10(4) (1974) 37-47.
7.
R. Basch, The electronic client: user expectations and searcher responsibilities. In: 7th National Online Meeting (Learned Information, New York, 1986) 19-25.
8.
J. Day and L. McDowell, Information needs of science and technology students, Education Libraries Bulletin31(2) (1988) 1-6.
9.
M. Slater , Social scientists' information needs in the 1980s, Journal of Documentation44(3) (1988) 226-237.
10.
N.J. Belkin , R.N. Oddy and H.M. Brooks, ASK for information retrieval, Part 1: Background and theory, Journal of Documentation38(2) (1982) 61-71.
11.
R.S. Taylor , Question negotiation and information seeking m libraries, College and Research Libraries29(3) (1968) 178-189.
12.
M. Hancock-Beaulieu , Online catalogues: a case for the user. In: C.R. Hildreth, (Editor), The Online Catalogue: Developments and Directions (Library Association, London, 1989) 25-46.
13.
B. Dervin and M. Nilan.Information needs and uses In: Annual Review of Information Science and Technology 21 ( Knowledge Industry, White Plains. NY, 1986) 3-33.
14.
H.J.G. Hall , Patterns in the use of information: the right to be different, Journal of the American Society for Information Science32(2) (1981) 103-112.
15.
C.H. Fenichel , Online searching: measures that discriminate among users with different types of experience, Journal of the American Society of Information Science32(1) (1981) 23-32.
16.
C.L. Borgman , Psychological research in human-computer interaction . In: Annual Review of Information Science and Technology 19 (Knowledge Industry, White Plains, NY, 1984) 33-64.
17.
C.L. Borgman , All users of information retrieval systems are not created equal: an exploration into individual differences, Information Processing and Management25(3) (1989) 237-251.
18.
A. Vickery, H.M. Brooks, B.A. Robinson and J. Stephens, Expert System for Referral (British Library, London, 1988).
19.
T. Saracevic , P. Kantor, A.Y. Chamis and D. Trivison.A study of information seeking and retrieving, Journal of the American Society for Information Science39(3) (1988) 161-216.
20.
M. Eisenberg and C. Barry.Order effects: a preliminary study of the possible influence of presentation order on user judgements of document relevance. ASIS 86 23 (Learned Information, New York. 1986) 80-86.
21.
S.E. Robertson and K. Sparck Jones, Relevance weighting of search terms , Journal of the American Society for Information Science27(3) ( 1976) 129-146.
22.
T.E. Doszkocs , Natural language processing in information retrieval , Journal of the American Society for Information Science37(4) ( 1986) 191-6.
23.
W.H. Mischo and A.F. Moore, Enhanced access to periodical literature within an online catalogue environment . In: C.R. Hildreth (editor), The Online Catalogue: Developments and Directions (Library Association. London, 1989) 107-126.
24.
C. McCarthy , The reliability factor in subject access, College and Research Libraries47(1) (1986) 48-56.
25.
N. Mitev , Users and ease of use: online catalogues, Program20(2) (1986) 111-119.
26.
C.L. Borgman , Why are online catalogs hard to use? Lessons learned from information-retrieval studies, Journal of the American Society for Information Science36(6) (1986) 387-400.
27.
C.R. Hildreth , General introduction. In: C.R. Hildreth (Editor), The Online Catalogue: Developments and Directions (Library Association, London, 1989) 22.
