Generalizability theory was used to examine the dependability of anchoring labels of Likert-type scales. Variance components associated with labeling were estimated in two samples using a two-facet, random effects g-study design. In one sample, 173 graduate students in education were administered seven items measuring attitudes toward quantitative methodology. The other sample consisted of 108 graduate students in education who responded to the eight-item Life Orientation Test. From both samples, variance components associated with labeling were found to be minute, contributing little to the observed score variance. One plausible explanation was that respondents could primarily be using the numerical information in rating a Likert-type scale.
Get full access to this article
View all access options for this article.
References
1.
Alpert, R. , & Haber, R. N. (1960). Anxiety in academic achievement situations. Journal of Abnormal and Social Psychology, 61, 207-215.
2.
Bass, B. M. (1968). How to succeed in business according to business students and managers. Journal of Applied Psychology, 52(3), 254-262.
3.
Bass, B. M. , Cascio, W. F., & O'Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 59(3), 313-320.
4.
Bendig, A. W. (1954). Reliability of short rating scales and the heterogeneity of the rated stimuli. Journal of Applied Psychology, 38(3), 167-170.
5.
Boote, A. S. (1981). Reliability testing of psychographic scales: Five-point or seven-point? Anchored or labeled?Journal of Advertising Research, 21(5), 53-60.
6.
Brennan, R. L. (1983). Elements of generalizability theory. Iowa City, IA: ACT.
7.
Brennan, R. L. , & Kane, M. T. (1977). An index of dependability for mastery tests. Journal of Educational Measurement, 14, 277-289.
8.
Cliff, N. (1959). Adverbs as multipliers. Psychological Review, 66, 27-44.
9.
Cronbach, L. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10, 3-31.
10.
Cronbach, L. J. , Gleser, G. C., Nanda, M. & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability of scores and profiles. New York: John Wiley.
11.
Dixon, P. N. , Bobo, M., & Stevick, R. A. (1984). Response differences and preferences for all category-defined and end-defined Likert formats. Educational and Psychological Measurement, 44, 61-66.
12.
Fenigstein, A. , Scheier, M. F., & Buss, A. H. (1975). Public and private self-consciousness: Assessment and theory. Journal of Consulting Psychology, 45(4), 522-527.
13.
Finn, R. H. (1972). Effects of some variations in rating scale characteristics on the means and reliabilities of ratings. Educational and Psychological Measurement, 32, 255-265.
14.
French-Lazovik, G. , & Gibson, C. L. (1984). Effects of verbally labeled anchor points on the distributional parameters of rating measures. Applied Psychological Measurement, 8(1), 49-57.
15.
Frisbie, D. A. , & Brandenburg, D. C. (1979). Equivalence of questionnaire items with varying response formats. Journal of Educational Measurement, 16, 43-48.
16.
Goldberg, L. R. (1981). Unconfounding situational attributions from uncertain, neutral, and ambiguous ones: A psychometric analysis of descriptions of oneself and various types of others. Journal of Personality and Social Psychology, 41(3), 517-552.
17.
Huck, S. W. , & Jacko, E. J. (1974). Effect of varying the response format of the Alpert-Haber Achievement Anxiety Test. Journal of Counseling Psychology.21(2), 159-163.
18.
Klockars, A. J. , & Yamagishi, M. (1988). The influence of labels and positions in rating scales. Journal of Educational Measurement, 25(2), 85-96.
19.
Lam, T. C. , & Klockars, A. J. (1982). Anchor point effects on the equivalence of questionnaire items. Journal of Educational Measurement, 19(4), 317-322.
20.
Masters, J. R. (1974). The relationship between number of response categories and reliability of Likert-type questionnaires. Journal of Educational Measurement, 11(1), 49-53.
21.
Matell, M. S. , & Jacoby, J. (1972). Is there an optimal number of alternatives for Likert-scale items? Effects of testing time and scale properties. Journal of Applied Psychology, 56, 506-509.
22.
McKelvie, S. J. (1978). Graphic rating scales-How many categories?British Journal of Psychology, 69, 185-202.
23.
Newstead, S. E. , & Arnold, J. (1989). The effect of response format on ratings of teaching. Educational and Psychological Measurement, 49, 33-43.
24.
Nunnally, J. C. (1967). Psychometric theory. New York: McGraw-Hill.
25.
Peters, D. L. , & McCormick, E. J. (1966). Comparative reliability of numerically anchored versus job-task anchored rating scales. Journal of Applied Psychology, 50, 92-96.
26.
Scheier, M. F. & Carver, C. S. (1985). The Self-Consciousness Scale: A revised version for use with general populations. Journal of Applied Social Psychology, 15(8), 687-699.
27.
Shavelson, R. J. , & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
28.
Spector, P. E. (1976). Choosing response categories for summated rating scales. Journal of Applied Psychology, 61(3), 374-375.
29.
Walsh, R. P. (1968) Some correlates of test-taking anxiety. Psychological Reports, 22, 449-450.
30.
Walsh, R. P. (1969). Test-taking anxiety and psychological needs. Psychological Reports, 25, 83-86.
31.
Walsh, R. P. , Engbretson, R. O., & O'Brien, B. A. (1968). Anxiety and test-taking behavior. Journal of Counseling Psychology, 15, 572-575.
32.
Wyatt, R. C. , & Meyers, L. S. (1987). Psychometric properties of four 5-point Likert-type response scales. Educational and Psychological Measurement, 47, 27-35.
