A Comparative Test of Magnitude Estimation and Pair-Comparison Treatment of Complete Ranks for Scaling a Small Number of Equalinterval Frequency Response Anchors

Abstract

This study investigated whether previously-found differences in two sets of recommended five-point equal-interval response anchors could have been caused by scaling too many stimuli at one time. One set of recommended anchors, produced by magnitude estimation, was compared with a set produced by Thurstone Case III pair-comparison treatment of complete ranks. Subjects (N =110) completed magnitude estimations and rankings of 8 frequency expressions. Few of the scale values produced by magnitude estimation differed significantly from the means obtained in previous studies or from the "ideal" values expected of exactly equal-interval anchors. However, this outcome was not true of the Case III results (they were seriously discrepant). Implications for future research are discussed.

Get full access to this article

View all access options for this article.

References

Bass, B. M. , Cascio, W. J. , and O'Connor, E. J. (1974). Magnitude estimation of expressions of frequency and amount. Journal of Applied Psychology, 34, 313-320.

Birnbaum, M. H. (1982). Controversies in psychological measurement. In B. Wegener (Ed.), Social attitudes and psychophysical measurement. Hillsdale, NJ: Lawrence Erlbaum Associates.

Bradford, J. W. and Schriesheim, C. A. (1990). Thurscal: A program for interval scaling using paired comparisons or paired comparison treatment of complete ranks under case III assumptions. Educational and Psychological Measurement, 50, 849-851.

Duncan, 0. D. (1984). Notes on social measurement: Historical and critical. New York: Russell Sage Foundation.

Gescheider, G. A. , and Bolanowski, Jr., S. J. (1991). Final comments on ratio scaling of psychological magnitudes. In S. J. Bolanowski, Jr. and G. A. Gescheider (Eds.), Ratio scaling of psychological magnitude. Hillsdale, NJ: Lawrence Erlbaum Associates.

Guilford, J. P. (1954). Psychometric methods (2nd ed.). New York: McGraw-Hill.

Lodge, M. (1981). Magnitude scaling: Quantitative measurement of opinions. Beverley Hills, CA: Sage Publications.

Marks, L. E. (1974). Sensoty processes: The new psychophysics. New York: Academic Press.

Marks, L. E. (1982). Psychophysical measurement: Procedures, tasks, scales. In B. Wegener (Ed.), Social attitudes and psychophysical measurement. Hillsdale, NJ: Lawrence Erlbaum Associates.

10.

Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

11.

Pohl, N. F. (1981). Scale considerations in using vague quantifiers. Journal of Experimental Education, 49, 235-240.

12.

Schriesheim, C. A. and Kerr, S. (1974). Psychometric properties of the Ohio State leadership scales. Psychological Bulletin, 81, 756-765.

13.

Schriesheim, C. A. and Novelli, L. (1989). A comparative test of the interval-scale properties of magnitude estimation and case III scaling and recommendations for equal-interval frequency response anchors. Educational and Psychological Measurement, 49, 59-74.

14.

Schriesheim, C. A. , and Schriesheim, J. F. (1974). Development and empirical verification of new response categories to increase the validity of multiple response alternative questionnaires. Educational and Psychological Measurement, 34, 877-884.

15.

Schriesheim, C. A. and Schriesheim, J. F. (1978). The invariance of anchor points obtained by magnitude estimation and pair-comparison treatment of complete ranks scaling procedures: An empirical comparison and implications for validity of measurement. Educational and Psychological Measurement, 38, 977-983.

16.

Siegel, S. (1956). Nonparametric statistics. New York: McGraw-Hill.

17.

Stevens, S. S. (1972). Psychophysics and social scaling. Morristown, NJ: General Learning Press.

18.

Stevens, S. S. (1975). Psychophysics. New York: Wiley-Interscience.

19.

Wegener, B. (1982). Fitting category to magnitude scales for a dozen survey-assessed attitudes. In B. Wegener (Ed.), Social attitudes and psychophysical measurement. Hillsdale, NJ: Lawrence Erlbaum Associates.

20.

Westermann, R. (1983). Interval-scale measurement of attitudes: Some theoretical conditions and empirical testing methods. British Journal of Mathematical and Statistical Psychology, 36, 228-239.