The present study assessed how respondents use continuous scales in two practical measurement situations. Responses to the continuous scales were expected to be multimodal, based on the assumptions that (a) respondents do not take full advantage of the scale and (b) the selective process is relatively general and common to all respondents. Kernel density analysis and a factor-analytic procedure were used to evaluate the assumptions in two empirical datasets. In both cases, the results suggested that respondents were operating with a limited number of response points in spite of the continuous nature of the scale.
Get full access to this article
View all access options for this article.
References
1.
Alwin, D. F. (1992). Information transmission in the survey interview: Number of response categories and the reliability of attitude measurement. In P. V. Marsden (Ed.), Sociological methodology (pp. 83-119). Cambridge, MA: Blackwell.
2.
Alwin, D. F. (1997). Feeling thermometers versus 7-point scales: Which are better? Sociological Methods & Research, 25, 318-340.
3.
Beardah, C. C., & Baxter, M. J. (1996). MATLAB routines for kernel density estimation and the graphical representation of archaeological data. In H. Kammermans & K. Fennema (Eds.), Interfacing the past: Computer applications and quantitative methods in archaeology. Leiden, UK: University of Leiden Press.
4.
Browne, M. W. (1984). Asymptotic distribution free methods in analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.
5.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
6.
Browne, M. W., & Mels, G. (1993). RAMONA user's guide. Columbus: The Ohio State University Press.
7.
Champney, H., & Marshall, H. (1939). Optimal refinement of the rating scale. Journal of Applied Psychology, 23, 323-331.
8.
Cheng, M. Y., & Hall, P. (1999). Mode testing in difficult cases. Annals of Statistics, 27, 1294-1315.
9.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
10.
Cook, C., Heath, F., Thompson, R., & Thompson, B. (2001). Score reliability in web- or Internet-based surveys: Unnumbered graphic rating scales versus Likert-type scales. Educational and Psychological Measurement, 61, 697-706.
11.
Cox, E. P. (1980). The optimal number of alternatives for a scale: A review. Journal of Marketing Research, 17, 407-422.
12.
Cronbach, L. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475-494.
13.
Eysenck, H. J., & Eysenck, S. B. G. (1963). Manual of the Eysenck Personality Inventory. London: University of London Press.
14.
Freyd, M. (1923). The graphic rating scale. Journal of Educational Psychology, 14, 83-102.
15.
Garner, W. R. (1960). Rating scales, discriminability and information transmission. Psychological Review, 67, 343-352.
16.
Guilford, J. P. (1954). Psychometric methods. New York: McGraw-Hill.
17.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
18.
Jöreskog, K. G., & Sörbom, D. (1996). LISREL 8: User's reference guide. Chicago: Scientific Software.
19.
Krieg, E. F. (1999). Biases induced by coarse measurements scales. Educational and Psychological Measurement, 59, 749-766.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
22.
Mellenbergh, G. J. (1994). A unidimensional latent trait model for continuous item responses. Multivariate Behavioral Research, 29, 223-237.
23.
Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits in our capacity for processing information. Psychological Review, 63, 81-97.
24.
Munshi, J. (1990). A method for constructing Likert scales. Research report, Sonoma State University. Retrieved from http://munshi.sonoma.edu/likert.html
25.
Osgood, C. E., Suci, G. J., & Tannembaum, P. H. (1957). The measurement of meaning. Urbana: University of Illinois Press.
26.
Parzen, E. (1962). On estimation of a probability density function and mode. Annals of Mathematical Statistics, 33, 1065-1076.
27.
Rosenblatt, M. (1956). Remarks on some nonparametric estimates of a density function. Annals of Mathematical Statistics, 27, 832-837.
28.
Samejima, F. (1973). Homogeneous case of the continuous response model. Psychometrika, 38, 203-219.
29.
Samejima, F. (1974). Normal give model on the continuous response level in the multidimensional latent space. Psychometrika, 39, 111-121.
30.
Saris, W. E. (1988). Variation in response functions: A source of measurement error in attitude research. Amsterdam: Sociometric Research Foundation.
31.
Satorra, A., & Bentler, P. M. (1988). Scaling corrections for chi-square statistics in covariance structure analysis. Proceedings of the American Statistical Association, 308-313.
32.
Sheather, S. J., & Jones, M. C. (1991). A reliable data-based bandwidth selection method for kernel density estimation. Journal of the Royal Statistical Society, 53, 683-690.
33.
Sherif, C. W., Sherif, M., & Nebergall, R. E. (1965). Attitude and attitude change. Philadelphia: Sanders.
34.
Silverman, B. W. (1986). Density estimation for statistics and data analysis. London: Chapman & Hall.
35.
Simon, H. A. (1957). Models of man. New York: Wiley.
36.
Simon, H. A., & Newell, A. (1971). Human problem solving: The state of the theory in 1970. American Psychologist, 26, 146-159.
37.
Tzeng, O. C. S. (1983). A comparative evaluation of four response formats in personality ratings. Educational and Psychological Measurement, 43, 935-950.
38.
Westwood, S., Baxter, M. J., & Beardah, C. C. (1999). Sample size problems with archaeometric data. In J. Barcelo, I. Briz, & A. Vila (Eds.), Computer applications and quantitative methods in archaeology (pp. 155-157). Oxford, UK: Archaeopress.
