The mixed standard scale is a rating format which allows researchers to count illogical (i.e., internally inconsistent) response patterns. These counts have been interpreted as an index of rater reliability, based on the notion that illogical response patterns reflect carelessness in responding. This study investigated the meaning of these counts, using 943 accountants as raters. It was found that the counts of illogical response patterns were not related to reliability as measured by Cronbach's alpha, and alternative interpretations for such indices are suggested.
Get full access to this article
View all access options for this article.
References
1.
Bass, B. M. , Cascio, W. F., and O'Connor, E. J.Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 1974, 59, 313-320.
2.
Benson, P. G. Response inconsistency and characteristics of accountants: An investigation into the mixed standard scale. Unpublished master's thesis, Department of Psychology, Colorado State University, 1978.
3.
Blanz, F. and Ghiselli, E. E.The mixed standard scale: A new rating system. Personnel Psychology, 1972, 25, 185-199.
4.
Cronbach, L. J.Coefficient alpha and the internal structure of tests . Psychometrika, 1951, 16, 197-234.
5.
Dickinson, T. L. and Zellinger, P. M.A comparison of the behaviorally anchored rating and mixed standard scale formats. Journal of Applied Psychology, 1980, 65, 147-154.
6.
Feldt, L. S.A test of the hypothesis that Cronbach's alpha or Kuder-Richardson coefficient twenty is the same for two tests . Psychometrika, 1969, 34, 363-373.
7.
Finley, D. M. , Osburn, H. G., Dubin, J. A., and Jeanneret, P. R.Behaviorally based rating scales: Effects of specific anchors and disguised scale continua. Personnel Psychology, 1977, 30, 659-669.
8.
Hemphill, J. K.Dimensions of executive positions. Ohio Studies in Personnel, Research Monographs, Ohio State University, Bureau of Business Research, 1960, No. 98.
9.
Hendel, D. D.Paired comparisons intransitivity: Trends across domains of content and across groups of subjects . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1975, 35, 865-868.
10.
Hodapp, R. P. and Gavin, J. F.The development of a theoretically-
