The present study compared rating accuracy of logical and illogical raters on mixed standard scales. A laboratory methodology was used so that the true level of ratee performance would be available and Cronbach's (1955) accuracy components could serve as dependent measures. Analyses indicated that illogical raters were less accurate than were logical raters, but only on differential evaluation. Implications for personnel practice and future research are discussed.
Get full access to this article
View all access options for this article.
References
1.
Barnes-Farrell, J. L. and Weiss, H. M. (1984). Effects of standard extremity on mixed standard scales performance ratings. Personnel Psychology, 37, 301-316.
2.
Benson, P. G. and Dickinson, T. L. (1983). Mixed standard scale response inconsistencies as reliability indices. Educational and Psychological Measurement, 43, 781-789.
3.
Blanz, F. and Ghiselli, E. E. (1972). The mixed standard scale: A new rating system. Personnel Psychology, 25, 185-199.
4.
Borman, W. C. (1977). Consistency of rating accuracy and rating error in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238-252.
5.
Borman, W. C. (1979). Format and training effects on rating accuracy and rater errors. Journal of Applied Psychology, 26, 410-421.
6.
Borman, W. C. (1979b). Individual differences correlates of accuracy in evaluating others' performance effectiveness. Applied Psychological Measurement, 3, 103-115.
7.
Cronbach, L. J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity."Psychological Bulletin, 52, 177-193.
8.
Desselles, M. L. and Dobbins, G. H. (1987). A comparison of mixed standard scales ratings calculated with Blanz and Ghiselli's and Saal's scoring algorithms. Educational and Psychological Measurement, 47, 799-806.
9.
Finley, D. M. , Osborn, H. G., Dubin, J. A., and Jeanneret, P. R. (1977). Behaviorally based rating scales: Effects of specific anchors and disguised scale continua. Personnel Psychology, 30, 659-669.
10.
Fiske, S. T. and Taylor, S. E. (1984). Social cognition. Reading, MA: Addison-Wesley Publishing.
11.
Guttman, L. (1944). A basis for scaling qualitative data. American Sociological Review, 9, 139-150.
12.
Murphy, K. R. , Garcia, M., Kerkar, S., Martin, C., and Balzer, W. K. (1982). Relationship between observational accuracy and accuracy in evaluating performance. Journal of Applied Psychology, 67, 320-325.
13.
Prien, E. P. and Hughes, G. L. (1987). The effect of quality control revisions on mixed standard scale rating errors. Personnel Psychology, 40, 815-823.
14.
Rosinger, G. , Myers, L., Levy, G., Loar, M., Mohrman, S., and Stock, J. R. (1982). Development of behaviorally-based performance appraisal system. Personnel Psychology, 35, 75-88.
15.
Saal, F. E. (1979). Mixed standard rating scales: A consistent system for numerically coeding inconsistent response combination. Journal of Applied Psychology, 64, 422-428.
16.
Saal, F. E. and Landy, F. J. (1977). The mixed standard rating scale: An evaluation. Organizational Behavior and Human Performance, 18, 19-35.
