A Comparison of Mixed Standard Scale Ratings Calculated with Blanz and Ghiselli's and Saal's Scoring Algorithms

Abstract

The present study compared the accuracy of mixed standard scale (MSS) ratings determined with either the Blanz and Ghiselli (1972) or the Saal (1979) scoring algorithm. A laboratory methodology was used so that the true level of ratee performance would be available and the accuracy of ratings could serve as dependent measures. Eighty-four undergraduate students observed four videotapes of managers interacting with subordinates and rated each manager on a MSS. The MSS was scored using the Blanz and Ghiselli and Saal algorithms. Analyses indicated that MSS ratings calculated with Saal's algorithm were more accurate than those calculated with Blanz and Ghiselli's method. Implications of the findings for past research and the future use of mixed standard scales are discussed.

Get full access to this article

View all access options for this article.

References

Bernardin, H. J. and Beatty, R. W. (1984). Performance appraisal: Assessing human behavior at work. Boston, MA: Kent Publishing Co.

Bernardin, H. J. and Pence, E. C. (1980). Effects of rater training: Creating new response sets and decreasing accuracy. Journal of Applied Psychology, 65, 606-666.

Blanz, F. and Ghiselli, E. E. (1972). The mixed standard scale: A new rating system. Personnel Psychology, 25, 185-199.

Borman, W. C. (1977). Consistency of rating accuracy and rating error in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238-252.

Borman, W. C. (1979). Format and training effects on rating accuracy and rater errors. Journal of Applied Psychology, 64, 410-421.

Cooper, W. H. (1981). Ubiquitous halo. Psychological Bulletin, 90, 218-244.

Cronbach, L. J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity." Psychological Bulletin, 52, 177-193.

Guttman, L. (1944). A basis for scaling qualitative data. American Sociological Review, 9, 139-150.

Rosinger, G. , Myers, L. B. , Levy, G. W. , Loar, M. , Mohrman, S. A. , and Stock, J. R. (1982). Development of behaviorally-based performance appraisal system. Personnel Psychology, 35, 75-88.

10.

Saal, F. E. (1979). Mixed standard rating scales: A consistent system for numerically coding inconsistent response combinations. Journal of Applied Psychology, 64, 422-428.

11.

Saal, F. E. and Landy, F. J. (1977). The mixed standard rating scale: An evaluation. Organizational Behavior and Human Performance. 18, 19-35.