Although training and use of multiple raters have been suggested to minimize demographic and individual biases on performance evaluations (Latham & Wexley, 1981), use of multiple raters often results in low interrater reliability which compounds the difficulty of establishing performance rating validity. The present study investigated the performance ratings made by the peers and supervisors of correction's officers, i.e., prison guards. Attention wasfocused on two issues: (1) the effects of rater and ratee personal, attitudinal, and relationship variables on performance ratings, and (2) examining performance "perspective differences" as an explanation of rating agreement. Results indicated that supervisor-subordinate educational similarity was significantly related to subordinate's performance rating. Supervisor-subordinate agreement on job dimension importance and subordinate age similarity with peer raters were also marginally related to performance ratings. The findings are discussed from the perspectives of shared cognitive schemas ofjob behaviors and practical implications.
Get full access to this article
View all access options for this article.
References
1.
ABELSON, R. P.Psychological status of the script concept. American Psychologist, 1981, 36, 715-729.
2.
ABELSON, R. P.Three modes of attitude-behavior consistency. In M. P. Zanna, E. T. Higgins, and C. P. Herman (Eds.), Consistency in social behavior: The Ontario Symposium (Vol. 2). Hillsdale, New Jersey: Eribaum, 1982, pp. 131-146.
3.
BERNARDIN, H. J.Rater training: A critique and reconceptualization. Proceedings of the Academy of Management, 1979, 216-220.
4.
BERNARDIN, H. J., & BEATTY, R. W.Performance appraisal: Assessing human behavior at work. Boston: Kent, 1984.
5.
BORMAN, W. C.The rating of individuals in organizations: An alternative approach. Organizational Behavior and Human Performance, 1974, 12, 105-124.
6.
BYRNE, D.The attraction paradigm. New York: Academic Press, 1971.
7.
BYRNE, D., & WONG, T. J.Racial prejudice, interpersonal attraction, and assumed dissimilarity of attitudes. Journal of Abnormal and Social Psychology, 1962, 65, 246-253.
8.
CANTOR, N., & MISCHEL, W.Traits as prototypes: Effects on recognition memory. Journal of Personality and Social Psychology, 1977, 3S, 38-48.
9.
CASTORE, C., & DeNINNO, J.Investigations in the social comparison of attitudes. In J. Suls and R. Miller (Eds.), Social comparison processesNew York: J. Wiley, 1977. pp. 125-148.
10.
CLEVELAND, J. N., & LANDY, F. J.The influence of rater and ratee age on two performance judgments. Personnel Psychology, 1981, 34, 19-29.
11.
CLORE, G. L.Interpersonal attraction: An overview. In J. W. Thibaut, J. T. Spence, and R. C. Carson (Eds.), Contemporary topics in social psychologyMorristown, New Jersey: General Learning Press, 1976, pp. 135-175.
12.
COHEN, J.Statistical power analysis for the behavioral sciences (revised ed.). New York: Academic Press, 1977.
13.
CRONBACH, L. J., & GLESER, G. C.Assessing similarity between profiles. Psychological Bulletin, 1953, 50, 456-473.
14.
DANSEREAU, F., GRAEN, G., & HAGA, W.A vertical dyad linkage approach to leadership within formal organizations. Organizational Behavior and Human Performance, 1975, 13, 46-78.
15.
DIPBOYE, R. L.Some neglected variables in research on discrimination in appraisals. Academy of Management Review, 1985, 10, 116-127.
16.
FELDMAN, J. M.Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology, 1981, 66, 127-148.
17.
FERRIS, G. R., YATES, V. L., GILMORE, D. C., & ROWLAND, K. M.The influence of subordinate age on performance ratings and causal attributions. Personnel Psychology, 1985, 38, 545-557.
18.
FISKE, S. T., & LINVILLE, P. W.What does the schema concept buy us?Personality and Social Psychology Bulletin, 1980, 6, 543-557.
19.
GIOIA, D. A., & POOLE, P. P.Scripts in organizational behavior. Academy of Management Review, 1984, 9, 449-459.
20.
GRAEN, G.Role-making processes within complex organizations. In M. Dunnette (Ed.), Handbook of Industrial and Organizational Psychology. Chicago: Rand McNally, 1976, pp. 1201-1245.
21.
GRAEN, G., & CASHMAN, J. F.A role-making model of leadership in formal organization: A developmental approach. In J. G. Hunt and L. L. Larson (Eds.), Leadership frontiersKent, Ohio: Kent State University Press, 1975, pp. 143-165.
22.
GRAEN, G. B., & SCANDURA, T. A.Toward a psychology of dyadic organizing. In B. Staw and L. L. Cummings (Eds.), Research in organizational behavior (Vol. 9). Greenwich, Connecticut: JAI Press, 1985, pp. 175-208.
23.
GRAEN, G., & SCHIEMANN, W.Leader-member agreement: A vertical dyad linkage approach. Journal of Applied Psychology, 1978, 63, 206-212.
24.
GRIFFIT, W., & JACKSON, T.The influence of ability and non-ability information on personnel selection decisions. Psychological Reports, 1970, 27, 959-962.
25.
HAMNER, W. C., KIM, J. S., BAIRD, L., & BIGONESS, N. J.Race and sex as determinants of ratings by potential employers in a simulated work sampling task. Journal of Applied Psychology, 1974, 59, 705-711.
26.
HASTORF, A. H., SCHNEIDER, D. J., & POLEFKA, J.Person perception. Reading, Massachusetts: Addison-Wesley, 1970.
27.
HUCK, J. R., & BRAY, D. W.Management assessment center evaluations and subsequent job performance of white and black females. Personnel Psychology, 1976, 29, 13-30.
28.
ILGEN, D. R., & FELDMAN, J. M.Performance appraisal: A process focus. In B. Staw and L. L. Cummings (Eds.), Research in organizational behavior Vol. 5). Greenwich, Connecticut: JAI Press, 1982.
29.
JUDD, C. M., & KULIK, J. A.Schematic effects of social attitudes on information processing and recall. Journal of Personality and Social Psychology, 1980, 38, 569-578.
30.
KIRCHNER, W., & REISBERG, D.Differences between better and less effective supervisors in appraisal of subordinates. Personnel Psychology, 1962, 15, 295-302.
31.
LANDY, F. J., & FARR, J. L.Performance rating. Psychological Bulletin, 1980, 87, 72-107.
32.
LATHAM, G. P., & WEXLEY, K. N.Increasing productivity through performance appraisal. Reading, Massachusetts:Addison-Wesley, 1981.
33.
LATHAM, G. P., WEXLEY, K. N., & PURSELL, E. D.Training managers to minimize rating errors in the observation of behavior. Journal of Applied Psychology, 1975, 60, 550-555.
34.
LEE, D., & ALVARES, K.Effect of sex on descriptions and evaluations of supervisory behavior in a simulated industrial setting. Journal of Applied Psychology, 1977, 62, 405-410.
35.
LEVY, S.Supervisory effectiveness and criterion relationships Paper presented at the 68th Annual Meeting of the American Psychological Association, 1960.
36.
LIDEN, R. C., & GRAEN, G.Generalizability of the vertical dyad linkage model of leadership. Academy of Management Journal, 1980, 23, 451-465.
37.
LONDON, M., & POPLAWSKI, J. R.Effects of information on stereotype development in performance appraisal and interview context. Journal of Applied Psychology, 1976, 61, 199-205.
38.
LORD, R. G.Accuracy in behavioral measurement: An alternative definition based on rater's cognitive schema and signal detection theory. Journal of Applied Psychology, 1985, 70, 66-71.
39.
LORD, R. G., FOTI, R. J., & PHILLIPS, J. S.A theory of leadership categorization. In J. G. Hunt, V. Sekaran, and C. Schriesheim (Eds.), Leadership: Beyond established views. Carbondale, Illinois: Southern Illinois University Press, 1982, pp. 104-121.
40.
MANDELL, M. M.Supervisory characteristics and ratings. Personnel Psychology, 1956, 32, 435-440.
41.
MERITT-HASTON, R. E. Explaining interrater reliability. Unpublished dissertation, Michigan State University, 1984.
42.
MOBLEY, W. H.Supervisor and employee race and sex effects on performance appraisals: A field study of adverse impact and generalizability. Academy of Management Journal, 1982, 25, 598-606.
43.
NATHAN, B. R., & ALEXANDER, R. A.The role of inferential accuracy in performance rating. Academy of Management Review, 1985, 10, 109-115.
PULAKOS, E. D., & WEXLEY, K. N.The relationship among perceptual similarity, sex, and performance ratings in manager-subordinate dyads. Academy of Management Journal, 1983, 26, 129-139.
46.
SCHMITT, N., & HILL, T.Sex and race composition of assessment center groups as a determinant of peer and assessor ratings. Journal of Applied Psychology, 1977, 62, 261-264.
47.
SCHWAB, D. P., & HENEMAN, H. G.Age stereotyping in performance appraisal. Journal of Applied Psychology, 1978, 63, 573-578.
48.
SHAW, M. E., & WRIGHT, J. M.Scales for the measurement of attitudes. New York: McGraw-Hill, 1967.
49.
SMITH, R. E., MEADOW, B. L., & SISK, T. K.Attitude similarity, interpersonal attraction, and evaluation social perception. Psychonomic Science, 1970, 18, 226-227.
50.
TAYLOR, S. E., & CROCKER, J.Schematic bases of social information processing. In E. T. Higgins, C. P. Herman, and M. P. Zanna (Eds.), Social cognition: The Ontario SymposiumHillsdale, New Jersey: Erlbaum, 1981, pp. 78-134.
51.
TERBORG, J. R., & ILGEN, D. R.A theoretical approach to sex discrimination in traditionally masculine occupations. Organizational Behavior and Human Performance, 1975, 13, 352-376.
52.
WANG, C. K. A., & THURSTONE, L. L.Scale of attitudes toward the punishment of criminals. In L. L. Thurstone (Ed.), The measurement of social attitudes. Chicago: University of Chicago Press, 1931.
53.
WEXLEY, K. N., & NEMEROFF, W. F.The effects of racial prejudice, race of applicant, and biographical similarity on interviewer evaluations of job applicants. Journal of Social and Behavioral Science, 1974, 20, 66-78.
54.
WEXLEY, K. N., & KLIMOSKI, R.Performance appraisal: An update. In K. M. Rowland and G. D. Ferris (Eds.), Research in personnel and human resources management (Vol 2). Greenwich, Connecticut: JAI Press, 1984.
55.
WEXLEY, K. N., ALEXANDER, R. A., GREENWALT, J. P., & COUCH, M. A.Attitudinal congruence and similarity as related to interpersonal evaluations in manager-subordinate dyads. Academy of Management Journal, 1980, 23, 320-330.
56.
WYER, R. S. Jr.The acquisition and use of social knowledge: Basic postulates and representative research. Personality and Social Psychology Bulletin, 1980, 6, 558-573.
57.
ZAMMUTO, R., LONDON, M., ROWLAND, K.Organizational and rater differences in-performance appraisals. Personnel Psychology, 1982, 35, 643-658.
