We investigated whether rater affect has a similar effect on the leniency of ratings from three of the sources of 360-degree feedback (downward, upward, and peer) and whether there is an interaction between a rater’s affect and the time he or she has spent observing the ratee. The findings indicate that the influence of rater affect on the leniency of ratings was significantly greater in upward and peer feedback than in downward feedback and that the influence increased as raters’ observation time increased.
Get full access to this article
View all access options for this article.
References
1.
Alexander, E. R., & Wilkins, R. D. (1982). Performance rating validity: the relationship of objective and subjective measures of performance. Group and Organizational Studies, 7, 485–496.
2.
Antonioni, D. (1994). The effects of feedback accountability on upward appraisal ratings. Personnel Psychology, 47, 349–356.
3.
Antonioni, D. (1996). Designing an effective 360-degree appraisal feedback process. Organizational Dynamics, 25, 24–38.
4.
Antonioni, D., & Woehr, D. J. (2000). Improving the quality of multi-source rater performance. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), Handbook of Multisource Feedback (pp. 114–129). San Francisco: Jossey–Bass.
5.
Atwater, L. E., Ostroff, C., Yammarino, F. J., & Fleenor, J. W. (1998). Self-other agreement: does it really matter?Personnel Psychology, 51, 577–598.
6.
Atwater, L. E., Roush, P., & Fischthal, A. (1995). The influence of upward feedback on self and follower ratings of leadership. Personnel Psychology, 48, 35–59.
7.
Atwater, L. E., & Yammarino, F. J. (1993). Personal attributes as predictors of superiors’ and subordinates’ perception of military academy leadership. Human Relations, 46, 645–668.
8.
Atwater, L. E., & Yammarino, F. J. (1992). Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?Personnel Psychology, 45, 141–164.
9.
Bernardin, H. J., & Walter, C. S. (1977). Effects of rater training and diary-keeping on psychometric error in ratings. Journal of Applied Psychology, 62, 64–69.
10.
Bettenhausen, K. L., & Fedor, D. B. (1997). Peer and upward appraisals: a comparison of their benefits and problems. Group and Organizational Management, 22, 236–263.
11.
Borman, W. C. (1974). The rating of individuals in organizations: an alternative approach. Organizational Behavior and Human Performance, 12, 105–124.
12.
Borman, W. C. (1987). Personal constructs, performance schema, and “folk theories” of subordinate effectiveness: explorations in an army officer sample. Organizational Behavior and Human Decision Processes, 40, 307–322.
13.
Borman, W. C., & Motowidlo, S. J. (1993). Expanding the criterion domain to include elements of contextual performance. In N. Schimitt & W. C. Borman, Personnel selection in organizations (pp. 71–98). San Francisco: Jossey–Bass.
14.
Bracken, D. W., Timmreck, C. W., & Church, A. H. (2000). History and development of multiple-source feedback as a methodology. In D. Bracken, C. Timmreck, & A. Church (Eds.), Handbook of MultiSource Feedback (pp. 3–14). San Francisco: Jossey–Bass.
15.
Breusch, T., & Pagan, A. (1980). The Lagrange multiplier test and its applications to model specification in econometrics. Review of Economic Studies, 47, 239–253.
16.
Cardy, R. L., Bernardin, H. J., Abbott, J. G., Senderak, M. P., & Taylor, K. (1987). The effects of individual performance schemata and dimension familiarization on rating accuracy. Journal of Occupational Psychology, 60, 197–205.
17.
Cardy, R. L., & Dobbins, G. H. (1986). Affect and appraisal accuracy: liking as an integral dimension in evaluating performance. Journal of Applied Psychology, 71, 672–678.
18.
Chamberlain, G. (1980). Analysis covariance with qualitative data. Review of Economic Studies, 47, 225–238.
19.
Decotiis, T., & Petit, A. (1978). The performance appraisal process: A model and some testable propositions. Academy of Management Review, 3, 635–646.
20.
DeNisi, A. S., Cafferty, T. P., & Meglino, B. M. (1984). A cognitive view of the performance appraisal process: a model and research propositions. Organizational Behavior and Human Performance, 6, 109–155.
21.
Dipboye, R. L. (1985). Some neglected variables in research on discrimination in appraisals. Academy of Management Review, 10, 116–127.
22.
Edwards, M., & Ewen, A. J. (1996). 360-degree feedback—the powerful new model for employee assessment & performance improvement. New York: AMACON.
23.
Farh, J., & Werbel, J. D. (1986). Effects of purpose of the appraisal and expectation of validation on self-appraisal leniency. Journal of Applied Psychology, 71, 527–529.
24.
Favero, J. L., & Ilgen, D. R. (1989). The effects of ratee prototypicality on rater observation and accuracy. Journal of Applied Social Psychology, 19, 932–946.
25.
Feldman, J. M. (1981). Beyond attribution theory: cognitive processes in performance appraisal. Journal of Applied Psychology, 66, 127–148.
26.
Ferris, G. R., & Judge, T. A. (1991). Personnel/human resources management: a political influence perspective. Journal of Management, 17, 447–488.
27.
Fisher, C. C. (1979). Transmission of positive and negative feedback to subordinates: a laboratory investigation. Journal of Applied Psychology, 64, 533–540.
28.
Frink, D. D., & Klimoski, R. J. (1998). Toward a theory of accountability in organizations and organizations and human resources management. Research in Personnel and Human Resources Management, 16, 1–51.
29.
George, J. M., & Brief, A. P. (1992). Feeling good-doing good: a conceptual analysis of the mood at work— organizational spontaneity relationship. Psychological Bulletin, 112, 310–329.
30.
Gerhart, B. (1988). Sources of variance in incumbent perceptions of job complexity. Journal of Applied Psychology, 73, 154–162.
31.
Gerhart, B., & Milkovich, G. T. (1990). Organizational differences in managerial compensation and financial performance. Academy of Management Journal, 33, 663–691.
32.
Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972). Consequences of failure to meet assumptions underlying fixed effects analyses of variance and covariance. Review of Educational Research, 42, 237–288.
33.
Haeggberg, R. L., & Chen, P. Y. (1999). Can accountability assure the accuracy of upward appraisals? Paper presented at the Fourteenth Annual Conference for the Society for Industrial and Organizational Psychology, Atlanta.
34.
Holzback, R. L. (1978). Rater bias in performance ratings: superior, self, and peer ratings. Journal of Applied Psychology, 63, 579–588.
35.
Hsiao, C. (1986). Analysis of panel data. Cambridge: Cambridge University Press.
36.
Huber, P. J. (1967). The behavior of maximum likelihood estimates under non-standard conditions. In Proceedings of the Fifth Berkeley Symposium in Mathematical Statistics and Probability (pp. 221–233). Berkeley, CA: University of California Press.
37.
Ilgen, D. R., & Feldman, J. R. (1983). Performance appraisals: a process focus. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior. (Vol. 5, pp. 141–197). Greenwich, CT: JAI Press.
38.
Isen, A. M., Shalker, T. E., Clark, M. S., & Karp, L. (1978). Positive affect, accessibility of material in memory, and behavior: a cognitive loop. Journal of Personality and Social Psychology, 36, 1–12.
39.
Izard, C. E. (1982). Comments on emotion and cognition: can there be a working relationship? In M. S. Clark & S. T. Fiske (Eds.), Affect and Cognition (pp. 229–240). Hillsdale, NJ: Lawrence Erlbaum Associates Inc.
40.
Jones, E. E. (1964). Ingratiation. New York: Appleton–Century–Crofts.
41.
Judge, T. A., & Ferris, G. R. (1993). Social context of performance evaluation decisions. Academy of Management Journal, 36, 80–105.
42.
Kane, J. S., Bernardin, H. J., Villanova, P., & Peyrefitte, J. (1995). Stability of rater leniency: three studies. Academy of Management Journal, 38, 1036–1051.
43.
Kennedy, P. (1998). A guide to econometrics. Cambridge, MA: The MIT Press.
44.
Kenny, D. A., & Judd, C. M. (1986). Consequences of violating the independence assumption in analysis of variance. Psychological Bulletin, 99, 422–431.
45.
Klimoski, R., & Inks, L. (1990). Accountability forces in performance appraisal. Organizational Behavior and Human Decision Processes, 45, 194–208.
46.
Kingstrom, P. O., & Mainstone, L. E. (1985). An investigation of the rater-ratee acquaintance and rater bias. Academy of Management Journal, 28, 641–653.
47.
Kumar, K., & Beyerlein, M. (1991). Construction and validation of an instrument for measuring ingratiatory behaviors in organizational settings. Journal of Applied Psychology, 76, 619–622.
48.
Landy, F. J., & Farr, J. L. (1980). Performance ratings. Psychological Bulletin, 87, 72–107.
49.
Latham, G. P., & Wexley, K. N. (1982). Increasing productivity through performance appraisal. Reading, MA: Addision–Wesley.
50.
Lee, D. M., & Alvares, K. M. (1977). Effects of sex on descriptions and evaluations of supervisory behavior in a simulated industrial setting. Journal of Applied Psychology, 62, 405–410.
51.
Lefkowitz, J. (2000). The role of interpersonal affective regard in supervisory performance ratings: a literature review and proposed causal model. Journal of Occupational and Organizational Psychology, 73, 67–85.
52.
Liker, J. K., Augustyniak, S., & Duncan, G. J. (1985). Panel data and models of change: a comparison of first difference and conventional two-wave models. Social Science Research, 14, 80–101.
53.
London, M., & Smither, J. W. (1995). Can multi-source feedback change perceptions of goal accomplishments, self-evaluations, and performance-related outcomes?Theory-based applications and directions for research. Personnel Psychology, 48, 803–839.
54.
London, M., & Beatty, R. W. (1993). 360-degree feedback as a competitive advantage. Human Resource Management, 32, 353–374.
55.
Longenecker, C. O., Sims, H. P., Jr., & Gioia, D. A. (1987). Behind the mask: the politics of employee appraisal. Academy of Management Executive, 7, 183–193.
56.
Longenecker, C. O., Jaccoud, H. P., Sims, H. P., Jr., & Gioia, D. A. (1992). Quantitative and qualitative investigations of affect in executive judgment. Applied Psychology: An International Review, 41, 21–41.
57.
McBrearty, P. (1982). We should abolish anonymous evaluations of teachers by their students. Chronicle of Higher Education, 7, 25–48.
58.
Mero, N. P., & Motowidlo, S. J. (1995). Effects of rater accountability on the accuracy and the favorability of performance ratings. Journal of Applied Psychology, 80, 517–524.
59.
Motowidlo, S. J., & Van Scotter, J. R. (1994). Evidence that task performance should be distinguished from contextual performance. Journal of Applied Psychology, 79, 475–480.
60.
Mundlak, Y. (1978). On the pooling of time series and cross sectional data. Econometrica, 46, 69–86.
61.
Murphy, K. R., & Cleveland, J. N. (1991). Performance appraisal: an organizational perspective. Eglewood Cliffs, NJ: Prentice Hall.
62.
Organ, D. (1988). Organizational citizenship behavior: the good soldier syndrome. Lexington, MA: Lexington Books.
63.
Park, O. S., Sims, H. P., & Motowidlo, S. J. (1986). Affect in organizations. In H. P Sims & D. A. Giola (Eds.), The thinking organization. (pp. 77–90). San Francisco, CA: Jossey–Bass.
64.
Podsakoff, P., & Organ, D. W. (1986). Self reports in organizational research: problems and prospects. Journal of Management, 12, 531–544.
65.
Regan, D. T., Straus, E., & Fazio, R. (1974). Liking and the attribution process. Journal of Experimental Social Psychology, 10, 385–397.
66.
Robbins, T. L., & DeNisi, A. S. (1994). A closer look at interpersonal affect as a distinct influence on cognitive processing in performance evaluations. Journal of Applied Psychology, 79, 341–353.
67.
Rogers, W. H. (1993). Regression standard errors in clustered samples. Stata Technical Bulletin, 13, 19–23.
68.
Romano, C. (1994). Conquering the fear of feedback. HR Focus, 71, 9–10.
69.
Rosenbaum, A. E., Lehman, W. E. K., & Holcom, M. L. (1993). Effects of personal accountability and rating consequences on performance evaluation. Paper presented at the Eighth Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco, CA.
70.
Saal, F. E., Downey, R. G., & Lahey, M. A. (1980). Rating the ratings: assessing the psychometric quality of rating data. Psychological Bulletin, 88, 413–428.
71.
Schmitt, N., & Klimoski, R. (1991). Research methods in human resource management. Cincinnati: Southwestern Publishing.
72.
Smith, D. E. (1986). Training programs for performance appraisal: a review. Academy of Management Review, 11, 22–40.
73.
Snyder, M., & Cantor, N. (1979). Testing hypotheses about other people: the use of historical knowledge. Journal of Experimental Social Psychology, 15, 330–342.
74.
Srull, T. K., & Wyer, R. S., Jr. (1980). Category accessibility and social perception: some implications for the study of person memory and interpersonal judgments. Journal of Personality and Social Psychology, 38, 841–856.
75.
Tetlock, P. E., & Kim, J. I. (1987). Accountability and judgment processes in a personality prediction task. Journal of Personality and Social Psychology, 52, 700–709.
76.
Tornow, W. W. (1993). Editor’s note: introduction to special issue on 360-degree feedback. Human Resource Management, 32, 211–220.
77.
Tornow, W. W., London, M., & CCL Associates. (1998). Maximizing the value of 360-degree feedback. A process for successful individual and organizational development. San Francisco: Jossey–Bass.
78.
Tsui, A. S., & Barry, B. (1986). Interpersonal affect and rating errors. Academy of Management Journal, 29, 586–599.
79.
Vance, R. J., Winne, P. S., & Wright, S. E. (1983). A longitudinal examination of rater and ratee effects in performance ratings. Personnel Psychology, 36, 609–621.
80.
Varma, A., DeNisi, A. S., & Peters, L. H. (1996). Interpersonal affect and performance appraisal: a field study. Personnel Psychology, 49, 341–360.
81.
Waldman, D., Atwater, L. A., & Antonioni, D. (1998). Has 360-degree feedback gone amok?Academy of Management Executive, 12, 86–94.
82.
Waldman, D., & Thornton, G. C., III. (1988). A field study of rating conditions and leniency in performance appraisal. Psychological Reports, 63, 835–840.
83.
Wayne, S. J., & Ferris, G. R., 1990. Influence tactics, affect, and exchange quality in supervisor-subordinate interactions: a laboratory experiment and a field study. Journal of Applied Psychology, 75, 487–499.
84.
White, H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48, 817–830.
85.
White, H. (1982). Maximum likelihood estimation of mis-specified models. Econometrica, 50, 1–25.
86.
Zajonc, R. B. (1980). Feeling and thinking: preferences need no inferences. American Psychologist, 35, 151–175.
