Drawing from game theoretical research, we explore the degree to which rater anonymity affects consequences of peer assessment with respect to individual effectiveness and contribution to group processes. Using longitudinal data collected in a kibbutz-owned manufacturing facility in Israel, we found peer assessment to be associated with a general improvement of supervisory ratings of subordinates over time. More important, this improvement was found to be significantly greater among individuals working in departments assigned to a nonanonymity assessment condition relative to those assigned to an anonymous condition. The theoretical and practical implications of these findings are discussed.
Albanese, R., & Van Fleet, D. (1985). Rational behavior in groups: The free-riding tendency. Academy of Management Review, 10, 244-255.
2.
Antonioni, D. (1994). The effects of feedback accountability on upward appraisal ratings. Personnel Psychology, 47, 349-356.
3.
Antonioni, D., & Park, H. (2001). The relationship between rater affect and three sources of 360-degree feedback ratings. Journal of Management, 27, 479-495.
4.
Atwater, L., Waldman, D., Atwater, D., & Cartier, P. (2000). An upward feedback field experiment: Supervisors’ cynicism, reactions, and commitment to subordinates. Personnel Psychology, 53, 275-297.
5.
Axelrod, R., & Dion, D. (1988). The further evolution of cooperation. Science, 242, 1385-1390.
6.
Bamberger, P., & Meshoulam, I. (2002). Human resource strategy: Formulation, implementation and impact. Thousand Oaks, CA: Sage.
7.
Brutus, S., Fleenor, J., & London, M. (1998). Elements of effective 360-degree feedback. In W. W. Tornow, M. London, & C. C. L. Associates (Eds.), Maximizing the value of 360-degree feedback (pp. 11-27). San Francisco: Jossey-Bass.
8.
Cederblom, D., & Lounsbury, J. W. (1980). An investigation of user acceptance of peer evaluations. Personnel Psychology, 33, 567-579.
9.
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
10.
Deadrick, D. L., Bennett, N., & Russell, C. J. (1997). Using hierarchical linear modeling to examine dynamic performance criteria over time. Journal of Management, 23, 745-757.
11.
Deadrick, D. L., & Madigan, R. M. (1990). Dynamic criteria revisited: A longitudinal study of performance stability and predictive validity. Personnel Psychology, 43, 717-744.
12.
DeNisi, A. S., Randolph, W. A., & Blencoe, A. (1983). Potential problems with peer ratings. Academy of Management Journal, 26, 457-464.
13.
DeNisi, A. S., & Stevens, G. (1981). Profiles of performance, performance evaluation and personnel decisions. Academy of Management Review, 24, 592-602.
14.
Druskat, V. U., & Wolff, S. B. (1999). Effects and timing of developmental peer appraisals in self-managing work groups. Journal of Applied Psychology, 84, 58-74.
15.
Erev, I., & Roth, A. (1998). Predicting how people play games: Reinforcement learning processes on games with unique mixed strategy equilibrium. American Economic Review, 88, 848-881.
16.
Erez, A., Lepine, J. A., & Elms, H. (2002). Effects of rotated leadership and peer evaluation on the functioning and effectiveness of self-managed teams: A quasi-experiment. Personnel Psychology, 55, 929-948.
17.
Fedor, D., & Bettenhausen, K. (1989). The impact of purpose, participant preconceptions and rating level on the acceptance of peer evaluations. Group and Organization Studies, 14, 182-197.
18.
Fedor, D.B., Bettenhausen, K., & Davis, W. (1999). Peer evaluations: Employees’ dual roles as raters and recipients. Group and Organization Management, 24, 92-121.
19.
Fox, J., & Guyer, M. (1978). “Public” choice and cooperation in n-person prisoner’s dilemma. Journal of Conflict Resolution, 22, 468-481.
20.
Fusilier, M. R. (1980). The effects of anonymity and outcome contingencies on rater beliefs and behavior in a performance appraisal situation. Proceedings of the 40th Annual Meeting of the Academy of Management, 273-277.
21.
Grissom, R. J., & Kim, J. J. (2001). Review of assumptions and problems in the appropriate conceptualization of effect size. Psychological Methods, 6, 135-146.
22.
Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. Human Resource Management, 32, 325-351.
23.
Hedge, J. W., Borman, W. C., & Birkeland, S. A. (2001). History and development of multisource feedback as a methodology. In D. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback (pp. 15-32). San Francisco: Jossey-Bass.
24.
Hinkin, T. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21, 967-988.
25.
James, L. R., Mulaik, S. A., & Brett, J. M. (1982). Causal analysis: Assumptions, models and data. Beverly Hills, CA: Sage.
26.
Kane, J., & Lawler, E. (1978). Methods of peer assessment. Psychological Bulletin, 85, 555-586.
27.
Kelloway, E. K. (1998). Using LISREL for structural equation modeling. Thousand Oaks, CA: Sage.
28.
Kerr, N., & Brunn, S. (1981). Ringelann revisited: Alternate explanations for the social loafing effect. Personality and Social Psychology Bulletin, 7, 224-231.
29.
Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30, 255-268.
30.
Leslie, J. B., Gurskiewicz, N. D., and Dalton, M. A. (1998). Understanding cultural differences on the 360-degree feedback process. In W. Tornow, M. London, & C. C. L. Associates (Eds.), Maximizing the value of 360-degree feedback (pp. 196-216). San Francisco: Jossey-Bass.
31.
London, M., & Smither, J. (1995). Can an multi-source feedback change perceptions of goal accomplishment, self-evaluations and performance related outcomes? Theory-based applications and directions for research. Personnel Psychology, 48, 803-839.
32.
London, M., Smither, J., & Adsit, D. (1997). Accountability: The Achilles heel of multi-source feedback. Group and Organization Management, 22, 162-184.
33.
Luce, R., & Raiffa, H. (1957). Games and decisions. New York: Wiley.
34.
Martineau, J. W. (1998). Using 360-degree surveys to assess change. In W. W. Tornow, M. London, & C. C. L. Associates (Eds.), Maximizing the value of 360-degree feedback (pp. 217-248). San Francisco: Jossey-Bass.
35.
Maurer, T. J., & Tarulli, B. A. (1996). Acceptance of peer/upward performance appraisal systems: Role of work context factors and beliefs about managers’ development capability. Human Resource Management, 35, 217-241.
36.
McIntyre, R. M., & Salas, E. (1995). Measuring and managing for team performance: Lessons from complex environments. In R. A. Guzzo & E. Salas (Eds.), Team effectiveness and decision-making in organizations (pp. 9-45). San Francisco: Jossey-Bass.
37.
Mero, N. P., & Motowidlo, S. J. (1995). Effects of rater accountability on the accuracy and the favorability of performance ratingsJournal of Applied Psychology, 80, 517-524.
38.
Murninghan, J. K., & Roth, A. R. (1983). Expecting continued play in prisoner’s dilemma games: A test of several modelsJournal of Conflict Resolution, 2, 279-300.
39.
Murphy, K. R. (1989). Is the relationship between cognitive ability and job performance stable over timeHuman Performance, 2, 183-200.
40.
Oldstein, Z., Carmi, O., Meshulam, I., Saar, M., Rotenstreich, Y., & Rimer, A. (1981). Manual for the human resource manager (In Hebrew). Tel Aviv, Israel: Productivity Institute.
41.
O’Reilly, C., Caldwell, D., & Barnett, W. (1989). Work group demography, social integration and turnoverAdministrative Science Quarterly, 34, 21-37.
42.
Reilly, R. R., & Chao, G. T. (1982). Validity and fairness of some alternative employee selection proceduresPersonnel Psychology, 78, 113-123.
43.
Ross, M., & Sicoly, F. (1979). Egocentric biases in availability and attributionJournal of Personality and Social Psychology, 37, 322-336.
44.
Russell, C. J., & Bobko, P. (1992). Moderated regression analysis and Likert scales: Too coarse for comfortJournal of Applied Psychology, 77, 336-342.
45.
Saavedra, R., & Kwun, S. (1993). Peer evaluation in self-managing work groupsJournal of Applied Psychology, 78, 450-462.
46.
Schwab, D. P. (1980). Construct validity in organizational behaviorResearch in Organizational Behavior, 2, 3-43.
47.
Tabachnik, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Boston: Allyn and Bacon.
48.
Tagger, S., & Brown T. C. (2001, August). Interpersonal affect and rating errors following prior peer-feedback in teams. Paper presented at the 61st annual meeting of the Academy of Management, Washington, D.C.
49.
Tjosvold, D. (1984). Cooperation theory and organizationsHuman Relations, 37, 743-767.
50.
Tornow, W. W., & London, M. (1998). Challenges and implications for maximizing 360-degree feedback. In W. W. Tornow, M. London, & C. C. L. Associates (Eds.), Maximizing the value of 360-degree feedback (pp. 249-258). San Francisco: Jossey-Bass.
51.
Tornow, W. W., & Tornow, C. P. (2001). Linking multisource feedback content with organizational needs. In D. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multi source feedback (pp. 48-62). San Francisco: Jossey-Bass.
52.
Van Velsor, E. (1998). Designing 360-degree feedback to enhance involvement, self-determination and commitment. In W. W. Tornow, M. London, & C. C. L. Associates (Eds.), Maximizing the value of 360-degree feedback (pp. 149-195). San Francisco: Jossey-Bass.
53.
Wageman, R. (1995). Interdependence and group effectivenessAdministrative Science Quarterly, 40(1), 145-180.
54.
Wagner, J. A. III. (1995). Studies of individualism-collectivism: Effects on cooperationAcademy of Management Journal, 38, 152-172.
55.
Waldman, D. A., Atwater, L. E., & Antonioni, D. (1998). Has 360 degree feedback gone amokAcademy of Management Executive, 12, 86-94.
