The problem and the solution . Empirical research suggests that, on average, the changes made by leaders after receiving multisource feedback (MSF) are positive, but fairly small. Four sets of explanations for these results are analyzed in this article: potential limitations in the design of previous studies on MSF, the psychometric characteristics of MSF instruments, flaws in implementing MSF systems, and theory-based explanations of development following receipt of feedback. Models of development, feedback, and MSF suggest that it is unrealistic to expect MSF to lead to development for all leaders. Implications for practice and research are discussed. MSF can help many leaders develop, but only when associated development programs are correctly designed and implemented.
Atwater, L.E., & Brett, J.F. (2005). Antecedents and consequences of reactions to 360-degree feedback. Journal of Vocational Behavior, 66(3), 532-548.
2.
Atwater, L., & Brett, J. (2006a). Feedback format: Does it influence a manager's reactions to feedback? Journal of Occupational and Organizational Psychology, 26, 517-532.
3.
Atwater, L.E., & Brett, J.F. (2006b). 360-degree feedback to leaders: Does it relate to changes in employee attitudes? Group & Organization Development, 31, 578-600.
4.
Atwater, L.E., Waldman, D.A., & Brett, J.F. (2002). Understanding and optimizing multisource feedback . Human Resource Management, 41, 193-208.
5.
Atwater, L., Waldman, D., Ostroff, C., Robie, C., & Johnson, K.M. (2005). Self-other agreement: Comparing its relationship with performance in the U.S. and Europe. International Journal of Selection and Assessment, 13, 25-40.
6.
Beehr, T.A., Ivanitskaya, L., Hansen, C.P., Erofeev, D., & Gudanowski, D.M. (2001). Evaluation of 360 degree feedback ratings: Relationships with each other and with performance and selection predictors. Journal of Organizational Behavior, 22, 775-788.
7.
Bernardin, H.J., Hagan, C., & Kane, J.S. (1995). The effects of a 360-degree appraisal system on managerial performance: No matter how cynical I get, I can't keep up. In W. W. Tornow (Chair), Upward feedback: The ups and downs of it. Symposium conducted at the 10th annual conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
8.
Bono, J.E., & Colbert, A.E. (2005). Understanding responses to multi-source feedback: The role of core self-evaluations. Personnel Psychology, 58, 171-203.
9.
Borman, W.C. (1997). 360° ratings: An analysis of assumptions and a research agenda for evaluating their validity. Human Resource Management Review, 7, 299-315.
10.
Bracken, D.W., Timmreck, C.W., & Church, A.H. (2001a). Introduction: A multisource feedback process model. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 3-14). San Francisco: Jossey-Bass.
11.
Bracken, D.W., Timmreck, C.W., & Church, A.H. (2001b). Preface. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. xxi-xxxiv). Francisco: Jossey-Bass.
12.
Brutus, S., Derayeh, M., Fletcher, C., Bailey, C., Velazquez, P., Shi, K., et al. (2006). Internationalization of multi-source feedback systems: A six-country exploratory analysis of 360-degree feedback. International Journal of Human Resource Management, 17, 1888-1906.
13.
Campbell, J.P. (1988). Training design for performance improvement. In J. P. Campbell, R. J. Campbell, & Associates (Eds.), Productivity in organizations: New perspectives from industrial and organizational psychology (pp. 177-215). San Francisco : Jossey-Bass.
14.
Chappelow, C.T. (2004). 360-degree feedback. In C. D. McCauley & E. Van Velsor (Eds.), Handbook of leadership development (2nd ed., pp. 58-84). San Francisco: John Wiley & Sons, Inc.
15.
Church, A.H., & Waclawski, J. (2001). A five-phase framework for designing a successful multisource feedback system. Consulting Psychology Journal: Practice and Research, 53, 82-95.
16.
Conway, J.M., & Huffcut, A.I. (1997). Psychmetric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings . Human Performance, 10, 331-360.
17.
Foster, C.A., & Law, M.R.F. (2006). How many perspectives provide a compass? Differentiating 360-degree and multi-source feedback. International Journal of Selection and Assessment, 14, 288-291.
18.
Goldsmith, M., & Underhill, B.O. (2001). In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 275-288). San Francisco : Jossey-Bass.
19.
Goodstone, M.S., & Diamonte, T. (1998). Organizational use of therapeutic change: Strengthening multisource feedback systems through interdisciplinary coaching. Consulting Psychology Journal: Practice and Research, 50, 152-163.
20.
Hazucha, J.F., Hezlett, S.A., & Schneider, R.S. (1993). The impact of 360-degree feedback on management skills development. Human Resource Management, 32, 325-351.
21.
Hernez-Broome, G., & Hughes, R.L. (2004). Leadership development: Past, present, and future . Human Resource Planning, 27, 24-32.
22.
Kluger, A.N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin , 119, 254-284.
23.
Luthans, F., & Peterson, S.J. (2003). 360-degree feedback with systematic coaching: Empirical analysis suggests a winning combination. Human Resource Management, 42, 243-256.
24.
Martineau, J.W. (1998). Using 360-degree surveys to assess change. In W. W. Tornow, M. London, & CCL Associates (Eds.), Maximizing the value of 360-degree feedback. (pp. 217-248). San Francisco: Jossey-Bass.
25.
Maurer, T.J., Mitchell, D.R.D., & Barbeite, F.G. (2002). Predictors of attitudes toward a 360-degree feedback system and involvement in post-feedback management development activity. Journal of Occupational and Organizational Psychology, 75, 87-107.
26.
McCarthy, A., & Garavan, T. (2006). Postfeedback development perceptions: Applying the theory of planned behavior. Human Resource Development Quarterly, 17, 245-267.
27.
McCauley, C.D., & Hezlett, S.A. (2001). Individual development in the workplace. In N. R. Anderson, D. S. Ones, H. K. Sinangil, & C. Visweswaran (Eds.), Handbook of work psychology: Volume 1, Personnel Psychology (pp 313-335). Thousand Oaks, CA: Sage.
28.
Morgan, A., Cannan, K., & Cullinane, J. (2005). 360° feedback: A critical enquiry. Personnel Review, 6, 663-680.
29.
Morgeson, F.P., Mumford, T.V., & Campion, M.A. (2005). Coming full circle: Using research and practice to address 27 questions about 360-degree feedback programs. Consulting Psychology Journal: Practice and Research, 57, 196-209.
30.
Mount, M.K., & Scullen, S.E. (2001). Multisource feedback ratings: What do they really measure? In M. London (Ed.), How people evaluate others in organizations (pp. 155-176). Mahwah, NJ: Lawrence Erlbaum.
31.
Murphy, K.R., Cleveland, J.N., & Mohler, C.J. (2001). Reliability, validity, and meaningfulness of multisource ratings. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 130-148). San Francisco: Jossey-Bass.
32.
Reilly, R.R., Smither, J.W., & Vasilopoulos, N.L. (1996). A longitudinal study of upward feedback. Personnel Psychology, 49, 599-612.
33.
Scullen, S.E., Mount, M.K., & Judge, T.A. (2003). Evidence of the construct validity of developmental ratings of managerial performance. Journal of Applied Psychology , 88, 50-66.
34.
Seifert, C.F., Yukl, G., & McDonald, R.A. (2003). Effects of multisource feedback and a feedback facilitator on the influence behavior of managers toward subordinates. Journal of Applied Psychology, 88, 561-569.
35.
Smither, J.W., London, M., & Reilly, R.R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings . Personnel Psychology, 58, 33-66.
36.
Smither, J.W., London, M.L., Flautt, R., Vargas, Y., & Kucine, I. (2003). Can working with an executive coach improve multisource feedback ratings over time? A quasi-experimental field study. Personnel Psychology, 56, 23-44.
37.
Smither, J.W., London, M., Vasilopoulos, N.L., Reilly R. R., Millsap, R.E., & Salvemini, N. (1995). An examination of the effects of an upward feedback program over time. Personnel Psychology, 48, 1-34.
38.
Smither, J.W., & Walker, A.G. (2001). Measuring the impact of multisource feedback. In D. W. Bracken, C. W. Timmreck, & A. H. Church (Eds.), The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes (pp. 256-271). San Francisco: Jossey-Bass.
39.
Tannenbaum, S.I., & Yukl, G. (1992). Training and development in organizations. Annual Review of Psychology, 43, 399-441.
40.
Tornow, W.W. (1993). Perceptions or reality: Is multi-perspective measurement a means or an end? Human Resource Management, 32, 221-229.
41.
Walker, A.G., & Smither, J.W. (1999). A five-year study of upward feedback: What managers do with their results matters. Personnel Psychology, 52, 393-423.
