A laboratory simulation was conducted in order to examine the influence of assessees' pattern of performance (ascending, consistently average, descending) on: (a) assessor ratings of assessee performance, (b) assessor attributionsfor assessee performance and, (c) rating accuracy. The influence of rating frequency (i.e., rating at the end of each exercise versus rating after all exercises have been concluded) on assessor accuracy was also examined. As predicted, assessees who exhibit different patterns of performance receive different ratings even though their overall level of performance is similar. More specifically, the ascending performer was rated higher in terms of leadership, decision-making, and persuasiveness, than either the consistently average or descending performer. It was alsofound that descending and ascending performance was attributed more to motivation causes than consistently average performance, and that descending performance was attributed more to ability causes (i.e., a lack of ability) than either the ascending or consistently average performer. With respect to rating accuracy, it was found that descending and ascending performance was rated more accurately than consistently average performance and that subjects who made ratings at the conclusion of each exercise did not make more accurate overall assessment ratings than those subjects who made overall assessment ratings only. Instead, it was found that the accuracy of overall assessment ratings was greatest when ratings collected after each exercise were averaged. The implications of these results for assessment center procedures is discussed.
Get full access to this article
View all access options for this article.
References
1.
Bass, B.M. (1954). The leaderless group discussion. Psychological Bulletin, 51, 465-492.
2.
Bernardin, H.J., & Walter, C.S. (1977). Effects of rater training and diary-keeping on psychometric error in ratings. Journal of Applied Psychology, 62, 64-69.
3.
Bernardin, H.J. & Beatty, R.W (1984). Performance appraisal: Assessing human behavior at work. Boston, MA: Kent Publishing Co.
4.
Borman, WC. (1977). Consistency of rating accuracy and rating errors in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238-252.
5.
Borman, WC. (1982). Validity of behavioral assessment for predicting military recruiter performance. Journal of Applied Psychology, 67, 3-9.
6.
Borman, W.C., Eaton, N.K., Bryan, J.D., & Rosse, R.L. (1983). Validity of army recruiter behavioral assessment: Does the assessor make a difference?Journal of Applied Psychology, 68, 415-419.
7.
Bray, D. W.., & Grant, D. L. (1966). The assessment center in the measurement of potential for business management. Psychological Monographs, 80, (17, Whole No. 625).
8.
Cascio, W.E., & Silbey, V. (1979). Utility of the assessment center as a selection device. Journal of Applied Psychology, 64, 107-118.
9.
Cascio, W.E., & Ramos, R.A. (1986). Development and Application of a new method for assessing job performance in behavioral/economic terms. Journal of Applied Psychology, 71, 20-28.
10.
DeNisi, A.S., & Stevens, G.E. (1981). Profiles of performance, performance evaluations, and personnel decisions. Academy of Management Journal, 24, 592-602.
11.
DeNisi, A.S., Cafferty, T.P., & Meglino, B.M. (1984). A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Performance, 33, 360-396.
12.
Gioia, D.A., & Sims, H.P. Jr. (1986). Cognition behavior connections: Attribution and verbal behavior in leader-subordinate interactions. Organizational Behavior and Human Decision Processes, 37, 197-229.
13.
Hastie, R., & Kumar, P. (1979). Person memory: Personality traits as organizing principles in memory for behavior. Journal of Personality and Social Psychology, 37, 25-38.
14.
Heneman, R.L., & Wexley, K.N. (1983). The effects of time delay in rating and amount of information observed on performance rating accuracy. Academy of Management Journal, 26, 677-686.
15.
Herrist, P., Chalmers, C., & Wingrove, J. (1985). Group decision making in an assessment centre. Journal of Occupational Psychology, 58, 309-312.
16.
Higgins, E.T., & Bargh, J.A. (1987). Social cognition and social perception. Annual Review of Psychology, 38, 369-425.
17.
Jones, E.E., Rock, L., Shaver, K.G., Goethals, G.R., & Ward, L.M. (1968). Pattern of performance and ability attribution: An unexpected primacy effect. Journal of Personality and Social Psychology, 10, 317-340.
18.
Klimoski, R.J., Friedman, B .A., & Weldon, E. (1980). Leaders influence in the assessment of performance. Personnel Psychology, 33, 389-401.
19.
Lingle, J., & Ostrom, T. (1979). Retrieval selectivity in memory-based impression judgments. Journal of Personality and Social Psychology, 37, 180-194.
20.
Mitchell, T.R., & Kalb, L.S. (1981). Effects of outcome knowledge and outcome valence on supervisor's evaluations. Journal of Applied Psychology, 66, 604-612.
21.
Pulakos, E.D. (1984). A comparison of rater training programs: Error training and accuracy training. Journal of Applied Psychology, 69, 581-588.
22.
Ross, L. (1977). The intuitive psychologist and his shortcomings: Distortions in the attribution process. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 10).New York: Academic Press.
23.
Russell, C.J. (1985). Individual decision processes in an assessment center. Journal of Applied Psychology, 70, 737-746.
24.
Sackett, P.R. (1987). Assessment centers and content validity: Some neglected issues. Personnel Psychology, 40, 13-25.
25.
Sackett, P.R., & Hakel, M.D. (1979). Temporal stability and individual differences in using assessment information to form overall ratings. Organizational Behavior and Human Performance, 23, 120-137.
26.
Schank, R., & Abelson, R. (1977). Scripts, plans, goals, and understanding. Hillsdale, NJ: Erlbaum.
27.
Schmitt, N. (1977). Interrater agreement in dimensionality and combination of assessment center judgments. Journal of Applied Psychology, 67, 10-17.
28.
Schmitt, N., & Hill, T. (1977). Sex and race composition of assessment center groups as a determinant of peer and assessor ratings. Journal of Applied Psychology, 62,251-264.
29.
Schmitt, N., Noe, R.J., Meritt, R., & Fitzgerald, M.P (1984). Validity of assessment center ratings for the prediction of performance ratings and school climate of school administrators. Journal of Applied Psychology, 69, 207-213.
30.
Scott, W.E., & Hamner, WC. (1975). The influence of variations in performance profiles on the performance evaluation process: An examination of the validity of the criterion. Organizational Behavior and Human Performance, 14, 360-370.
Smith, P.C., & Kendall, L.M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149-155.
33.
Souder, W.E., & Leksich, A.M. (1983). Assessment centers are evolving toward a bright future. Personnel Administrator, 28 (11), 80-87.
34.
Srull, T.K., & Wyer, R.S. (1980). Category accessibility and social perception: Some implications for the study of person memory and interpersonal judgments. Journal of Personality and Social Psychology, 38, 841-856.
35.
Taylor, S.E., Crocker, J., Fiske, S.T., Sprinzen, M., & Winkler, J. (1979). The generalizability of salience effects. Journal of Personality and Social Psychology, 37, 357-368.
36.
Taylor, S.E., & Fiske, S.T. (1979). Salience, attention and attribution: Top of the head phenomena. In L. Berkowitz (Ed.) Advances in experimental social psychology (Vol. 11). New York: Academic Press.
37.
Thornton, G.C., & Byham, WC. (1982). Assessment centers and managerial performance. New York: Academic Press.
38.
Weiner, B., Frieze, I., Kukla, A., Reed, L., Rest, S., & Rosenbaum, R. (1971). Perceiving the causes of success andfailure. New York: General Learning Press.
39.
Wexley, K.N., Yukl, G.A., Kovacs, S.Z., & Sanders, R.E. (1972). Importance of content effects in employment interviews. Journal of Applied Psychology, 56, 45-48.
40.
Wiggins, J. (1973). Personality and prediction: Principles of personality assessment. Reading, MA: Addison-Wesley.
41.
Zedeck, S. (1986). A process analysis of the assessment center method. In L.L. Cummings & B.M. Staw (Eds.), Research in organizational behavior (Vol. 8, pp. 259-296). Greenwich, CT: JAI Press.
