Data from a sample of government research scientists were used to compare the psychometric properties of pooled and consensus ratings of job performance. It was hypothesized that consensus ratings would possess less halo and leniency error and greater validity than would pooled ratings. The findings supported the halo hypothesis and partially supported the validity hypothesis. Given the severity of the “criterion problem” in validation research, further research was recommended to extend the generalizability of these findings to other performance appraisal settings.
Get full access to this article
View all access options for this article.
References
1.
DelbecqA. L.Van de VenA. H.GustafsonD. H. (1975) Group techniques for program planning. Glenview, IL: Scott, Foresman.
2.
EinhornH. J.HogarthR. M.KlempnerE. (1977) Quality of group judgment. Psychological Bulletin, 84, 158–172.
3.
GuionR. M. (1965) Personnel testing. New York: McGraw-Hill.
4.
HallE. J.MoutonJ. S.BlakeR. R. (1963) Group problem-solving effectiveness under conditions of pooling vs. interaction. Journal of Social Psychology, 59, 147–157.
5.
JanisI. L.MannL. (1977) Decisionmaking. New York: Free Press.
6.
LathamG. P.WexleyK. N.PursellE. D. (1975) Training managers to minimize rating errors in the observation of behavior. Journal of Applied Psychology, 60, 550–555.
7.
LibbyR.BlashfieldR. K. (1978) Performance of a composite as a function of the number of judges. Organizational Behavior and Human Performance, 21, 121–129.
8.
McNemarQ. (1969) Psychological statistics. New York: Wiley.
9.
MiddletonM. A.WarrenL. (1972) Risk-taking effects on group decisionmaking. Journal of Psychology, 82, 189–196.
10.
NemiroffP. M.KingD. C. (1975) Group decisionmaking performance as influenced by consensus and self-orientation. Human Relations, 28, 1–21.
11.
NunnallyJ. C. (1967) Psychometric theory. New York: McGraw-Hill.
