Podsakoff and Todor (1985) proposed partialling the first principal component from observed correlations as a procedure for controlling method variance. Using mathematical derivations and Monte Carlo simulation, we found that this procedure is biased. Partialling out the first principal component introduces a negative bias into the resulting correlations that seriously compromises subsequent analysis. Moreover, the extent of bias is not reduced by increasing sample size; however, it is inversely proportional to the number of variables. Therefore, partialling the first principal component is not recommended. Researchers are encouraged to collect data with multiple methods whenever feasible.
Get full access to this article
View all access options for this article.
References
1.
Campbell, D.T., & Fiske, D.W (1959). Convergent and discriminant validation by the multitraitmultimethod matrix. Psychological Bulletin, 56, 81-105.
2.
Cook, T.D., & Campbell, D.T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton-Mifflin.
3.
Dunlap, WP., Jones, M.B., & Bittner, A. (1983). Average correlations vs. correlated averages. Bulletin of the Psychonomic Society, 21, 213-216.
4.
Edwards, A.L. (1953). The relationship between the desirability of a trait and the probability that the trait will be endorsed. Journal of Applied Psychology, 37, 90-93.
5.
Edwards, A.L. (1957). The social desirability variable in personality assessment and research. New York: Dryden.
6.
Harvey, R.J. (1982). The future of partial correlations as a means to reduce halo in performance ratings. Journal of Applied Psychology, 67, 171-176.
7.
Hulin, C.L. (1982). Some reflections on general performance dimensions and halo rating error. Journal of Applied Psychology, 67165-170.
8.
Landy, F.J., Vance, R.J., & Barnes-Farrell, J.L. (1980). Statistical control of halo in performance ratings. Journal of Applied Psychology, 65, 501-506.
9.
Messick, S. (1967). The psychology of acquiescence: An interpretation of the research evidence. In L.A. Berg (Ed.), Response set in personality assessment (pp. 115-145). Chicago: Aldine.
10.
Meyers, J.H. (1965). Removing halo from job evaluation factor structures. Journal of Applied Psychology, 49, 217-221.
11.
Murphy, K.R. (1982). Difficulties in the statistical control of halo. Journal of Applied Psychology, 67, 161-164.
12.
Podsakoff, P.M., & Organ, D.W (1986). Self-reports in organizational research: Problems and prospects. Journal of Management, 12, 531-544.
13.
Podsakoff, PM., & Todor, W D. (1985). Leader behavior and group processes. Journal of Management, 10, 55-73.
14.
Steiger, J.H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87245-251.
