Employment of the bootstrap method to approximate the sampling variation of eigenvalues is explicated, and its usefulness is amplified by an illustration in conjunction with two commonly used number-of-factors criteria: eigenvalues larger than one and the scree test. Confidence intervals for eigenvalues are approximated for sample correlation matrices that have ones and squared multiple correlation coefficients on the diagonals. The results demonstrate the usefulness of the bootstrap method in providing information about the sampling variability of eigenvalues-knowledge that affords a basis for more informed decisions regarding the number of factors when employing common criteria. Further, this information can be obtained with little difficulty, and the approach avoids tenuous assumptions of symmetric confidence intervals.
Get full access to this article
View all access options for this article.
References
1.
Anderson, T. W. (1984). An introduction to multivariate statistical analysis (2nd ed.). New York: Wiley.
2.
Armstrong, J. S. and Soelberg, P. (1968). On the interpretation of factor analysis. Psychological Bulletin, 70, 361-364.
3.
Beran, R. and Srivastava, M. S. (1985). Bootstrap tests and confidence regions for functions of a covariance matrix. Annals of Statistics, 13, 95-115.
4.
Bickel, P. J. and Freedman, D. A. (1981). Some asymptotic theory for the bootstrap. Annals of Statistics, 9, 1196-1217.
5.
Billingsley, P. (1968). Convergence of probability measures. New York: Wiley.
6.
Bunke, O. and Droge, B. (1984). Bootstrap and cross-validation estimates of the prediction error for linear regression models. Annals of Statistics, 12, 1400-1424.
7.
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.
8.
Cattell, R. B. (1978). The scientific use of factor analysis in behavioral and life sciences. New York: Plenum Press.
9.
Cattell, R. B. and Jaspers, J. (1967). General plasmode (No. 30-10-5-2) for factor analytic exercises and research. Multivariate Behavioral Research Monographs, No. 67-3.
10.
Cattell, R. B. and Vogelmann, S. (1977). A comprehensive trial of the scree and KG criteria for determining the number of factors. Multivariate Behavioral Research, 12, 289-325.
11.
Chung, K. L. (1968). A course in probability theory. New York: Harcourt, Brace & World.
12.
Cliff, N. and Hamburger, C. D. (1967). The study of sampling errors in factor analysis by means of artificial experiments. Psychological Bulletin, 68, 430-445.
13.
Coovert, M. D. and McNelis, K. (1988). Determining the number of common factors in factor analysis: A review and program. Educational and Psychological Measurement, 48, 687-692.
14.
Crawford, C. B. (1975). Determining the number of interpretable factors. Psychological Bulletin, 82, 226-237.
15.
Diaconis, P. and Efron, B. (1983). Computer-intensive methods in statistics. Scientific American, 248, 116-130.
16.
Dillon, W. R. and Goldstein, M. (1984). Multivariate analysis. New York: Wiley.
17.
Dolker, M. , Halperin, S., and Divgi, D. R. (1982). Problems with bootstrapping Pearson correlations in very small bivariate samples. Psychometrika, 47, 529-530.
18.
Efron. B. (1979a). Bootstrap methods: Another look at the jack-knife. Annals of Statistics, 7, 1-26.
19.
Efron, B. (1979b). Computers and the theory of statistics: Thinking the unthinkable. SIAM Review, 21, 460-480.
20.
Efron, B. (1981). Nonparametric standard errors and confidence intervals. Canadian Journal of Statistics, 9, 139-172.
21.
Efron, B. (1982). The jackknife, the bootstrap and other resampling plans. Philadelphia: Society for Industrial and Applied Mathematics.
22.
Efron, B. (1987a). Better bootstrap confidence intervals. Journal of the American Statistical Association, 82, 171-185.
23.
Efron, B. (1987b). Rejoinder. Journal of the American Statistical Association, 82, 198-200.
24.
Efron, B. and Gong, G. (1983). A leisurely look at the bootstrap, the jackknife, and cross-validation. American Statistician, 37, 36-48.
25.
Efron, B. and Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science, 1, 54-75.
26.
Freedman, D. A. (1981). Bootstrapping regression models. Annals of Statistics, 9, 1218-1228.
27.
Freedman, D. (1984). On bootstrapping two-stage least-squares estimates in stationary linear models. Annals of Statistics, 12, 827-842.
28.
Freedman, D. A. and Peters, S. C. (1984a). Bootstrapping a regression equation: Some empirical results. Journal of the American Statistical Association, 79, 97-106.
29.
Freedman, D. A. and Peters, S. C. (1984b). Bootstrapping an econometric model: Some empirical results. Journal of Business and Economic Statistics, 2, 150-158.
30.
Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
31.
Guertin, A. S. , Guertin, W. H., and Ware, W. B. (1981). Distortion as a function of the number of factors rotated under varying levels of common variance and error. Educational and Psychological Measurement, 41, 1-9.
32.
Hakstian, A. R. and Muller, V. J. (1973). Some notes on the number of factors problem. Multivariate Behavioral Research, 8, 461-475.
33.
Hakstian, A. R. , Rogers, W. T., and Cattell, R. B. (1982). The behavior of number-of-factors rules with simulated data. Multivariate Behavioral Research, 17, 193-219.
34.
Harman, H. H. (1976). Modern factor analysis (3rd ed.). Chicago: University of Chicago Press.
35.
Harris, R. J. (1985). A primer of multivariate statistics (2nd ed.). Orlando, FL: Academic Press.
36.
Horn, J. L. and Engstrom, R. (1979). Cattell's scree test in relation to Bartlett's chi-square test and other observations on the number of factors problem. Multivariate Behavioral Research, 14, 283-300.
37.
Humphreys, L. G. , Ilgen, D., McGrath, D., and Montanelli, R. (1969). Capitalization on chance in rotation of factors. Educational and Psychological Measurement, 29, 259-271.
38.
Kaiser, H. F. (1976). D. N. Lawley and A. E. Maxwell, Factor analysis as a statistical method. Educational and Psychological Measurement, 36, 586-589.
39.
Lunneborg, C. E. (1985). Estimating the correlation coefficient: The bootstrap approach. Psychological Bulletin, 98, 209-215.
40.
Lunneborg, C. E. (1986). Confidence intervals for a quartile contrast: Application of the bootstrap. Journal of Applied Psychology, 71, 451-456.
41.
Lunneborg, C. E. and Tousignant, J. P. (1985). Efron's bootstrap with application to the repeated measures design. Multivariate Behavioral Research, 20, 161-178.
42.
Mardia, K. V. , Kent, J. T., and Bibby, J. M. (1979). Multivariate analysis. London: Academic Press.
43.
Martin, J. K. and McDonald, R. P. (1975). Bayesian estimation in unrestricted factor analysis: A treatment for Heywood cases. Psychometrika, 40, 505-517.
44.
Muirhead, R. J. (1982). Aspects of multivariate statistical theory. New York: Wiley.
45.
Peters, S. C. and Freedman, D. A. (1987). Comment: Balm for bootstrap confidence intervals. Journal of the American Statistical Association, 82, 186-187.
46.
Rubin, D. B. (1981). The Bayesian bootstrap. Annals of Statistics, 9, 130-134.
47.
Schenker, N. (1985). Qualms about bootstrap confidence intervals. Journal of the American Statistical Association, 80, 360-361.
48.
Seber, G. A. F. (1984). Multivariate observations. New York: Wiley.
49.
Singh, K. (1981). On the asymptotic accuracy of Efron's bootstrap. Annals of Statistics, 9, 1187-1195.
50.
Stine, R. A. (1985). Bootstrap prediction intervals for regression. Journal of the American Statistical Association, 80, 1026-1031.
51.
Thompson, B. (1988). Program FACSTRAP: A program that computes bootstrap estimates of factor structure. Educational and Psychological Measurement, 48, 681-686.
52.
Tucker, L. R. , Koopman, R. F., and Linn, R. L. (1969). Evaluation of factor analytic research procedures by means of simulated correlation matrices. Psychometrika, 34, 421-459.
53.
Weinberg, S. L. , Carroll, J. D., and Cohen, H. S. (1984). Confidence regions for Indscal using the jackknife and bootstrap techniques. Psychometrika, 49, 475-491.
54.
Zwick, W. R. and Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442.
