An examination of the use of exploratory and confirmatory factor analysis by researchers publishing in Personality and Social Psychology Bulletin over the previous 5 years is presented, along with a review of recommended methods based on the recent statistical literature. In the case of exploratory factor analysis, an examination and recommendations concerning factor extraction procedures, sample size, number of measured variables, determining the number of factors to extract, factor rotation, and the creation of factor scores are presented. These issues are illustrated via an exploratory factor analysis of data from the University of California, Los Angeles, Loneliness Scale. In the case of confirmatory factor analysis, an examination and recommendations concerning model estimation, evaluating model fit, sample size, the effects of non-normality of the data, and missing data are presented. These issues are illustrated via a confirmatory factor analysis of data from the Revised Causal Dimension Scale.
Get full access to this article
View all access options for this article.
References
1.
Allison, P. D. (1987). Estimation of linear models with incomplete data. In C. C. Clogg (Ed.), Sociological methodology 1987 (pp. 71-103). San Francisco: Jossey-Bass.
2.
Allison, P. D. (2002). Missing data. Thousand Oaks, CA: Sage.
3.
Arbuckle, J. L. (1997). Amos user’s guide version 3.6. Chicago: SmallWaters.
4.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
5.
Bentler, P. M. (1995). EQS structural equations program manual. Encino, CA: Multivariate Software.
6.
Bentler, P. M. , & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
7.
Bentler, P. M. , & Kano, Y. (1990). On the equivalence of factors and components. Multivariate Behavioral Research, 25, 67-74.
8.
Bentler, P. M. , & Lee, S. L. (1983). Covariance structures under polynomial constraints: Applications to correlation and alpha-type structural models. Journal of Educational Statistics, 8, 207-222.
9.
Bentler, P. M. , & Yuan, K. -H. (1999). Structural equation modeling with small samples: Test statistics. Multivariate Behavioral Research, 34, 181-197.
10.
Bollen, K. A. (1989). A new incremental fit index for general structural equation models. Sociological Research and Methods, 16, 492-503.
11.
Boomsma, A. (1982). The robustness of LISREL against small sample sizes in factor analysis models. In K. G. Jöreskog & H. Wold (Eds.), Systems under indirect observation: Causality, structure, prediction (Part I, pp. 149-175). Amsterdam: North-Holland.
12.
Browne, M. W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.
13.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage.
14.
Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. New York: Lawrence Erlbaum.
15.
Byrne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. New York: Lawrence Erlbaum.
16.
Cattell, R. B. (1966). Handbook of multivariate experimental psychology. Chicago: Rand McNally.
17.
Comrey, A. L. , & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
18.
Cudeck, R. (1989). Analysis of correlation matrices using covariance structure models. Psychological Bulletin, 105, 317-327.
19.
Curran, P. J. , West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29.
20.
Cutrona, C. E. , & Russell, D. (1987). The provisions of social relationships and adaptation to stress. In W. H. Jones & D. Perlman (Eds.), Advances in personal relationships (Vol. 1, pp. 37-67). Greenwich, CT: JAI.
21.
Enders, C. K. (2001). A primer on maximum likelihood algorithm available for use with missing data. Structural Equation Modeling, 8, 128-141.
22.
Enders, C. K. , & Bandalos, D. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8, 430-457.
23.
Fabrigar, L. R. , Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
24.
Fan, X. , Thompson, B., & Wang, L. (1999). Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling, 6, 56-83.
25.
Fouladi, R. T. (2000). Performance of modified test statistics in covariance and correlation structure analysis under conditions of multivariate nonnormality. Structural Equation Modeling, 7, 356-410.
26.
Gold, M. S. , & Bentler, P. M. (2000). Treatments of missing data: A Monte Carlo comparison of RBHDI, iterative stochastic regression imputation, and expectation-maximization. Structural Equation Modeling, 7, 319-355.
27.
Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
28.
Gorsuch, R. L. (1988). Exploratory factor analysis. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 231-258). New York: Plenum.
29.
Hu, L. , & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
30.
Hu, L. , & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
31.
Hu, L. , Bentler, P. M., & Kano, Y. (1992). Can test statistics in covariance structure analysis be trusted?Psychological Bulletin, 112, 351-362.
32.
Jackson, D. (2001). Sample size and number of parameter estimates in maximum likelihood confirmatory factor analysis: A Monte Carlo investigation. Structural Equation Modeling, 8, 205-223.
33.
Jamshidian, M. , & Bentler, P. M. (1999). ML estimation of mean and covariance structures with missing data using complete data routines. Journal of Educational and Behavioral Statistics, 24, 21-41.
34.
Jöreskog, K. G. , & Sörbom, D. (1996). LISREL 8: User’s reference guide. Chicago: Scientific Software International.
35.
Kaiser, H. F. (1970). A second generation Little Jiffy. Psychometrika, 35, 401-415.
36.
Kelloway, E. K. (1998). Using LISREL for structural equation modeling: A researcher’s guide. Thousand Oaks, CA: Sage.
37.
Kenny, D. A. , & McCoach, D. B. (2000). Effect of the number of variables on measures of fit that use a null model. Manuscript submitted for publication.
38.
Kline, R. B. (1998). Principles and practice of structural equation modeling. New York: Guilford.
39.
MacCallum, R. C. , Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84-99.
40.
Marsh, H. W. , & Hocever, D. (1985). Application of confirmatory factor analysis to the study of self-concept: First and higher order factor models and their invariance across groups. Psychological Bulletin, 97, 562-582.
41.
Maruyama, G. (1997). Basics of structural equation modeling. Thousand Oaks, CA: Sage.
42.
McAuley, E. , Duncan, T. E., & Russell, D. (1992). Measuring causal attributions: The Revised Causal Dimension Scale (CDSII). Personality and Social Psychology Bulletin, 18, 566-573.
43.
McDonald, R. P. (1989). An index of goodness-of-fit based on noncentrality. Journal of Classification, 6, 97-103.
44.
McDonald, R. P. , & Marsh, H. W. (1990). Choosing a multivariate model: Noncentrality and goodness of fit. Psychological Bulletin, 107, 247-255.
45.
Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
46.
Muthén, B. , & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45, 19-30.
47.
Muthén, B. , Kaplan, K., & Hollis, M. (1987). On structural equation modeling with data that are not missing completely at random. Psychometrika, 42, 431-462.
48.
Muthén, L. K. , & Muthén, B. (1998). Mplus user’s guide. Los Angeles: Muthén & Muthén.
49.
Ogasawara, H. (2000). Some relationships between factors and components. Psychometrika, 65, 167-185.
50.
Raykov, T. , & Marcoulides, G. A. (2000). A first course in structural equation modeling. New York: Lawrence Erlbaum.
51.
Reise, S. P. , Waller, N. G., & Comrey, A. L. (2000). Factor analysis and scale revision. Psychological Assessment, 12, 287-297.
52.
Russell, D. (1996). The UCLA Loneliness Scale (Version 3): Reliability, validity, and factor structure. Journal of Personality Assessment, 66, 20-40.
53.
Satorra, A. , & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variable analysis: Applications for developmental research (pp. 399-419). Thousand Oaks, CA: Sage.
54.
Schafer, J. L. (1997). Analysis of incomplete multivariate data. London: Chapman & Hall.
55.
Schneeweiss, H. (1997). Factors and principal components in the near spherical case. Multivariate Behavioral Research, 32, 375-401.
56.
Schneeweiss, H. , & Mathes, H. (1995). Factor analysis and principal components. Journal of Multivariate Analysis, 55, 105-124.
57.
Schumacker, R. E. , & Lomax, R. G. (1996). A beginner’s guide to structural equation modeling. New York: Lawrence Erlbaum.
58.
Sinharay, S. , Stern, H. S., & Russell, D. W. (2001). The use of multiple imputation for the analysis of missing data. Psychological Methods, 6, 317-329.
59.
Steiger, J. H. (1989). EzPATH: A supplementary module for SYSTAT and SYGRAPH. Evanston, NJ: SYSTAT.
60.
Steiger, J. H. , & Lind, J. C. (1980, May). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
61.
Tucker, L. R. , & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.
62.
Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321-327.
63.
Velicer, W. F. , & Fava, J. L. (1998). Effects of variable and subject sampling on factor pattern recovery. Psychological Methods, 3, 231-251.
64.
Velicer, W. F. , & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25, 1-28.
65.
Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters?Multivariate Behavioral Research, 28, 263-311.
66.
Yuan, K. -H. , & Bentler, P. M. (1999). F tests for mean and covariance structure analysis. Journal of Educational and Behavioral Statistics, 24, 225-243.
67.
Yuan, K. -H. , & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. In Sociological Methodology 2000 (pp. 165-200). Washington, DC: American Sociological Association.
