Personality trait inventories often perform poorly when their structure is evaluated with confirmatory factor analysis (CFA). The authors demonstrate poor CFA fit for several widely used personality measures with documented evidence of criterion-related validity but also show that some measures perform well from an exploratory factor analytic perspective. In light of these results, the authors suggest that the failure of these measures to fit CFA models is because of the inherent complexity of personality, issues related to its measurement, and issues related to the application and interpretation of CFA models. This leads to three recommendations for researchers interested in the structure and assessment of personality traits: (a) utilize and report on a range of factor analytic methods, (b) avoid global evaluations regarding the internal validity of multiscale personality measures based on model fit according to conventional CFA cutoffs, and (c) consider the substantive and practical implications of model modifications designed to improve fit.
Anderson, J.C., & Gerbing, D.W. ( 1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103, 411-423.
2.
Ashton, M.C., & Lee, K. ( 2007). Empirical, theoretical, and practical advantages of the HEXACO model of personality structure. Personality and Social Psychology Review, 11, 150-166.
3.
Ashton, M.C., Lee, K., Goldberg, L.R., & de Vries, R. E. (2009). Higher order factors of personality: Do they exist? Personality and Social Psychology Review, 13, 79-91.
Barrett, P. ( 1986). Factor comparison: An examination of three methods. Personality and Individual Differences, 7, 327-340.
6.
Bentler, P.M., & Bonett, D.G. ( 1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
7.
Borkeneau, P., & Ostendorf, F. ( 1990). Comparing exploratory and confirmatory factor analysis: A study on the 5-factor model of personality. Personality and Individual Differences, 11, 515-524.
8.
Box, G.E.P. ( 1976). Science and statistics. Journal of the American Statistical Association, 71, 791-799.
9.
Brannick, M.T. ( 1995). Critical comments on applying covariance structure modeling . Journal of Organizational Behavior, 16, 201-213.
10.
Breckler, S.J. ( 1990). Applications of covariance structure modeling in psychology: Cause for concern? Psychological Bulletin, 107, 260-273.
11.
Briggs, S.R., & Cheek, J.M. ( 1986). The role of factor analysis in the development and evaluation of personality scales. Journal of Personality, 54, 106-148.
12.
Brown, T.A. ( 2006). Confirmatory factor analysis for applied research. New York: Guilford.
13.
Browne, M.W. ( 2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111-150.
14.
Byrne, B.M. ( 2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
15.
Byrne, B.M. ( 2005). Factor analytic models: Viewing the structure of an assessment instrument from three perspectives. Journal of Personality Assessment, 85, 17-32.
16.
Chan, W., Ho, R.M., Leung, K., Chan, D.K.S., & Yung, Y.F. ( 1999). An alternative method for evaluating congruence coefficients with Procrustes rotation: A bootstrap procedure. Psychological Methods, 4, 378-402.
17.
Church, A.T., & Burke, P.J. ( 1994). Exploratory and confirmatory tests of the Big Five and Tellegen’s three- and four-dimensional models. Journal of Personality and Social Psychology, 66, 93-114.
18.
Cloninger, C.R. ( 2008). The psychobiological theory of temperament and character: Comment on Farmer and Goldberg. Psychological Assessment, 20, 292-299.
19.
Cohen, J. ( 1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
20.
Conn, S.R., & Rieke, M.L. ( 1994). The 16PF fifth edition technical manual. Champaign, IL: Institute for Personality and Ability Testing.
Cudeck, R., & MacCallum, R.C. (2007). Factor analysis at 100: Historical developments and future directions. Mahwah, NJ: Lawrence Erlbaum.
23.
Diener, E., Emmons, R.A., Larsen, R.J., & Griffin, S. ( 1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 49, 71-75.
24.
DiStefano, C., & Motl, R.W. ( 2009). Personality correlates of method effects due to negatively worded items on the Rosenberg Self-Esteem Scale. Personality and Individual Differences, 46, 309-313.
25.
Donnellan, M.B., Oswald, F.L., Baird, B.M., & Lucas, R.E. ( 2006). The mini-IPIP scales: Tiny-yet effective measures of the Big Five factors of personality. Psychological Assessment , 18, 192-203.
26.
Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., & Strahan, E.J. ( 1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
27.
Farmer, R.F., & Goldberg, L.R. (2008). A psychometric evaluation of the revised Temperament and Character Inventory (TCI-R) and the TCI-140 . Psychological Assessment, 20, 281-291.
28.
Floyd, F.J., & Widaman, K.F. ( 1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment , 7, 286-299.
29.
Gignac, G.E., Bates, T.C., & Jang, K. ( 2007). Implications relevant to CFA model misfit, reliability, and the five factor model as measured by the NEO-FFI. Personality and Individual Differences, 43, 1051-1062.
30.
Goldberg, L.R. ( 1993). The structure of personality traits: Vertical and horizontal aspects. In D. C. Funder, R. D. Parke, C. Tomlinson-Keasy , & K. Widaman (Eds.), Studying lives through time: Personality and development (pp. 169-188). Washington, DC: American Psychological Association .
31.
Goldberg, L.R., & Velicer, W.F. ( 2006). Principles of exploratory factor analysis. In S. Strack (Ed.), Differentiating normal and abnormal personality (2nd ed., pp. 209-237). New York: Springer.
Grucza, R.A., & Goldberg, L.R. (2007). The comparative validity of 11 modern personality inventories: Predictions of behavioral acts, informant reports, and clinical indicators. Journal of Personality Assessment , 89, 167-187.
34.
Guadagnoli, E., & Velicer, W.F. ( 1991). A comparison of pattern matching indices. Multivariate Behavioral Research, 26, 323-343.
35.
Hattie, J. ( 1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139-164.
36.
Hoelzle, J.B., & Meyer, G.J. ( 2009). The invariant component structure of the Personality Assessment Inventory (PAI) full scales. Journal of Personality Assessment, 91, 175-186.
37.
Hofstee, W.K.B., de Raad, B., & Goldberg, L.R. (1992). Integration of the Big Five and circumplex approaches to trait structure. Journal of Personality and Social Psychology, 63, 146-163.
38.
Hogan, R., & Hogan, J. ( 1995). Hogan Personality Inventory manual (2nd ed.). Tulsa, OK: Hogan Assessment Systems.
39.
Hoyle, R.H., & Duvall, J.L. ( 2004). Determining the number of factors in exploratory and confirmatory factor analysis. In D. Kaplan (Ed.), Handbook of quantitative methodology for the social sciences (pp. 301-315). Thousand Oaks, CA: Sage.
40.
Hu, L.T., & Bentler, P.M. ( 1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
41.
Jackson, D.N. ( 1971). The dynamics of structured personality tests: 1971. Psychological Review, 78, 229-248.
42.
Jackson, D.N., Paunonen, S.V., & Tremblay, P.F. (2000). Six Factor Personality Questionnaire. Port Huron, MI: Sigma Assessment Systems.
43.
Lance, C.E., Butts, M.M., & Michels, L.C. ( 2006). The sources of four commonly reported cutoff criteria: What did they really say? Organizational Research Methods , 9, 202-220.
44.
Lee, K., & Ashton, M.C. ( 2004). Psychometric properties of the HEXACO Personality Inventory . Multivariate Behavioral Research, 39, 329-358.
45.
Lee, K., & Ashton, M.C. ( 2006). Further assessment of the HEXACO Personality Inventory: Two new facet scales and an observer report form. Psychological Assessment, 18, 182-191.
46.
Lee, K., & Ashton, M.C. ( 2007). Factor analysis in personality research. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 424-443). New York: Guilford.
47.
Loevinger, J. ( 1957). Objective tests as instruments of psychological theory . Psychological Reports, 3, 635-694.
48.
Lorenzo-Seva, U., & ten Berge, J.M.F. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology , 2, 57-64.
49.
Louks, J., Hayne, C., & Smith, J. ( 1989). Replicated factor structure of the Beck Depression Inventory . Journal of Nervous and Mental Disease, 177, 473-479.
50.
Lykken, D.T. ( 1971). Multiple factor analysis and personality research. Journal of Experimental Research in Personality, 5, 161-170.
51.
Lynam, D.R., Hoyle, R.H., & Newman, J.P. ( 2006). The perils of partialling: Cautionary tales from aggression and psychopathy. Assessment, 13, 328-341.
52.
MacCallum, R. ( 1986). Specification searches in covariance structure modeling . Psychological Bulletin, 100, 107-120.
53.
Marsh, H.W. ( 1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810-819.
54.
Marsh, H.W., Hau, K.T., & Wen, Z. ( 2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indices and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320-341.
55.
Marsh, H.W., Muthen, B., Asparaouhov, T., Ludtke, O., Robitzsch, A., Morin, A.J.S., et al. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Unpublished manuscript.
56.
Maydeu-Olivares, A., & Coffman, D.L. ( 2006). Random intercept item factor analysis. Psychological Methods, 11, 344-362.
57.
McCrae, R.R., & Costa, P.T., Jr. (2008). Empirical and theoretical status of the five-factor model of personality traits. In G. Boyle, G. Matthews, & D. H. Saklofske (Eds.), The SAGE handbook of personality theory and assessment (pp. 273-294). Thousand Oaks, CA: Sage.
58.
McCrae, R.R., Zonderman, A.B., Costa, P.T., Jr., Bond, M.H., & Paunonen, S.V. (1996). Evaluating replicability of factors in the revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotation. Journal of Personality and Social Psychology, 70, 552-566.
59.
Meehl, P.E. ( 1990). Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it. Psychological Inquiry, 1, 108-141.
60.
Mulaik, S.A. ( 2006). Foundations of factor analysis (2nd ed.). New York: CRC Press.
61.
Quilty, L.C., Oakman, J.M., & Risko, E. ( 2006). Correlates of the Rosenberg Self-Esteem Scale and method effects. Structural Equation Modeling, 13, 99-117.
62.
Rosenberg, M. ( 1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.
63.
Russel, D.W. ( 2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28, 1629-1646.
64.
Saris, W.E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561-582.
65.
Schmitt, N., & Stults, D.M., (1985). Factors defined by negatively keyed items: The result of careless respondents? Applied Psychological Measurement , 9, 367-373.
66.
Slocum-Gori, S.L., Zumbo, B.D., Michalos, A.C., & Diener, E. ( 2009). A note on the dimensionality of Quality of Life scales: An illustration with the Satisfaction With Life Scale (SWLS). Social Indicators Research, 92, 489-496.
67.
Steger, M.F. ( 2006). An illustration of issues in factor extraction and identification of dimensionality in psychological assessment data. Journal of Personality Assessment, 86, 263-272.
68.
Tafarodi, R.W., & Milne, A.B. ( 2002). Decomposing global self-esteem. Journal of Personality, 70, 443-483.
69.
Teel, C., & Verran, J.A. ( 1991). Factor comparison across studies. Research in Nursing and Health, 14, 67-72.
70.
Tellegen, A. & Waller, N.G. ( 2008). Exploring personality through test construction: Development of the Multidimensional Personality Questionnaire. In G. J. Boyle, G. Matthews and D. H. Saklofske, (Eds.). Handbook of personality theory and testing, II. (pp. 261-292). London: Sage.
71.
Thompson, B. ( 2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.
72.
Thurstone, L.L. ( 1947). Multiple-factor analysis. Chicago : University of Chicago Press.
73.
Tucker, L.R. ( 1951). A method for synthesis of factor analysis studies (Personnel Research Section Report 984). Washington, DC: Department of the Army.
74.
Vassend, O., & Skrondal, A. ( 1995). Factor analytic studies of the NEO Personality Inventory and the five-factor model: The problem of high structural complexity and conceptual indeterminacy. Personality and Individual Differences, 19, 135-147.
75.
Vassend, O., & Skrondal, A. ( 1997). Validation of the NEO Personality Inventory and the five factor model. Can findings from exploratory and confirmatory factor analysis be reconciled? European Journal of Personality, 11, 147-166.
76.
Widaman, K.F. ( 2007). Common factors versus components: Principals and principles, errors and misconceptions. In R. Cudeck and R. C. MacCullum (Eds.). Factor Analysis at 100: Historical Developments and Future Directions. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
77.
Wrigley, C., & Neuhaus, J.E. ( 1955). The matching of two sets of factors. American Psychologist, 10, 418-419.
