Procrustes methods of factor rotation have been criticized for producing excessively high coefficients of congruence when attempting to fit one factor pattern matrix into the space of a targeted pattern. A Monte Carlo study was designed to evaluate some of the conditions contributing to this problem when using Schonemann's orthogonal Procrustes transformation. It was found that the expected size of the factor congruence coefficient varied with (a) the number of variables in the analysis, (b) the number of salient variables defining a factor, and (c) the size of the salient variables' factor pattern coefficients. The number of factors extracted also had some influence on congruence but only in interaction with the size of the salient pattern values. The results of this simulation study, which include a prediction equation, can be used by researchers to appraise levels of factor congruence they find with real data.
Get full access to this article
View all access options for this article.
References
1.
Acito, F. , & Anderson, R. D. (1980). A simulation study of the robustness of orthogonal target analysis. Multivariate Behavioral Research, 15, 319-327.
2.
Barrett, P. (1986). Factor comparison: An examination of dtree methods. Personality and Individual Differences, 7, 327-340.
3.
Bernstein, I. H. , & Eveland, D. (1982). State vs. trait anxiety: A case study in confirmatory factor analysis. Personality and Individual Differences, 3, 361-372.
4.
Bemstein, I. H. , Garbin, C. P., & McClellan, P. G. (1983). A confirmatory factoring of the California Psychological Inventory. Educational and Psychological Measurement, 43, 687-691.
5.
Bijnen, E. J. , & Poortinga, Y. H. (1988). The questionable value of cross-culturl comparisons with the Eysenck Personality Questionnaire. Journal of Cross-Cultural Psychology, 19, 193-202.
6.
Boomsma, A. (1985). Nonconvergence, improper solutions, and starting values in Lisrel maximum likelihood estimation. Psychometrika, 50, 229-242.
7.
Broadbooks, W. J. , & E hore, P. B. (1987). A Monte Carlo study of the sampling distribution of the congruence coefficient. Educational and Psychological Measurement, 47, 1-11.
8.
Brokken, F. B. (1983). Orthogonal Procrustes rotation maxing congruence. Psychometrika, 48, 343-352.
9.
Burt, C. L. (1948). The factorial study of temperamental traits. British Journal of Psychology, Statistical Section, 1, 178-203.
10.
Cliff, N. (1966). Orthogonal rotation to congruence. Psychometrika, 31, 33-42.
11.
Davenport, E. C. (1990). Significance testing of congruence coefficients: A good idea?Educational and Psychological Measurement, 50, 289-296.
12.
Derogatis, L. R. , Serio, J. C., & Cleary, P. A. (1972). An empirical comparison of three indices of factorial similarity. Psychological Reports, 30, 791-804.
13.
Eysenck, H. J. , Barrett, P., & Eysenck, S.B.G. (1985). Indices of factor comparison for homologous and non-homologous personality scales in 24 countries. Personality and Individual Differences, 6, 503-504.
14.
Gebhardt, F. (1968). Ober die Ahnlichkeit von Faktormatrizen. Psychologische Beitrtige, 10, 591-599.
15.
Guadagnoli, E. , & Velicer, W. (1988). The relationship of sample size to the stability of component patterns: A simulation study. Psychological Bulletin, 103, 265-275. 57
16.
Guadagnoli, E. , & Velicer, W. (1991). A comparison of pattern matching indices. Multivariate Behavioral Research, 26, 323-343.
17.
Harman, H. H. (1976). Modern factor analysis. Chicago: University of Chicago Press.
18.
Haven, S. , & ten Berge, J.M.F. (1977). Tucker's coefficient of congruence as a measure of factorial invariance: An empirical study (Heymans Bulletin 290 EX 1977). Groningen, the Netherlands: University of Groningen, Department of Psychology.
19.
Horn, J. L (1967). On subjectivity in factor analysis. Educational and Psychological Measurement, 27, 811-820.
20.
Horn, J. L. , & Knapp, J. R. (1973). On the subjective character of the empirical base of Guilford's structure-of-intellect model. Psychological Bulletin, 80, 33-43.
21.
Humphreys, L. G. , Ilgen, D., McGrath, D., & Montanelli, R. (1969). Capitalization on chance in rotation of factors. Educational and Psychological Measurement, 29, 259-271.
22.
Hurley, J. , & Cattell, R. B. (1962). The Procrustes program: Producing direct rotation to test a hypothesized factor structure. Behavioral Science, 7, 258-262.
23.
IMSL. (1987). International mathematical and statistical libraries (10th ed.). Houston, TX: Author.
24.
Jackson, D. N. , & Chan, D. W. (1980). Maximum-likelihood estimation in common factor analysis: A cautionary note. Psychological Bulletin, 88, 502-508.
25.
Jöreskog, K. G. , & Sorbom, D. (1989). LISREL 7: A guide to the program and applications. Mooresville, IN: Scientific Software, Inc.
26.
Kaiser, H. F. , Hunka, S., & Bianchini, J. C. (1971). Relating factors between studies based upon different individuals. Multivariate Behavioral Research, 6, 409-422.
27.
Korth, B. (1978). A significance test for congruence coefficients for Cattell's factors matched by scanning. Multivariate Behavioral Research, 13, 419-430.
28.
Korth, B. , & Tucker, L. R. (1975). The distribution of chance congruence coefficients from simulated data. Psychometrika, 40, 361-372.
29.
Korth, B. , & Tucker, L. R. (1976). Procrustes matching by congruence coefficients. Psychometrika, 41, 531-535.
30.
McCrae, R. R. , Zonderman, A. B., Costa, P. T., Bond, M. H., & Paunonen, S. V. (1996). Evaluating replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis and Procrustes rotation. Journal of Personality and Social Psychology, 70, 552-556.
31.
Meredith, W. (1964a). Notes on factorial invariance. Psychometrika, 29, 177-185.
32.
Meredith, W. (1964b). Rotation to achieve factorial invariance. Psychometrika, 29, 187-206.
33.
Mulaik, S. A. (1972). The foundations of factor analysis. New York: McGraw-Hill.
34.
Nesselroade, J. R. , & Baltes, P. B. (1970). On a dilemma of comparative factor analysis: A study of factor matching based on random data. Educational and Psychological Measurement, 30, 935-948.
35.
Nesselroade, J. R. , Baltes, P. B., & Labouvie, E. W. (1971). Evaluating factor invariance in oblique space: Baseline data generated from random numbers. Multivariate Behavioral Research, 6, 233-241.
36.
Paunonen, S. V. , Jackson, D. N., Trzebinski, J., & Forsterling, F. (1992). Personality structure across cultures: A multi method evaluation. Journal of Personality and Social Psychology, 62, 447-456.
37.
Reynolds, C. R. , & Harding, R. E. (1983). Outcome in two large sample studies of factorial similarity under six methods of comparison. Educational and Psychological Measurement, 43, 723-728.
38.
Schonemann, P. H. (1966). A generalized solution of the orthogonal Procrustes problem. Psychometrika, 31, 1-16.
39.
Stumpf, H. (1993). The factor structure of the Personality Research Form: A cross-national evaluation. Journal of Personality, 61, 27-48.
40.
Taylor, P. A. (1967). The use of factor models in curriculum evaluation: A mathematical model relating two factor structures. Educational and Psychological Measurement, 27, 305-321.
41.
ten Berge, J.M.F. (1986a). Some relationships between descriptive comparisons of components from different studies. Multivariate Behavioral Research, 21, 29-40.
42.
ten Berge, J.M.F. (1986b). Rotation to perfect congruence and the cross validation of component weights across populations. Mulivariate Behavioral Research, 21, 41-64.
43.
Thompson, B. (1992). A partial test distribution for cosines among factors across samples. In B. Thompson (Ed.), Advances in social science methodology (Vol. 2, pp. 81-97). Greenwich, CT: JAI.
44.
Tucker, L. R. (1951). A method for synthesis of factor analysis studies (Personnel Research Section Report No. 984). Washington, DC: Department of the Anny.
45.
van Driel, O. P. (1978). On various causes of improper solutions in maximum likelihood factor analysis. Psychometrika, 43, 225-243.
46.
Velicer, W. F. , & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25, 1-28.
47.
Widaman, K. F. (1990). Bias in pattern loadings represented by common factor analysis and component analysis. Multivariate Behavioral Research, 25, 89-96.
48.
Wrigley, C. S. , & Neuhaus, J. O. (1955). The matching of two sets of factors. American Psychologist, 10, 418-419.
