Although many textbooks on multivariate statistics discuss the common factor analysis model, few of these books mention the problem of factor score indeterminacy (FSI). Thus, many students and contemporary researchers are unaware of an important fact. Namely, for any common factor model with known (or estimated) model parameters, infinite sets of factor scores can be constructed to fit the model. Because all sets are mathematically exchangeable, factor scores are indeterminate. Our professional silence on this topic is difficult to explain given that FSI was first noted almost 100 years ago by E. B. Wilson, the 24th president (1929) of the American Statistical Association. To help disseminate Wilson’s insights, we demonstrate the underlying mathematics of FSI using the language of finite-dimensional vector spaces and well-known ideas of regression theory. We then illustrate the numerical implications of FSI by describing new and easily implemented methods for transforming factor scores into alternative sets of factor scores. An online supplement (and the fungible R library) includes R functions for illustrating FSI.
AndersonH. C. (2008). The annotated Hans Christian Andersen. W. W. Norton & Company.
2.
AndersonT. W.OlkinI.UnderhillL. G. (1987). Generation of random orthogonal matrices. SIAM Journal on Scientific and Statistical Computing, 8(4), 625–629.
3.
AnderssonG.Yang-WallentinF. (2020). Generalized linear factor score regression: A comparison of four methods. Educational and Psychological Measurement, 81, 1–27.
4.
AxlerS. (1997). Linear algebra done right. Springer Verlag.
5.
Ben-IsraelA.GrevilleT. (2003). Generalized inverses: Theory and applications (Vol. 15). Springer Verlag.
6.
BentlerP. (1980). Multivariate analysis with latent variables: Causal modeling. In Annual review of psychology (Vol. 31., pp. 419–456). Annual Reviews Inc
7.
BollenK. A. (1989). Structural equations with latent variables. Wiley & Sons.
8.
BollenK. A. (2002). Latent variables in psychology and the social sciences. In Annual review of psychology (Vol. 53., pp. 605–634). Annual Reviews Inc
9.
BorsboomD.MellenberghG.van HeerdenJ. (2003). The theoretical status of latent variables. Psychological Review, 110(2), 203–218.
10.
BrowneM. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111–150.
11.
DevliegerI.MayerA.RosseelY. (2016). Hypothesis testing using factor score regression: A comparison of four methods. Educational and Psychological Measurement, 76(5), 741–770.
12.
GreenlandS.SennS. J.RothmanK. J.CarlinJ. B.PooleC.GoodmanS. N.AltmanD. G. (2016). Statistical tests, p values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31(4), 337–350.
13.
GuttmanL. (1955). The determinacy of factor score matrices with applications for five other problems of common factor theory. British Journal of Statistical Psychology, 8, 65–82.
HartB.SpearmanC. (1912). General ability, its existence and nature. British Journal of Psychology, 5, 51–84.
16.
HornJ. L.McArdleJ. J. (2007). Understanding human intelligence since spearman. In CudeckR.MacCallumR. C. (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 205–247). Routledge.
KestelmanH. (1952). The fundamental equation of factor analysis. British Journal of Psychology, 5, 1–6.
19.
LattinJ. M.CarrollJ. D.GreenP. E. (2003). Analyzing multivariate data. Thomson Brooks/Cole.
20.
LawleyD. N.MaxwellA. E. (1971). Factor analysis as a statistical method (Vol. 18). Butterworths London.
21.
LedermannW. (1938). The orthogonal transformation of a factorial matrix into itself. Psychometrika, 3, 181–187.
22.
LovieA. D.LovieP. (1993). Charles spearman, Cyril Burt, and the origins of factor analysis. Journal of the History of the Behavioral Sciences, 29(4), 308–321.
23.
McDonaldR. P. (1996). Latent traits and the possibility of motion. Multivariate Behavioral Research, 31(4), 593–601.
24.
McDonaldR. P. (1974). The measurement of factor indeterminacy. Psychometrika, 39, 203–222.
25.
McDonaldR. P.BoltD. M. (1998). The determinacy of variables in structural equation models. Multivariate Behavioral Research, 33(3), 385–401.
26.
McDonaldR. P.MulaikS. (1979). Determinancy of common factors: A nontechnical review. Psychological Bulletin, 86(2), 297–306.
27.
MeehlP. E. (1993). Four queries about factor reality. History and Philosophy of Psychology Bulletin, 5(2), 4–5.
28.
MulaikS. A. (1976). Comments on “The measurement of factorial indeterminacy.”Psychometrika, 41, 249–262.
29.
MulaikS. A. (2005). Looking back on the indeterminacy controversies in factor analysis. In Maydeu-OlivaresA.McArdleJ. J. (Eds.) (pp. 173–206). Lawrence Erlbaum
30.
MulaikS. A. (2010). Foundations of factor analysis (2nd ed.). Chapman and Hall (CRC Press).
31.
MulaikS. A.McDonaldR. P. (1978). The effect of additional variables on factor indeterminacy in models with a single common factor. Psychometrika, 43, 177–192.
32.
PenroseR. (1955). A generalized inverse for matrices. In Mathematical proceedings of the Cambridge Philosophical Society (Vol. 51, pp. 406–413). Cambridge University Press.
33.
PiaggioH. T. H. (1931). The general factor in spearman’s theory of intelligence. Nature, 127, 56–67.
34.
RencherA. (2002). Methods of multivariate analysis. Wiley Online Library.
35.
ReymentR. A.JoreskogK. (1996). Applied factor analysis in the natural sciences. Cambridge University Press.
36.
RigdonE. E.BeckerJ.-M.SarstedtM. (2019). Factor indeterminacy as metrological uncertainty: Implications for advancing psychological measurement. Multivariate Behavioral Research, 54(3), 429–443.
37.
SchönemannP. H. (1971). The minimum average correlation between equivalent sets of uncorrelated factors. Psychometrika, 36, 21–30.
38.
SchönemannP. H.SteigerJ. H. (1978). On the validity of indeterminate factor scores. Bulletin of the Psychonomic Society, 12, 287–290.
39.
SchönemannP. H.WangM. M. (1972). Some new results on factor indeterminacy. Psychometrika, 37, 61–91.
40.
SpearmanC. (1904). General intelligence” objectively determined and measured. American Journal of Psychology, 15, 201–293.
41.
SpearmanC. (1922). Correlation between arrays in a table of correlations. Proceedings of the Royal Society of London. Series A, Containing Papers of a Mathematical and Physical Character, 101(708), 94–100.
42.
SpearmanC. (1927). The abilities of man. Macmillan.
43.
SteigerJ. H. (1979a). Factor indeterminacy in the 1930s and 1970s: Some interesting parallels. Psychometrika, 44, 157–167.
44.
SteigerJ. H. (1979b). The relationship between external variables and common factors. Psychometrika, 44, 93–97.
45.
SteigerJ. H.SchonemannP. H. (1978). A history of factor indeterminacy. In ShyeS. (Ed.), Theory construction and data analysis in the behavioral sciences (pp. 136–178). Jossey-Bass.
46.
StrangG. (1993). The fundamental theorem of linear algebra. The American Mathematical Monthly, 100(9), 848–855.
47.
ten BergeJ.KrijnenW.WansbeekT.ShapiroA. (1999). Some new results on correlation-preserving factor scores prediction methods. Linear Algebra and Its Applications, 289(1–3), 311–318.
48.
ThomsonG. H. (1935). The definition and measurement of “g” (general intelligence). Journal of Educational Psychology, 26, 241–262.
49.
ThurstoneL. L. (1935). The vectors of mind. University of Chicago Press.
50.
ThurstoneL. L. (1947). Multiple factor analysis. University of Chicago Press.
51.
VittadiniG. (1988). On the validity of the indeterminate latent variables in the lisrel model. Communications in Statistics. Theory and Methods, 17(3), 861–874.
52.
VittadiniG. (1989). Indeterminacy problems in the lisrel model. Multivariate Behavioral Research, 24(4), 397–414.
53.
WallerN. G. (2022). Fungible: Psychometric functions from the Waller lab. [Computer software manual]. (version 2.2.1)
54.
WeisbergS. (2005). Applied linear regression (Vol. 528). John Wiley & Sons.
55.
WidamanK. F.RevelleW. (2022). Thinking thrice about sum scores, and then some more about measurement and analysis. Behavior Research Methods, 1–19.
56.
WilsonE. B. (1928a). On hierarchical correlation systems. Proceedings of the National Academy of Sciences, 14, 283–291.
57.
WilsonE. B. (1928b). Review of “the abilities of man, their nature and measurement” by C. Spearman. Science, 67, 244–248.
58.
YanaiH.TakeuchiK.TakaneY. (2011). Projection matrices, generalized inverse matrices, and singular value decomposition. Springer Verlag.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
