In this paper we compare and contrast the objectives of principal component analysis and exploratory factor analysis. This is done through consideration of nine examples. Basic theory is presented in appendices. As well as covering the standard material, we also describe a number of recent developments. As an alternative to factor analysis, it is pointed out that in some cases it may be useful to rotate certain principal components if and when that is appropriate.
Get full access to this article
View all access options for this article.
References
1.
DavenportEllerby DR. A statistical investigation of the treatment of certain brain damaged patients. Unpublished MSc dissertation: University of Kent, Canterbury, 1980.
2.
Bartlett JR, Neil-Dwyer G., Davenport-Ellerby DR, Morgan Bjt.The rôle of the scanner in the care of the injured. Unpublished manuscript, 1981.
3.
Jolliffe ITPrincipal component analysis. New York: Springer-Verlag, 1986.
Everitt BSStatistical methods for medical investigations. Bristol : Arnold, 1989.
13.
Albert A., Harris EKMultivariate interpretation of clinical laboratory data. New York: Dekker, 1987.
14.
Ross CA, Joshi S., Currie R.Dissociative experiences in the general population: a factor analysis. Hospital and Community Psychiatry1991; 42: 297-301.
15.
Henderson WG , Fisher SG, Cohen N., Waltzman S., Weber L., the VA co-operative study group on cochlear implantation. Use of principal components analysis to develop a composite score as a primary outcome variable in a clinical trial. Controlled Clinical Trials1990; 11: 199-214.
16.
Yamamura K. , Onodera S., Sasaki N., Matsumoto H., Nakano H., Makino M.Principal component analysis of various respiratory function tests: the relationship between factor score and severity of pulmonary circulatory disorder in chronic obstructive pulmonary disease. Respiratory Medicine1991; 85: 34-43.
17.
Duflou H., Maenhaut W., DeReuck J.Application of principal component and cluster analysis to the study of the distribution of minor and trace elements in normal human brain. Chemometrics and Intelligent Laboratory Systems1990; 9: 273-86.
18.
Andrews DF, Herzberg AMData: a collection of problems from many fields for the student and research worker. New York: Springer-Verlag , 1985.
19.
Krzanowski WJBetween-groups comparison of principal components . Journal of the American Statistical Association1979; 74: 703-707 (correction in 76:1022).
20.
Jeffers Jnr.Two case studies in the application of principal component analysis. Applied Statistics1967 ; 16: 225-36.
21.
Moser CA, Scott W.British Towns. Edinburgh: Oliver and Boyd, 1961.
22.
Jolliffe IT , Jones B., Morgan Bjt.Utilising clusters: a case study involving the elderly. Journal of the Royal Statistical Society, Series A1982; 145: 224-36.
23.
Jolliffe ITDiscarding variables in a principal component analysis, I: Artificial data. Applied Statistics1972; 21: 160-73.
24.
Gower JCSome distance properties of latent roots and vector methods used in multivariate analysis. Biometrika1966; 53: 325-38.
25.
Beumont Pjv, Booth AL, Abraham SF, Griffiths DA, Turner TRA temporal sequence of symptoms in patients with Anorexia Nervosa. Unpublished manuscript, 1981.
26.
Banfield CF , Gower JCA note on the graphical representation of multivariate binary data. Applied Statistics1980; 29: 238-45.
27.
Morgan Bjt, Ray Apg.Non-uniqueness and inversions in cluster analysis. Unpublished manuscript, 1990.
28.
Digby Pgn, Kempton RAMultivariate analysis of ecological communities. London : Chapman and Hall, 1987.
29.
Jolliffe ITRotation of ill-defined principal components . Applied Statistics1989; 38: 139-47.
30.
Huber P.Projection pursuit (with discussion). Annals of Statistics1985; 13: 435-525.
31.
Jones MC, Sibson R.What is projection pursuit ? (with discussion). Journal of the Royal Statistical Society, Series A1987; 150: 1-36.
32.
Friedman JHExploratory projection pursuit. Journal of the American Statistical Association1987; 82: 249-66.
33.
Morton SCInterpretable projection pursuit. Technical Report 45106. Department of Statistics, Stanford University, 1989.
34.
Pack P., Jolliffe IT, Morgan Bjt.Influential observations in principal component analysis: a case study. Journal ofApplied Statistics1988; 15: 39-52.
35.
Critchley F.Influence in principal component analysis. Biometrika1985; 72: 627-36.
36.
Tanaka Y., Odaka Y.Influential observations in principal factor analysis. Psychometrika1989 ; 54 : 475-85.
37.
Flury B.Common principal components and related multivariate models. New York: Wiley, 1988.
38.
Flury B., Neuenschwander B.Principal components and proportionality in patterned covariance matrices . Unpublished manuscript, 1991
39.
Chatfield C., Collins AJIntroduction to multivariate analysis. London: Chapman and Hall, 1980: 89.
40.
Jolliffe ITDiscarding variables in a principal component analysis, II: real data. Applied Statistics, 1973: 22: 21-31.
41.
Marx BD, Smith EPPrincipal component estimation for generalized linear regression. Biometrika1990; 77: 23-31.
42.
Jolliffe IT , Jones B., Morgan Bjt.Comparison of cluster analyses of the English Personal Social Services Authorities. Journal of the Royal Statistical Society, Series A1986; 149:253-70.
43.
Chang W-C.On using principal components before separating a mixture of two multivariate normal distributions. Applied Statistics1983 ; 32: 267-75.
