Expectations for reporting factor analysis results as part of construct validation are explored in the context of emerging views of measurement validity. Desired practices are discussed regarding both exploratory factor analysis (e.g., principal components analysis) and confirmatory factor analysis (e.g., LISREL and EQS factor analyses). A short computer program for conducting parallel analysis is appended.
Get full access to this article
View all access options for this article.
References
1.
American Educational Research Association , American Psychological Association, and National Council on Measurement in Education. (1985). Standards for educational and psychological testing. Washington, DC: Author.
2.
Armstrong, J. S. (1967). Derivation of theory by means of factor analysis or Tom Swift and his electric factor analysis machine. American Statistician, 21(5), 17-21.
3.
Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.
4.
Bentler, P. M. (1994). On the quality of test statistics in covariance structure analysis: Caveat emptor. In C. R. Reynolds (Ed.), Cognitive assessment: A multidisciplinary perspective (pp. 237-260). New York: Plenum.
5.
Bentler, P. M. , & Dudgeon, P. (1996). Covariance structure analysis: Statistical practice, theory, and directions. Annual Review of Psychology, 47, 563-592.
6.
Byrne, B. M. (1989). A primer of LISREL. New York: Springer-Verlag.
7.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows. Thousand Oaks, CA: Sage.
8.
Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297-312.
9.
Campbell, D. T. , & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
10.
Campo, S. F. , Sharpton, W. R., Thompson, B., & Sexton, D. (in press). Measurement characteristics of the Quality of Life Index when used with adults with severe/profound disabilities. American Journal on Mental Retardation.
11.
Carr, S. (1992). A primer on the use of Q-technique factor analysis. Measurement and Evaluation in Counseling and Development, 25, 133-138.
12.
Cattell, R. B. (1978). The scientific use of factor analysis in behavioral and life sciences. New York: Plenum.
13.
Cronbach, L. J. (1989). Construct validation after thirty years. In R. L. Linn (Ed.), Intelligence: Measurement theory and public policy (pp. 147-171). Urbana: University of Illinois Press.
14.
Cronkhite, G. , & Liska, J. R. (1980). The judgment of communicant acceptability. In M. E. Roloff & G. R. Miller (Eds.), Persuasion: New directions in theory and research (pp. 101-139). Beverly Hills, CA: Sage.
15.
Cudeck, R. (1989). The analysis of correlation matrices using covariance structure models. Psychological Bulletin, 105, 317-327.
16.
Daniel, L. G. (1990, November). Common factor analysis or components analysis: An update on an old debate. Paper presented at the annual meeting of the Mid-South Educational Research Association, New Orleans, LA. (ERIC Document Reproduction Service No. ED 325 531)
17.
Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
18.
Guilford, J. P. (1946). New standards for test evaluation. Educational and Psychological Measurement, 6, 427-439.
19.
Hendrick, C. , & Hendrick, S. (1986). A theory and method of love. Journal of Personality and Social Psychology, 50, 392-402.
20.
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185.
21.
Huberty, C. (1994). Applied discriminant analysis. New York: Wiley.
22.
Joint Committee on Standards for Educational Evaluation. (1988). The personnel evaluation standards: How to assess systems for evaluating educators. Newbury Park, CA: Sage.
23.
Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs (2nd ed.). Thousand Oaks, CA: Sage.
24.
Kerlinger, F. N. (1979). Behavioral research: A conceptual approach. New York: Holt, Rinehart & Winston.
25.
Knapp, T. R. (1978). Canonical correlation analysis: A general parametric significance testing system. Psychological Bulletin, 85, 410-416.
26.
Moss, P. A. (1992). Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 62, 229-258.
27.
Moss, P. A. (1995). Themes and variations in validity theory. Educational Measurement: Issues and Practice, 14(2), 5-12.
28.
Mulaik, S. A. (1987). A brief history of the philosophical foundations of exploratory factor analysis. Multivariate Behavioral Research, 22, 267-305.
29.
Mulaik, S. A. (Ed.). (1992). [Theme issue on principal components analysis]. Multivariate Behavioral Research, 27(3).
30.
Mulaik, S. A. (1994). The critique of pure statistics: Artifact and objectivity in multivariate statistics. In B. Thompson (Ed.), Advances in social science methodology (Vol. 3, pp. 241-289). Greenwich, CT: JAI.
31.
Mulaik, S. A. , James, L. R., van Alstine, J., Bennett, N., Lind, S., & Stilwell, C. D. (1989). Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105, 430-445.
32.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
33.
Popper, K. R. (1962). Conjectures and refutations: The growth of scientific knowledge. New York: Harper & Row.
34.
Shepard, L. A. (1993). Evaluating test validity. In L. Darling-Hammond (Ed.), Review of research in education (Vol. 19, pp. 405-450). Washington, DC: American Educational Research Association.
35.
Snook, S. C. , & Gorsuch, R. L. (1989). Component analysis versus common factor analysis: A Monte Carlo study. Psychological Bulletin, 106, 148-154.
36.
Thompson, B. (1988). Program FACSTRAP: A program that computes bootstrap estimates of factor structure. Educational and Psychological Measurement, 48, 681-686.
37.
Thompson, B. (1991). A primer on the logic and use of canonical correlation analysis. Measurement and Evaluation in Counseling and Development, 24(2), 80-95.
38.
Thompson, B. (1992). A partial test distribution for cosines among factors across samples. In B. Thompson (Ed.), Advances in social science methodology (Vol. 2, pp. 81-97). Greenwich, CT: JAI.
39.
Thompson, B. (1994a). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.
40.
Thompson, B. (1994b). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality, 62(2), 157-176.
41.
Thompson, B. (1995). Stepwise regression and stepwise discriminant analysis need not apply here: A guidelines editorial. Educational and Psychological Measurement, 55, 525-534.
42.
Thompson, B. , & Borrello, G. M. (1985). The importance of structure coefficients in regression research. Educational and Psychological Measurement, 45, 203-209.
43.
Zwick, W. R. , & Velicer, W. F. (1986). Factors influencing five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442.
