Eight formula-based estimates of population squared cross-validity and nine estimates of factor scores were used in a prediction study involving 31 attitude type predictors and a criterion. These estimates were compared with the conventional cross-validation procedure and the use of data-level variables (raw scores or standardized raw scores) in two separate sample sizes of 150 and 250 cases. The major findings of this empirical study are: (1) Formula-based estimates of population squared cross-validity are as good as those obtained from the conventional cross-validation procedure, (2) factor score estimates are equally good in predicting population squared cross-validity, and (3) two formula-based estimates (Burket's and Rozeboom's) of population squared cross-validity in combination with one of the factor score methods appear to offer the most for practitioners concerned with prediction.
Get full access to this article
View all access options for this article.
References
1.
Anderson, T. W. and Rubin, H.Statistical inference in factor analysis. In J. Neyman (Ed.), Proceedings on the Third Berkeley Symposium on Mathematical Statistics and Probability (Vol. 5). Berkeley, Ca.: University of California Press, 1956.
2.
Bartlett, M. S.The statistical conception of mental factors . British Journal of Psychology, 1937, 28, 97-104.
3.
Burket, G. R.A study of reduced rank models for multiple prediction . Psychometric Monograph, 1964, (12).
4.
Cattin, P.Estimation of the predictive power of a regression model . Journal of Applied Psychology, 1980, 65, 407-414.
5.
Claudy, J. G.Multiple regression and validity estimation in one sample . Applied Psychological Measurement, 1978, 2, 595-607.
6.
Drasgow, F. , Dorans, N. J. and Tucker, L. R.Estimators of squared cross-validity coefficient: A Monte Carlo investigation. Applied Psychological Measurement, 1979, 3, 387-399.
7.
Darlington, R. B.Multiple regression in pscyhological research and practice . Psychological Bulletin, 1968, 69, 161-182.
8.
Geisser, S. and Greenhouse, S. W.An extension of Box's results on the use of the F distribution in multivariate analysis. Annals of Mathematical Statistics, 1958, 29, 885-891.
9.
Glass, G. V. and Maguire, T. O.Abuses of factor scores. American Educational Research Journal, 1966, 3, 297-304.
10.
Harman, H. H.Modern factor analysis. Chicago: The University of Chicago Press, 1976.
11.
Harris, C. W.On factors and factor scores . Psychometrika, 1967, 32, 363-379.
12.
Herzberg, P. A.The parameters of cross-validation . Psychometrika Monograph Supplement, 1969, 34 (2, Pt. 2).
13.
Holzinger, K. J. and Harman, H. H.Factor analysis—a synthesis of factorial methods. Chicago: University of Chicago Press, 1941.
14.
Horn, J. L.An empirical comparison of methods for estimating factor scores . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1965, 25, 313-322.
15.
Horn, J. L. and Miller, W. C.Evidence on problems in estimating common factor scores. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1966, 26, 617-622.
16.
Horst, P.Factor analysis of data matrices. Chicago: Holt, Rinehart, & Winston, 1965.
17.
Huberty, C. J. and Mourad, S. A.Estimation in multiple correlation/prediction. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1980, 40, 101-112.
18.
Kirk, R. E.Experimental design: Procedure for the Behavioral Science. Belmont, California: Brooks/Cole, 1968.
19.
Ledermann, W.On a shortened method of estimation of mental factors by regression . Psychometrika, 1939, 4, 109-116.
20.
Lord, F. M.Efficiency of prediction when a regression equation from one sample is used in a new sample. Princeton, N.J.: Educational Testing Sevice, 1950. (Research Bulletin N. 50-40).
21.
McDonald, R. P. and Burr, E. J.A comparison of four methods of constructing factor scores. Psychometrika, 1967, 32, 381-401.
22.
Morris, J. D.A comparison of regression prediction accuracy on several types of factor scores . American Educational Research Journal, 1979, 16, 17-24.
23.
Morris, J. D.The predictive accuracy of full-rank variables vs. various types of factor scores: Implications for test validation . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1980, 40, 389-396.
24.
Morris, J. D. and Guertin, W. H.The superiority of factor scores as predictors. Journal of Experimental Education, 1977, 45, 41-44.
25.
Moseley, E. C. and Klett, C. J.An empirical comparison of factor scoring methods. Psychological Reports, 1964, 14, 179-184.
26.
Mulaik, S. A.The Foundations offactor analysis. New York, New York: McGraw-Hill Book Company, 1972.
27.
Nicholson, G. E. The application of a regression equation to a new sample. Unpublished doctoral dissertation, University of North Carolina, 1948.
28.
Rozeboom, W. W.Estimation of cross-validated multiple correlation: A clarification . Psychological Bulletin, 1978, 85, 1348-1351.
29.
Schmitt, N. , Coyle, B. W., and Rauschenberger, J. A.Monte Carlo Evaluation of three formula estimates of cross-validated multiple correlation. Psychological Bulletin, 1977, 84, 751-758.
30.
Thomson, G. H.Some points of mathematical technique in the factorial analysis of ability . Journal of Educational Psychology, 1936, 27, 37-54.
31.
Thurstone, L. L.Multiple-factor analysis. Chicago: University of Chicago Press, 1947.
32.
Thurstone, L. L.The vectors of mind. Chicago: University of Chicago Press, 1935.
33.
Tucker, L. R.Relations of factor score estimates to their use . Psychometrika, 1971, 36, 427-436.
34.
Velicer, W. F.The relation between factor score estimates, image scores, and principal component scores . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1976, 36, 149-159.
35.
Wackwitz, J. H. and Horn, J. L.On obtaining the best estimates of factor scores within an ideal simple structure. Multivariate Behavioral Research, 1971, 6. 389-408.
36.
Wherry, R. J.A new formula for predicting the shrinkage of the coefficient of multiple correlation . Annals of Mathematical Statistics, 1931, 2, 440-457.
37.
Winer, B. J.Statistical principles in experimental design. New York New York: McGraw-Hill Book Company, 1971.
