The inter-rater reliability of Cattell's scree and Linn's mean square ratio test of the number of factors was studied. Sample correlation matrices were generated from a population correlation matrix by means of standard Monte Carlo procedures such that there were 100 samples based on each of 3 sample sizes. Each matrix was factored and the scree test and the mean square ratio test were each applied by five raters. For both tests, the inter-rater reliabilities were very low. These results suggest that inexperienced factor analysts should be wary of these tests of the number of factors.
CattellR. B.The scree test for the number of factors. Multivariate Behavioral Research, 1966, 1, 245–276.
3.
CattellR. B., & SullivanW.The scientific nature of factors: a demonstration by cups of coffee. Behavioral Sciences, 1962, 7, 184–193.
4.
CliffN., & HamburgerC. D.The study of sampling errors in factor analysis by means of artificial experiments. Psychological Bulletin, 1967, 68, 430–445.
5.
CrawfordC. B.Determining the number of interpretable factors. Psychological Bulletin, 1975, 82, 226–237.
LinnR. L.Use of random normal deviates to determine the number of factors in factor analysis. Unpublished Master's thesis, Univer. of Illinois, Urbana, 1964.
8.
LinnR. L.A Monte Carlo approach to the number of factors problem. Psychometrika, 1968, 33, 37–71.
9.
LordM., & NovickM. R.Statistical theories of mental test scores. Reading, Mass.: Addison-Wesley, 1968.
10.
MulaikS. A.The foundations of factor analysis. New York: McGraw-Hill, 1972.
