An approximate statistical test is derived for the hypothesis that the intraclass reliability coefficients associated with two measurement procedures are equal. Control of Type 1 error is investigated by comparing empirical sampling distributions of the test statistic with its derived theoretical distribu tion. A numerical illustration of the procedure is also presented.
Bartko, J.J. (1966). The intraclass correlation coefficients as a measure of reliability. Psychological Reports, 19, 3-11.
2.
Bartko, J.J. (1976). On various intraclass correlation reliability coefficients. Psychological Bulletin,83, 762-765.
3.
Baumgartner, T.A., & Jackson, A.S. (1987). Measurement for evaluation in physical education and exercise science (3rd ed.). Dubuque IA: W. C. Brown.
4.
Bross, I.D.J. (1959). Note on an application of the Schumann-Bradley table. Annals of Mathematical Statistics, 30, 220-238.
5.
Browne, M.W. (1968). A comparison of factor analytic techniques. Psychometrika, 33, 267-334.
6.
Donner, A. (1986). A review of inference procedures for the intraclass correlation coefficient in the one-way random effects model. International Statistical Review, 54, 67-82.
7.
Donner, A., & Bull, S.B. (1983). Inferences concerning a common intraclass correlation coefficient. Biometrics, 39, 771-776.
8.
Ebel, R.L. (1951). Estimation of the reliability of ratings. Psychometrika, 16, 407-424.
9.
Feldt, L.S. (1969). A test of the hypothesis that Cronbach's alpha or Kuder-Richardson coefficient twenty is the same for two tests. Psychometrika, 34, 363-373.
10.
Feldt, L.S. (1980). A test of the hypothesis that Cronbach's alpha reliability coefficient is the same for two tests administered to the same sample. Psychometrika, 49, 99-105.
11.
Feldt, L.S. (1989). Reliability. In R. L. Linn (Ed.), Educational Measurement (3rd ed.) (pp. 116-117). New York: Macmillan.
12.
Feldt, L.S. (1990). The sampling theory for the intraclass reliability coefficient. Applied Measurement in Education, 3, 361-367.
13.
Fisher, R.A. (1970). Statistical methods for research workers (14th ed.). Darien CT: Hafner Publishing Company.
14.
Haggard, E.A. (1958). Intraclass correlation and the analysis of variance . New York: Dryden Press.
15.
Hogg, R.V., & Craig, A.T. (1978). Introduction to mathematical statistics (4th ed.). New York: Macmillan.
16.
Imsl. (1987). International mathematical and statistical libraries (10th ed.). Houston: Author.
17.
Kendall, M.G., & Stuart A. (1977). The advanced theory of statistics (Vol. 1, 4th ed.). New York: MacMillan.
18.
Kraemer, H.C. (1981). Extensions of Feldt's approach to testing homogeneity of coefficients of reliability. Psychometrika, 45, 41-45.
19.
Lord, F.M. (1955). A survey of observed test-score distributions with respect to skewness and kurtosis. Educational and Psychological Measurement, 15, 383-389.
20.
Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading MA: Addison-Wesley.
21.
Odell, P.L., & Feiveson, A.N. (1966). A numerical procedure to generate a sample covariance matrix. Journal of the American Statistical Association,61, 199-203.
22.
Satterthwaite, F.E. (1941). Synthesis of variance. Psychometrika , 6, 309-316.
23.
Satterthwaite, F.E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110-114.
24.
Scheffé, H. (1959). The analysis of variance. New York: Wiley.
25.
Schumann, D.E.W., & Bradley, R.A. (1957). The comparison of the sensitivities of similar experiments: Theory. Annals of Mathematical Statistics, 28, 902-920.
26.
Schumann, D.E.W., & Bradley, R.A. (1959). The comparison of the sensitivities of similar experiments: Model II of the analysis of variance. Biometrics , 15, 405-416.
