Estimating Reliability and Generalizability in Coefficients in Two-Facet Designs

Abstract

This article illustrates the use of generalizability theory to estimate the reliability of a measure when there is more than one source of error in the universe of inference, and how the effects from changing the number of items and/or raters can be evaluated.

Get full access to this article

View all access options for this article.

References

Cronbach, L.J. Coefficients alpha and the internal structure of tests. Psychometrika , 1951, 16, 297-334.

Cronbach, L.J. , Gleser, G.C. , Nanda, H. , & Rajaratnam, N. The dependability of behavioral measurements . New York: Wiley, 1972.

Godshalk, F.I. , Swineford, F. , & Coffman, W.E. The measurement of writing ability. CEEB, 1966.

Goodstein, H.A. The reliability of criterion-referenced tests and special education : Assumed versus demonstrated. Journal of Special Education , 1982, 16, 37-48.

Hopkins, K.D. , & Stanley, J. Educational and psychological measurement and evaluation. Englewood Cliffs, N.J.: Prentice-Hall, 1981.

Hoyt, C. . Test reliability estimated by analysis of variance. Psychometrika, 1941, 6, 153-160.

Kuder, G.G. , & Richardson, M.W. The theory of the estimation of test reliability . Psychometrika, 1937, 2, 151-160.