A procedure is presented for the analysis of rating data with correlated intrajudge and uncorrelated interjudge measurement errors. Correlations between true scores on different rating dimensions, reliabilities for each judge on each dimension and correlations between intrajudge errors can be estimated given a minimum of three raters and two dimensions.
Get full access to this article
View all access options for this article.
References
1.
Campbell, D. T. and Fiske, D. W.Convergent and discriminant validation by validation by the multitrait-multimethod matrix. Psychological Bulletin , 1959, 56, 81-105.
2.
Fisher, F. M.The identification problem in econometrics. New York: McGraw-Hill , 1966.
3.
Jöreskog, K. G. and Gruvaeus, G. T.RMLFA—A computer program for restricted maximum likelihood factor analysis. RB-67-21. Princeton, N. J. : Educational Testing Service, 1967 .
4.
Jöreskog, K. G.A general method for analysis of covariance structures. Biometrika, 1970 , 57, 239-251.
5.
Jöreskog, K. G., Gruvaeus, G. T., and van Thillo, M.ACOVS—A general computer program for analysis of covariance structures . RB-70-15. Princeton, N. J.: Educational Testing Service, 1970.
6.
Jöreskog, K. G. and van Thillo, M.LISREL—A general computer program for estimating a linear structural equation system involving multiple indicators of unmeasured variables. RB-72-56. Princeton, N. J.: Educational Testing Service, 1972.
7.
Werts, C. E., Jöreskog, K. G. and Linn, R. L.A multitrait-multimethod model for studying growth. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 197232, 655-678.
