A statistical model is given for representing the several components of variability present in measurements (e.g., DMFS scores) given by examiners to patients. Methods for making inferences about the intraclass correlation coefficient of reliability are presented and illustrated on a real set of data. The proper analysis of data from a reliability study is shown to depend on the planned design and analysis of the clinical or field trial to be conducted following the reliability trial.
Get full access to this article
View all access options for this article.
References
1.
World Health Organization: Oral Health Surveys - Basic Methods, Geneva: W.H.O. , 1971.
2.
De Paola, P.F. ; and Alman, J.: Assessment of the Reliability of Radiographic Diagnosis in a Clinical Caries Trial, J Dent Res51:1431-1437, 1972.
3.
Rugg-Gunn, A.J. ; and Holloway, P.J.: Methods of Measuring the Reliability of Caries Prevalence and Incremental Data, Community Dent & Oral Epidemiol2 :287-294,1974.
4.
Slakter, M.J. ; Juliano, D.B.; and Fischman , S.L.: Estimating Examiner Consistency with DMFS Measures, J Dent Res55:930-934,1976.
5.
Fleiss, J.L. ; and Shrout, P.E.: The Effects of Measurement Errors on Some Multivariate Procedures, Amer J Pub Hlth, 67:1188-1191, 1977.
6.
Fischman, S. ; Picozzi, A.; Juliano, D.; Slakter, M.; and English, J.: Examiner Standardization for Caries Studies , J Dent Res55:926-929, 1976.
7.
Fleiss, J.L. ; Fischman, S.L.; Chilton, N.W.; and Park, M.H.: The Reliability of Discrete Measurements in Caries Trials, J Caries Res, in press.
8.
Shrout, P.E. ; and Fleiss, J.L.: Intraclass Correlations: Uses in Assessing Rater Reliability, Psychol Bull, in press.
9.
Scheffe, H.: The Analysis of Variance, New York, Wiley, 1959.
10.
Satterthwaite, F.E.: An Approximate Distribution of Estimates of Variance Components, Biometrics2:110-114, 1946.
11.
Fleiss, J.L. ; and Shrout, P.E.: Approximate Interval Estimation for a Certain Intraclass Correlation Coefficient, Psychometrika, 43:259-262,1978.
