The interrater reliability of three different interaction scales—the Maternal Behavior Rating Scale, the Rating Scales of Mother-Child Interaction, and the Teaching Skills Inventory—were estimated with four different statistical techniques: Pearson correlations, percentages of agreement, comparisons of raters' means, and generalizability theory techniques. The estimates varied widely, both within and across the three interaction scales. The meanings of each statistical approach are discussed, and some suggestions are given to help a researcher decide which approach to use in particular circumstances.
Get full access to this article
View all access options for this article.
References
1.
Als, H., & Brazelton, T.B. (1980). Affective reciprocity and the development of autonomy. Journal of American Academy of Child Phychiatry, 19, 22–40.
2.
Bruner, J.S. (1975). The ontogenesis of speech acts. Journal of Child Language, 2, 1–19.
3.
Clark, R., Musick, J., Stott, R., & Klehr, K. (1980). Rating scales of mother--child interaction.Chicago: The Thresholds' Mothers' Project.
4.
Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles.New York: Wiley.
5.
Fewell, R.R. (1986). The measurement of family functioning. In L. Bickman & D.L. Weatherford (Eds.), Evaluating early intervention programs for severely handicapped children and their families (pp. 263–307). Austin, TX: Pro-Ed.
6.
Field, T. (1983). High-risk infants “have less fun” during early interventions. Topics in Early Childhood Special Education, 3, 77–87.
7.
Glass, G.V., & Hopkins, K.D. (1984). Statistical methods in education and psychology (2nd ed.). Englewood Cliffs, N.J.: Prentice-Hall.
8.
Goodwin, L.D., & Prescott, P.A. (1981). Issues and approaches to estimating interrater reliability in nursing research. Research in Nursing and Health, 4, 323–337.
9.
Goodwin, W.L., & Driscoll, L.A. (1980). Handbook for measurement and evaluation in early childhood education.San Francisco: Jossey-Bass.
10.
Hanson, M.J., & Krentz, M.S. (1986). Supporting parent-child interactions: A guide for early intervention program personnel.San Francisco: San Francisco State University.
11.
Hopkins, K.D., & Stanley, J.C. (1981). Educational and psychological measurement and evaluation (6th ed.). Englewood Cliffs, NJ: Prentice-Hall.
12.
Johnson, O.G. (1976). Tests and measurements in child development: Handbook II.San Francisco: Jossey-Bass.
13.
Kane, M.T., & Brennan, R.L. (1977). The generalizability of class means. Review of Educational Research, 47, 267–292.
14.
Kirk, R.E., (1982). Experimental design: Procedures for the behavioral sciences (2nd ed.). Monterey, CA: Brooks/Cole.
15.
Mahoney, G., Finger, I., & Powell, A. (1985). The relationship of maternal behavioral style to the developmental status of organically impaired mentally retarded infants. American Journal of Mental Deficiency, 90, 296–302.
16.
Mahoney, G., & Powell, A. (1986). Transactional intervention program.Farmington: University of Connecticut School of Medicine.
17.
Mahoney, G., Powell, A., & Finger, I. (1986). The Maternal Behavior Rating Scale. Topics in Early Childhood Special Education, 6, 44–56.
18.
McCollum, J., & Stayton, V.D. (1985). Infant/parent interaction: Studies and intervention guidelines based on the SIAI model. Journal of the Division for Early Childhood, 9, 125–135.
19.
Rosenberg, S.A., & Robinson, C.C. (1985). Development and use of the Teaching Skills Inventory. Unpublished manuscript. Omaha: University of Nebraska Medical Center.
20.
Rosenberg, S.A., Robinson, C.C., & Beckman, P.J. (1986). Measures of parent--infant interaction: An overview. Topics in Early Childhood Special Education, 6, 32–43.
Snow, C.E. (1984). Parent-child interaction and the development of communicative ability. In R.L. Schiefelbusch & J. Pickar (Eds.), The acquisition of communicative competence (pp. 69–107). Baltimore: University Park Press.
23.
Stern, D., Beebe, B., Jaffe, J., & Bennett, S.L. (1977). The infant's stimulus world during social interaction: A study of caregiver behaviors with particular reference to repetition and timing. In H.R. Schaffer (Ed.), Studies of mother--infant interaction.New York: Academic Press.
24.
Walker, D.K. (1973). Socioemotional measures for preschool and kindergarten children.San Francisco: Jossey-Bass.
25.
Webb, N.M., Rowley, G.L., & Shavelson, R.J. (1988). Using generalizability theory in counseling and development. Measurement and Evaluation in Counseling and Development, 21, 81–90.
26.
Winer, B.J. (1971). Statistical principles in experimental design (2nd ed.). New York: McGraw-Hill.
27.
Zimiles, H. (1986). Rethinking the role of research: New issues and lingering doubts in an era of expanding preschool education. Early Childhood Research Quarterly, 1, 189–206.
