Teachers’ ratings of children’s competencies may in part reflect characteristics and perspectives of teachers who assigned the ratings, which compromises their validity as a measure of child attributes. The purposes of this study were to use multilevel modeling to (a) estimate between-rater variance in teachers’ ratings of children’s social behaviors and relationships with teachers and (b) examine characteristics of teachers and classrooms associated with teachers’ perceptions of these social competencies. Ratings of 711 children completed by 210 prekindergarten teachers indicated that between 15% and 33% of the total variance in teachers’ ratings was attributed to mean differences between raters. After controlling for characteristics of children and their families, teachers’ ratings of positive relationships and behaviors were associated with fewer years of experience, higher self-efficacy, non-White race/ethnicity, shorter length programs, better child-teacher ratios, and programs located within school settings. Implications are discussed for interpreting and analyzing teachers’ ratings of children’s competencies.
Bandura, A. (1997). The exercise of control. New York: Freeman.
2.
Birch, S. H., & Ladd, G. W. (1998). Children’s interpersonal behaviors and the teacher-child relationship. Developmental Psychology, 34, 934-946.
3.
Canivez, G. L., Watkins, M. W., & Schaefer, B. A. (2002). Interrater agreement for discriminant classifications for the adjustment scales for children and adolescents. Psychology in the Schools, 39, 375-384.
4.
Carrow-Woolfolk, E. (1995). Oral and written language scales. Circle Pines, MN: American Guidance Service.
5.
Chow, B. W., & McBride-Chang, C. (2003). Promoting language and literacy development through parent-child reading in Hong Kong preschoolers. Early Education and Development, 14, 233-248.
6.
Dunn, L. M., & Dunn, L. M. (1997). Peabody Picture Vocabulary Test-third edition. Circle Pines, MN: American Guidance Service, Inc.
7.
Engelhard, G., Jr. (2002). Monitoring raters in performance assessments. In G. Tindal & T. M. Haladyna (Eds.), Large-scale assessment programs for all students (pp. 261-288). Mahwah, NJ: Lawrence Erlbaum.
8.
Entwisle, D. R., & Hayduk, L. A. (1988). Lasting effects of elementary school. Sociology of Education, 61, 147-159.
9.
Hamre, B. K., & Pianta, R. C. (2001). Early teacher-child relationships and the trajectory of children’s school outcomes through eighth grade. Child Development, 72, 625-638.
10.
Hamre, B., & Pianta, R. (2004). Self-reported depression in nonfamilial caregivers: Prevalence and associations with caregiver behavior in child care settings. Early Childhood Research Quarterly, 19, 297-318.
11.
Hightower, A. D., Work, W. C., Cowen, E. L., Lotczewski, B. S., Spinnell, A. P., Guare, J. C., et al. (1986). The teacher-rating scale: A brief objective measure of elementary children’s school problem behaviors and competencies. School Psychology Review, 15, 393-409.
12.
Hopkins, K. D., George, C. A., & Williams, D. D. (1985). The concurrent validity of standardized achievement tests by content area using teachers’ ratings as criteria. Journal of Educational Measurement, 22, 177-182.
13.
Jackson, D. A., & King, A. R. (2004). Gender differences in the effects of oppositional behavior on teacher ratings of ADHD symptoms. Journal of Abnormal Child Psychology, 32, 215-224.
14.
Kenny, D. T., & Chekaluk, E. (1993). Early reading performance: A comparison of teacher-based and test-based assessments. Journal of Learning Disabilities, 26, 227-236.
15.
Konold, T., Walthall, J., & Pianta, R. C. (2004). The behavior of child behavior ratings: Measurement structure of the Child Behavior Checklist across time, informants, and child gender. Journal of Behavioral Disorders, 29, 372-383.
16.
Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boice, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160, 1566-1577.
17.
Lynch, M., & Cicchetti, D. (1997). Children’s relationships with adults and peers: An examination of elementary and junior high school students. Journal of School Psychology, 35, 81-99.
18.
Mashburn, A. J., & Henry, G. T. (2004). Assessing school readiness: Validity and bias in preschool and kindergarten teachers’ ratings. Educational Measurement: Issues and Practice, 23(4), 16-30.
19.
McConaughy, S. H. (1993). Evaluating behavioral and emotional disorders with the CBCL, TRF, and YSR cross-informant scales. Journal of Emotional and Behavioral Disorders, 1, 40-52.
20.
McConaughy, S. H., & Ritter, D. R. (1995). Best practices in multidimensional assessment of emotional and behavioral disorders. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology (Vol. 3, pp. 865-873). Washington, DC: NASP.
21.
Pianta, R. C. (2001). Student-Teacher Relationship Scale [STRS]. Lutz, FL: Psychological Assessment Resources, Inc.
22.
Pianta, R. C., Steinberg, M. S., & Rollins, K. B. (1995). The first two years of school: Teacher-child relationships and deflections in children’s classroom adjustment. Development and Psychopathology, 7, 295-312.
23.
Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Journal of Applied Psychological Measures, 1, 385-401.
24.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage.
25.
Rimm-Kaufman, S. E., Pianta, R. C., & Cox, M. J. (2000). Teachers’ judgments of success in the transition to kindergarten. Early Childhood Research Quarterly, 15, 147-166.
26.
Schaefer, E. S., & Edgerton, M. (1985). Parent and child correlates of parental modernity. In I. E. Sigel (Ed.), Parental belief systems: Psychological consequences for children (pp. 287-318). Hillsdale, NJ: Lawrence Erlbaum.
27.
Shepard, L., Kagan, S. L., & Wurtz, E. (1998). Principals and recommendations for early childhood assessments. Retrieved July 22, 2005, from http://www.negp.gov/index.htm
28.
Singer, J. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 24, 323-355.
29.
Weissberg, R. P., Cowen, E. L., Loyyczewski, B. S., Boike, M. F., Orara, N. A., Stalonas, P., et al. (1987). Teacher ratings of children’s problem and competence behaviors: Normative and parametric characteristics. American Journal of Community Psychology, 15, 387-401.
30.
Woodcock, R. W., & Johnson, M. B. (1990). Woodcock-Johnson Psychoeducational Battery-Revised. Allen, TX: DLM Teaching Resources.
