This study applies multi-level analysis to student reports of effective teacher-student interactions in 50 upper elementary school classrooms (N = 594 fourth- and fifth-grade students). Observational studies suggest that teacher-student interactions fall into three domains: Emotional Support, Classroom Organization, and Instructional Support. Results of multi-level confirmatory factor analyses indicated that a three-factor model fits between- and within-classroom variability in students’ reports reasonably well. Multi-level regressions provide some evidence of criterion validity, with student reports at the classroom level related to parallel observations. Both classroom- and student-level student report data were associated with students’ reading proficiency and disciplinary referrals. Findings are discussed in terms of implications for future research on student reports of classroom interactions and their practical utility in teacher evaluation and feedback systems.
AleamoniL. M. (1999). Student rating myths versus research facts from 1924 to1998. Journal of Personnel Evaluation in Education, 13, 153-166.
2.
AndermanE. M.MaehrM. L.MidgleyC. (1999). Declining motivation after the transition to middle school: Schools can make a difference. Journal of Research and Development in Education, 32, 131-147.
3.
BedeianA. G.MossholderK. W. (2000). On the use of the coefficient of variation as a measure of diversity. Organizational Research Methods, 3, 285-297.
4.
BentlerP. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.
5.
BentlerP. M. (1995). EQS structural equations program manual. Encino, CA: Multivariate Software.
6.
BlairC. (2002). School readiness: Integrating cognition and emotion in a neurobiological conceptualization of children’s functioning at school entry. American Psychologist, 57, 111-127.
7.
BlieseP. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In KleinK. J.KozlowskiS. W. (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco, CA: Jossey-Bass.
8.
BlieseP. D.HalversonR. R. (1998). Group consensus and psychological well-bring: A large field study. Journal of Applied Social Psychology, 28, 563-580.
BowlbyJ. (1969). Attachment. Attachment and loss: Vol. 1. Loss. New York, NY: Basic Books.
11.
BransfordJ. D.BrownA. L.CockingR. R. (2000). How people learn: Brain, mind, experience, and school, expanded edition. Washington, DC: National Academies Press.
12.
BrennanR. L. (1995). The conventional wisdom about group mean scores. Journal of Educational Measurement, 32, 385-396.
13.
BrophyJ.EvertsonC. (1976). Learning from teaching: A developmental perspective. Boston, MA: Allyn & Bacon.
14.
BrowneM. W.CudeckR. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230-258. doi:10.1177/0049124192021002005
15.
BurnhamK. P.AndersonD. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). New York: Springer.
16.
BuyseE.VerschuerenK.DoumenS.Van DammeJ.MaesF. (2008). Classroom problem behavior and teacher-child relationships in kindergarten: The moderating role of the classroom climate. Journal of School Psychology, 46, 367-391.
17.
CampbellD. T.FiskeD. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
18.
CattsH. W.FeyM. E.ZhangX.TomblinJ. B. (2001). Language basis of reading and reading disabilities: Evidence from a longitudinal investigation. Scientific Studies of Reading, 3, 331-361.
19.
CicchettiD. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284-290.
20.
ConnellJ. P.WellbornJ. G. (1991). Competence, autonomy, and relatedness: A motivational analysis of self-system processes. In GunnarM. R.SroufeL. A. (Eds.), Self process and development: The Minnesota symposia on child development (Vol. 23, pp. 43-77). Hillsdale, NJ: Lawrence Erlbaum.
21.
CronbachL. J.GleserG. C.NandaH.RajaratnamN. (1972). The dependability of behavioral measurements. New York, NY: Wiley.
22.
CroonM. A.van VeldhovenM. (2007). Predicting group-level outcome variables from variables measured at the individual level: A latent variable multilevel model. Psychological Methods, 12, 45-57.
23.
CurbyT. W.Rimm-KaufmanS. E.PonitzC. C. (2009). Teacher-child interactions and children’s achievement trajectories across kindergarten and first grade. Journal of Educational Psychology, 101, 912-925.
24.
De Los ReyesA.ThomasS. A.GoodmanK. L.KundeyS. M. A. (2013). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9, 123-149.
25.
den BrokP.BrekelmansM.WubbelsT. (2006). Multilevel issues in research using students’ perceptions of learning environments: The case of the Questionnaire on Teacher Interaction. Learning Environments Research, 9, 199-213.
26.
DollB.ChampionA.KurienS. (2008, February). Social and psychological context for high quality classrooms. Poster presented at the 2008 Annual Convention of the National Association of School Psychologists, New Orleans, LA.
27.
DollB.SpiesR. A. (2007, March). The CMS. Paper presented at the Annual Convention of the National Association of School Psychologists, New York, NY.
28.
DollB.SpiesR. A.LeClairC. M.KurienS. A.FoleyB. P. (2010). Student perceptions of classroom learning environments: Development of the ClassMaps Survey. School Psychology Review, 39, 203-218.
29.
EmmerE. T.StroughL. (2001). Classroom management: A critical part of educational psychology, with implications for teacher education. Educational Psychologist, 36, 103-112.
30.
EvertsonC.EmmerE.SanfordJ.ClementsB. (1983). Improving classroom management: An experiment in elementary classrooms. Elementary School Journal, 84, 173-188.
31.
FauthB.DecristanJ.RieserS.KliemeE.BüttnerG. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1-9.
32.
FeldlauferH.MidgleyC.EcclesJ. (1988). Student, teacher, and observer perceptions of the classroom before and after the transition to junior high school. Journal of Early Adolescence, 8, 133-156.
33.
FraserB. J.McRobbieC. J. (1995). Science laboratory classroom environments at schools and universities: A cross-national study. Educational Research and Evaluation, 1, 289-317.
34.
FraserB. J.O’BrienP. (1985). Student and teacher perceptions of the environment of elementary school classrooms. Elementary School Journal, 85, 567-580.
GazelleH. (2006). Class climate moderates peer relations and emotional adjustment in children with an early childhood history of anxious solitude: A child-by-environment model. Developmental Psychology, 42, 1179-1192.
37.
Gonzalez-RomaV.PeiroJ. M.TorderaN. (2002). An examination of the antecedents and moderator influences of climate strength. Journal of Applied Psychology, 87, 465-473.
38.
GrahamJ. W.HoferS. M.MacKinnonD. P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application of maximum likelihood procedures. Multivariate Behavioral Research, 31, 197-218. doi:10.1207/s15327906mbr3102_3
39.
HafenC. A.HamreB. K.AllenJ. P.BellC. A.GitomerD. H.PiantaR. C. (2014). Teaching through interactions in secondary classrooms: Revisiting the factor structure and practical application of the Classroom Assessment Scoring System–Secondary. Journal of Early Adolescence. Advance online publication. doi:10.1177/0272431614537117
40.
HambletonR. K.CrockerL.CruseK.DoddB.PlakeB. S.PoggioJ. (2008). Review of selected technical characteristics of the Virginia Standards of Learning (SOL) assessments. Richmond, VA: Virginia Department of Education.
41.
HamreB. K.HatfieldB.PiantaR.JamilF. (2013). Evidence for general and domain-specific elements of teacher-child interactions: Associations with preschool children’s development. Child Development, 85, 1257-1274.
42.
HamreB. K.PiantaR. C. (2005). Can instructional and emotional support in the first grade classroom make a difference for children at risk of school failure?Child Development, 76, 949-967.
43.
HamreB. K.PiantaR. C. (2007). Learning opportunities in preschool and early elementary classrooms. In PiantaR. C.CoxM. J.SnowK. (Eds.), School readiness and the transition to school (pp. 49-84). Baltimore, MD: Paul H. Brookes.
44.
HamreB. K.PiantaR. C. (2010). Classroom environments and developmental processes: Conceptualization and measurement. In MeeceJ.EcclesJ. (Eds.), Handbook of research on schools, schooling, and human development (pp. 25-41). New York, NY: Routledge.
45.
HamreB. K.PiantaR. C.DownerJ. T.HamagamiA.MashburnA.JonesS.. . . BrackettM. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. Elementary School Journal, 113, 461-487.
46.
HarelO. M.StrattonJ.AseltineR. (2012). Designed missingness to better estimate efficacy of behavioral studies (Technical Report 11-15). Storrs: Department of Statistics, University of Connecticut.
47.
HowesC.BurchinalM.PiantaR.BryantD.EarlyD.CliffordR.BarbarinO. (2008). Ready to learn? Children’s pre-academic achievement in pre-kindergarten programs. Early Childhood Research Quarterly, 23, 27-50.
48.
HuL.BentlerP. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
49.
KaneM. T. (2001). Current concerns in validity theory. Journal of Education Measurement, 38, 319-342.
50.
KaneM. T.BrennanR. L. (1977). The generalizability of class means. Review of Educational Research, 47, 267-292.
KennyD. A. (2004). PERSON: A general model of interpersonal perception. Personality and Social Psychology Review, 8, 265-280. doi:10.1207/s15327957pspr0803_3
53.
KliemeE.PauliC.ReusserK. (2009). The Pythagoras study: Investigating effects of teaching and learning in Swiss and German mathematics classrooms. In JanikT.SeidelT. (Eds.), The power of video studies in investigating teaching and learning in the classroom (pp. 137-160). Münster, Germany: Waxmann.
54.
KoskeyK. L. K.KarabenickS. A.WoolleyM. E.BonneyC. R.DeverB. V. (2010). Cognitive validity of students’ self-reports of classroom mastery goal structure: What students are thinking and why it matters. Contemporary Educational Psychology, 35, 254-263. doi:10.1016/j.cedpsych.2010.05.004
55.
KulikJ. A.KulikC.-L. (1988). Timing of feedback and verbal learning. Review of Educational Research, 58, 79-97.
56.
KunterM.BaumertJ. (2006). Who is the expert? Construct and criteria validity of student and teacher ratings of instruction. Learning Environments Research, 9, 231-251.
57.
LittleT. D.CunninghamW. A.ShaharG.WidamanK. F. (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling, 9, 151-173.
58.
LittleT. D.RhemtullaM. (2013). Planned missing data designs for developmental researchers. Child Development Perspectives, 7, 199-204.
59.
LüdtkeO.MarshH. W.RobitzschA.TrautweinU. (2011). A 2 × 2 taxonomy of multilevel latent contextual models: Accuracy-bias trade-offs in full and partial error correction models. Psychological Methods, 16, 444-467.
60.
MaasC. J. M.HoxJ. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1, 86-92.
61.
MandinachE. B.JacksonS. S. (2012). Transforming teaching and learning through data driven decision making. Thousand Oaks, CA: Corwin.
62.
MarcoulidesG. A. (1996). Estimating variance components in generalizability theory: The covariance structure analysis approach. Structural Equation Modeling: A Multidisciplinary Journal, 3, 290-299.
63.
MarshH. W.LüdtkeO.NagengastB.TrautweinU.MorinA. J. S.AbduljabbarA. S.KollerO. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47, 106-124. doi:10.1080/00461520.2012.670488
64.
MarshH. W.LüdtkeO.RobitzschA.TrautweinU.AsparouhovT.MuthénB.NagengastB. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44, 764-802.
65.
MayerR. E. (2002). Rote versus meaningful learning. Theory Into Practice, 41, 226-233.
MorinA. J. S.MarshH. W.NagengastB.ScalasL. F. (2014). Doubly latent multilevel analyses of classroom climate: An illustration. Journal of Experimental Education, 82, 143-167.
NICHD Early Child Care Research Network. (2003). Social functioning in first grade: Prediction from home, child care and concurrent school experience. Child Development, 74, 1639-1662.
71.
NickoliteA.DollB. (2008). Resilience applied in school: Strengthening classroom environments for learning. Canadian Journal of School Psychology, 23, 94-113.
72.
O’BrienR. M. (1991). Estimating the reliability of aggregate-level variables based on individual-level characteristics. Sociological Methods & Research, 18, 473-504.
73.
PakarinenE.LerkkanenM.-K.PoikkeusA.-M.KiuruN.SiekkinenM.Rasku-PuttonenH.NurmiJ.-E. (2010). A validation of the Classroom Assessment Scoring System in Finnish kindergartens. Early Education and Development, 21, 95-124.
74.
PiantaR. C.AllenJ. (2008). Building capacity for positive youth development in secondary school classrooms: Changing teachers’ interactions with students. In ShinnM.YoshikawaH. (Eds.), Toward positive youth development: Transforming schools and community programs. New York, NY: Oxford University Press.
75.
PiantaR. C.BelskyJ.VandergriftN.HoutsR.MorrisonF. (2008). Classroom effects on children’s achievement trajectories in elementary school. American Educational Research Journal, 45, 365-397.
76.
PiantaR. C.HamreB. K.MintzS. L. (2010). Classroom Assessment Scoring System manual–Upper elementary. Charlottesville: University of Virginia.
77.
PonitzC. C.Rimm-KaufmanS. E.BrockL. L.NathansonL. (2009). Contributions of gender, early school adjustment, and classroom organizational climate to first grade outcomes. Elementary School Journal, 110, 143-162.
78.
PressleyM.RoehrigA.RaphaelL.DolezalS.BohnK.MohanL.Wharton-McDonaldR.BognerKHoganK. (2003). Teaching processes in elementary and secondary education. In ReynoldsW. M.MillerG. E. (Eds.), Comprehensive handbook of psychology: Vol. 7. Educational psychology (pp. 153-176). New York: Wiley.
79.
RaudenbushS.SadoffS. (2008). Statistical inference when classroom quality is measured with error. Journal of Research on Educational Effectiveness, 1, 138-154.
80.
ReyesM. R.BrackettM. A.RiversS. E.WhiteM.SaloveyP. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104, 700-712. doi:10.1037/a0027268
81.
Rimm-KaufmanS. E.CurbyT. W.GrimmK.NathansonL.BrockL. L. (2009). The contribution of children’s self-regulation and classroom quality to children’s adaptive behaviors in the kindergarten classroom. Developmental Psychology, 45, 958-972.
82.
RoeserR. W.EcclesJ. S.SameroffA. J. (2000). School as a context of early adolescents’ academic and social-emotional development: A summary of research findings. The Elementary School Journal, 100, 443-471.
83.
RuzekE. A.PiantaR. C. (2015). The value of using observational and student report methodologies in classroom research. In Rubie-DaviesC.StephensJ.WatsonP. (Eds.), The social psychology of the classroom international handbook. New York, NY: Routledge.
84.
SchweigJ. (2014). Multilevel factor analysis by model segregation: New applications for robust test statistics. Journal of Educational and Behavioral Statistics, 39, 394-422.
85.
ShavelsonR. J.WebbN. M. (1991). Generalizability theory: A primer. Newbury Park, CA: SAGE.
86.
SkibbeL.BehnkeM.JusticeL. (2004). Parental scaffolding of phonological awareness: Interactions between mothers and their preschoolers with language impairment. Communication Disorders Quarterly, 25, 189-203.
87.
TaylorB. M.PearsonP. D.PetersonD. S.RodriguezM. C. (2003). Reading growth in high-poverty classrooms: The influence of teacher practices that encourage cognitive engagement in literacy learning. The Elementary School Journal, 104, 3-28.
88.
VitielloV. E.MoasO.HendersonH. A.GreenfieldD. B.MunisP. M. (2012). Goodness of fit between children and classrooms: Effects of child temperament and preschool classroom quality on achievement trajectories. Early Education and Development, 23, 302-322.
89.
WagnerW.GöllnerR.HelmkeA.TrautweinU.LüdtkeO. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1-11. doi:10.1016/j.learninstruc.2013.03.003
90.
WoolleyM. E.BowenN. K.BowenG. L. (2005). Mixed methods: Meaning and validity in the development of self-report items for children. In BengtsonV.AcockA.AllenK.Dilworth-AndersonP. (Eds.), Sourcebook of family theory and research (pp. 77-80). Beverly Hills, CA: Sage.
91.
WubbelsT.BrekelmansM. (2005). Two decades of research on teacher–student relationships in class. International Journal of Educational Research, 43, 6-24.
